I am trying to implement a simple problem in map reduce-transpose of a matrix.
Input- 1 2 3
4 5 6
7 8 9
Desired output- 1 4 7
2 5 8
7 8 9
My map output is (0,1) (1,4), (2,7)
(0,2) (1,5), (2,8) and so on. so i was expecting to use the reducer method method as 0-{1,2,7} , 1-{4,5,8} and directly use write to write the object in serialized form. But the shuffle and sort is not giving the desired output. After the map method i am...
Shuffle and sort in map-reduce
Input- 1 2 3
4 5 6
7 8 9
Desired output- 1 4 7
2 5 8
7 8 9
My map output is (0,1) (1,4), (2,7)
(0,2) (1,5), (2,8) and so on. so i was expecting to use the reducer method method as 0-{1,2,7} , 1-{4,5,8} and directly use write to write the object in serialized form. But the shuffle and sort is not giving the desired output. After the map method i am...
Shuffle and sort in map-reduce