EFFECT OF COUNTERS IN PERFORMANCE OF HADOOP
AbstractRecent technological advancements have led to an overflow of data from distinctive domains (e.g., health care and scientific sensors, user-generated data, Internet and financial companies, and supply chain systems) over the past two decades . Big data is commonly unstructured, huge in volume and require more real-time analysis. This paper discusses a Big Data problem from NCDC for huge volume of weather data collected from various parts of world. We had generated map () and reduce () function for solving this problem and experimental results of these applications on a Hadoop cluster are being discussed. In this paper, performance of above application has been shown with respect to some counters available.
Maurya and Mahajan, S., â€œPerformance analysis of MapReduce programs on Hadoop clusterâ€, Information and Communication Technologies (WICT), 2012 World Congress, ISBN:978-1-4673-4806-5, Oct. 30 2012.
A. Alexandrov, R. Bergmann, S. Ewen, J.C. Freytag, F. Hueske, A. Heise, O. Kao, M. Leich, U. Leser, V. M. Felix Naumann, M. Peters, A. RheinlÃ¤nder, M. J. Sax and S. Schelter, â€œThe Stratosphere Plateform for Big Data Analyticsâ€, The VLDB Journal,
Springer-Verlag Berlin Heidelberg, July 2013.
Shilpa and Manjit Kaur, â€œBig Data Visualization tool with Advancement of Chalangeâ€ International Journal of Advanced Research in Computer and Software Engineeringâ€, ISSN: 2277 128X, Volume 4, Issue 3, March 2014.  D. Borthakur, â€œThe Hadoop Distributed File System: Architecture and Designâ€.  Han Hu, Yonggang Wen , Tat-Seng Chua and Xuelong Li, â€œToward Scalable Systems for Big Data Analytics: A Technology Tutorialâ€, ISSN :2169-3536, INSPEC Accession Number: 14429402
P. Kumar and Dr. V. S. Rathore, â€œEfficient Capabilities of Processing of Big Data using Hadoop Map Reduceâ€, International Journal of Advanced Research in Computer and Communication Engineering, Vol. 3, Issue 6, June 2014.
Shilpa and Manjit Kaur, â€œBig Data Visualization tool with Advancement of Chalangeâ€ International Journal of Advanced Research in Computer and Software Engineeringâ€, ISSN: 2277 128X, Volume 4, Issue 3, March 2014.
X. Zhang, â€œSimple example to demonstrate how does the map reduce workâ€, June 2013.
The submitter hereby warrants that the Work (collectively, the “Materials”) is original and that he/she is the author of the Materials. To the extent the Materials incorporate text passages, figures, data or other material from the works of others, the undersigned has obtained any necessary permissions. Where necessary, the undersigned has obtained all third party permissions and consents to grant the license above and has all copies of such permissions and consents.
The submitter represents that he/she has the power and authority to make and execute this assignment. The submitter agrees to indemnify and hold harmless the COMPUSOFT from any damage or expense that may arise in the event of a breach of any of the warranties set forth above. For authenticity, validity and originality of the research paper the author/authors will be totally responsible.