EFFECT OF COUNTERS IN PERFORMANCE OF HADOOP

  • Preeti Jain
  • Juhi Kanungo

Abstract

Recent technological advancements have led to an overflow of data from distinctive domains (e.g., health care and scientific sensors, user-generated data, Internet and financial companies, and supply chain systems) over the past two decades [1]. Big data is commonly unstructured, huge in volume and require more real-time analysis. This paper discusses a Big Data problem from NCDC for huge volume of weather data collected from various parts of world. We had generated map () and reduce () function for solving this problem and experimental results of these applications on a Hadoop cluster are being discussed. In this paper, performance of above application has been shown with respect to some counters available.

Downloads

Download data is not yet available.

References

Maurya and Mahajan, S., “Performance analysis of MapReduce programs on Hadoop clusterâ€, Information and Communication Technologies (WICT), 2012 World Congress, ISBN:978-1-4673-4806-5, Oct. 30 2012.

A. Alexandrov, R. Bergmann, S. Ewen, J.C. Freytag, F. Hueske, A. Heise, O. Kao, M. Leich, U. Leser, V. M. Felix Naumann, M. Peters, A. Rheinländer, M. J. Sax and S. Schelter, “The Stratosphere Plateform for Big Data Analyticsâ€, The VLDB Journal,

Springer-Verlag Berlin Heidelberg, July 2013.

Shilpa and Manjit Kaur, “Big Data Visualization tool with Advancement of Chalange†International Journal of Advanced Research in Computer and Software Engineeringâ€, ISSN: 2277 128X, Volume 4, Issue 3, March 2014. [4] D. Borthakur, “The Hadoop Distributed File System: Architecture and Designâ€. [5] Han Hu, Yonggang Wen , Tat-Seng Chua and Xuelong Li, “Toward Scalable Systems for Big Data Analytics: A Technology Tutorialâ€, ISSN :2169-3536, INSPEC Accession Number: 14429402

P. Kumar and Dr. V. S. Rathore, “Efficient Capabilities of Processing of Big Data using Hadoop Map Reduceâ€, International Journal of Advanced Research in Computer and Communication Engineering, Vol. 3, Issue 6, June 2014.

Shilpa and Manjit Kaur, “Big Data Visualization tool with Advancement of Chalange†International Journal of Advanced Research in Computer and Software Engineeringâ€, ISSN: 2277 128X, Volume 4, Issue 3, March 2014.

X. Zhang, “Simple example to demonstrate how does the map reduce workâ€, June 2013.

Published
2015-10-08
How to Cite
Jain, P., & Kanungo, J. (2015). EFFECT OF COUNTERS IN PERFORMANCE OF HADOOP. COMPUSOFT: An International Journal of Advanced Computer Technology, 4(5). Retrieved from https://www.ijact.in/index.php/ijact/article/view/38