Please use this identifier to cite or link to this item: http://13.232.72.61:8080/jspui/handle/123456789/303
Title: An Optimal Data Placement Framework to Increase Performance BOF Mapreduce for Data-Intensive Applications with Interest Locality
Authors: Vaghri, Solmaz.
Mohan, K. G.
Keywords: Computer science
Computer network
Issue Date: Jul-2014
Publisher: IJCSE
Citation: Vaghri, Solmaz., & Mohan, K. G. (2014). An optimal data placement framework to increase performance BOF mapreduce for data-intensive applications with interest locality. International Journal of Computer Science and Engineering, 3(4), 8-9.
Abstract: Emerging many numbers of data-intensive applications that needs to access ever-increasing data sets ranging from gigabytes to terabytes or even petabytes, place a demand on employing parallel processing techniques to optimize performance and reduce the decision time. Of late parallel computing frameworks such as MapReduce and it’s open source implementation Apache Hadoop has been used to run large scaledata-intensive applications and conduct analysis, but data locality have not been taken into account in Hadoop and MapReduce and they use random data distribution method for load balancing. Practically in many data-intensive applications data groups often accessed to gather and only subset of a whole data set are frequently used. Ignoring data grouping issue and random data placement noticeably reduce the performance of MapReduce and Hadoop. This paper presents architecture and implementation status of a an optimal data placement framework that dynamically analyzes data accesses from system log files and create optimal data groupings and distribute the data evenly to achieve maximum parallelism per data group and significantly improves the overall performance of MapReduce for data-intensive applications.
URI: http://13.232.72.61:8080/jspui/handle/123456789/303
ISSN: e-2278-9979
p-2278-9960
Appears in Collections:Articles



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.