key-value pair level incremental processing in big data environment

Karthikeyan S,Manimegalai R,Hamsapriya T

Published in International Journal of Advanced Research in Computer Science Engineering and Information Technology

ISSN: 2321-3337          Impact Factor:1.521         Volume:6         Issue:3         Year: 20 December,2016         Pages:1215-1219

Abstract

A novel Incremental Processing method is proposed for data analysis in order to keep the mining results up-to-date. To reduce the running time of refreshing the big data results, the proposed workimplements a technique called i2Map Reduce which is an extension of Map Reduce that supports Fine Grain Incremental Processing for both One step and Four iterative computation. i2MapReduce performs key value pair level incremental processing compared to the state-of- art Incoop, that uses task level re computation. It supports not only one step computation but also more sophisticated iterative computation, which is widely used in data mining applications, and incorporates a set of tale techniques to reduce I/O overhead for accessing preserved fine-grain computation states.

Download Journal Download Certificate

Kewords

Bigdata,Hadoop,MapReduce,HDFS,Hive

Reference

Dr.Manimegalai R Principal PARKCT