Implementation of Big Data Technology using Hadoop Platform

##plugins.themes.bootstrap3.article.main##

Abstract

Big data analytics is a set of advanced analytic techniques used against very large, miscellaneous data sets that include. Using advanced analytic techniques such as machine learning, Analytics like Text and Predictive, statistics, data mining, etc. Businesses can examine previously untouched data sources independently or together with their current enterprise data to gain new perceptions, resulting in faster and better decisions. In this research paper, the Hadoop platform provides an improved programming model that is used to create and run distributed systems quickly and efficiently to process high volumes of data. Big Data, i.e., terabytes to exabytes, consists of large datasets that cannot be managed efficiently by the common database management systems. Mobile phones, Credit cards, Radio Frequency Identification (RFID) devices, and social networking platforms create huge amounts of data that may reside unutilized on unknown servers for many years. However, with the evolution of Big Data, this data can be accessed and analysed regularly to generate useful information.

References

Beyond the Hype: Big Data Concepts, Methods, and Analytics. International Journal of Information Management, 35(2), 13 (2015).

Big Data Technologies: A Survey. Journal of King Saud University – Computer and Information Sciences, 30(4), 431–48 (2018).

Castineira, R., & Metzger, A. (2018, April). The transforming transport project – Mobility meets big data. http://doi.org/10.5281/zenodo.1484954

Cavanillas, J. M., Curry, E., & Wahlster, W. (Eds.). (2016). New horizons for a data-driven economy: A roadmap for usage and exploitation of big data in Europe. https://doi.org/10.1007/978-3-319-21569-3

Curry, E. (2020). Real-time linked data spaces. https://doi.org/10.1007/978-3-030-29665-0

Curry, E., & Ojo, A. (2020). Enabling knowledge flows in an intelligent systems data ecosystem. In Real-time Linked Data Spaces (pp. 15–43). http://doi.org/10.1007/978-3-030-29665-0_2

Erl, T., Khattak, W., & Buhler, P. (2016). Big data fundamentals: Concepts, drivers & techniques. Boston: Prentice Hall.

Metzger, A., Thornton, J., Valverde, F., Lopez, J. F. G., & Rublova, D. (2019a). Transforming Transport. Predictive analytics and predictive maintenance innovation via big data: The case of Transforming Transport. In 13th Intelligent Transport Systems – European Congress (ITS Europe), Brainport–Eindhoven, The Netherlands, June 3–6.

Palm, A., Metzger, A., & Pohl, K. (2020). Online reinforcement learning for self-adaptive information systems. In S. Dustdar, E. Yu, C. Salinesi, D. Rieu, & V. Pant (Eds.), Advanced Information Systems Engineering (pp. 169–184). Cham: Springer.

Wadkar, S., Siddalingaiah, M., & Venner, J. (2014). Pro Apache Hadoop. Berkeley, CA: Apress.

Williams, S. (2016). Business Intelligence strategy and big data analytics: A general management perspective. Cambridge, MA: Morgan Kaufmann.