Big Data Streaming Platforms: A Review

Authors

  • Harish Kumar Department of Computer Science, College of Computer Science, King Khalid University, Abha 61413, Saudi Arabia https://orcid.org/0000-0003-2302-5828
  • Ping Jack Soh Associate Professor, University of Oulu, Finland
  • Mohd Arfian Ismail Faculty of Computing, College of Computing and Applied Sciences, Universiti Malaysia Pahang, Malaysia

DOI:

https://doi.org/10.52866/ijcsm.2022.02.01.010

Keywords:

big data, streaming processing, Kafka, Spark

Abstract

Yesterday’s “Big Data” is today’s “data.” As technology advances, new difficulties and new solutions emerge. In recent years, as a result of the development of Internet of Things (IoT) applications, the area of Data Mining has been confronted with the difficulty of analyzing and interpreting data streams in real time and at a high data throughput. This situation is known as the velocity element of big data. The rapid advancement of technology has come with an increased use of social media, computer networks, cloud computing, and the IoT. Experiments in the laboratory also generate a large quantity of data, which must be gathered, handled, and evaluated. This massive amount of data is referred to as “Big Data.” Analysts have seen an upsurge in data including valuable and worthless elements. In extracting usable information, data warehouses struggle to keep up with the rising volume of data collected. This article provides an overview of big data architecture and platforms, tools for data stream processing, and examples of implementations. Streaming computing is the focus of our project, which is building a data stream management system to deliver large-scale, cost-effective big data services. Owing to this study, the feasibility of large-scale data processing for distributed, real-time computing is improved even when the systems are overwhelmed.

Downloads

Download data is not yet available.

Downloads

Published

2022-04-01

How to Cite

[1]
H. . Kumar, P. J. . Soh, and M. A. . Ismail, “Big Data Streaming Platforms: A Review”, Iraqi Journal For Computer Science and Mathematics, vol. 3, no. 2, pp. 95–100, Apr. 2022.
CITATION
DOI: 10.52866/ijcsm.2022.02.01.010
Published: 2022-04-01

Issue

Section

Articles