Sarcouncil Journal of Engineering and Computer Sciences

Abstract: Big data is the era in which advances in digital technology have made it possible to collect a lot of difficult data. To find useful insights in their massive amounts of structured, semi-structured, and unstructured data, more and more companies are using big data analytics. Innovation, operational optimization, and decision-making are all aided by this. With an emphasis on Hadoop, Spark, and cloud providers like AWS EMR, this overview lays out the fundamentals of big data analytics and its tools and methodologies. The use of analytical tools such as descriptive, predictive, prescriptive, text, sentiment and graph analytics are addressed based on how it helps in identifying patterns, trends and relationships within mega data. The paper also addresses another problem with big data analytics, which is the following: processing speed, data quality, security, heterogeneity, scalability, and fault tolerance. This review highlights the relevance of quality data administration and analytical approaches in the utilization of big data by offering a detailed insight into the state of art tools and methodologies in the subject. It provides information on how organizations can convert complex data to practical knowledge and use it to promote innovation, operational effectiveness, and competitiveness in various areas.