Data Engineer
CurrentGenerating a Big Data solution using Spark and Scala to analyze the MovieLens dataset (1 million records), answering analytical questions on movie ratings, genres, and user behavior.Leveraging Spark RDD, Spark SQL, and Spark DataFrame to process and analyze large datasets, improving data processing speed; utilizing Cassandra for efficient data.