Senior Data Engineer
CurrentUtilizing Spark, Scala, and Python in Hadoop/Hive environments for large-scale data processing and regular expression projects.Migrating code bases to Amazon EMR and evaluating components of the Amazon ecosystem, including Redshift.Importing metadata into Hive using Scala and migrating existing tables and applications to operate effectively on Hive and the.