Big Data Developer
Current- Implemented a Scala app that flattens very large AVRO data files into smaller sets of data based on defined Spark schemas to increase efficiency in data processing- Added new functionality to an existing app to send daily email reports on the status of processing data, which helps the dev team and product consumers monitor and troubleshoot application issues- Managed data using Hadoop, Hive, Dremio, and Scality- Integrated vulnerability scanning into apps using AgentSmith to ensure Production deployment meets security standards