Senior Software Engineer (Smts)
Current- Engineering Big Data solutions for the transformation of data as a part of Salesforce Detection and Response
- Architecting a modern cloud ETL platform, bringing together scalable compute and user-first web solutions
- Utilizing open source platforms like Kafka, Spark, and Airflow to transform and store logs at petabyte scale
- Managing and deploying data pipelines in AWS that process up to 6 million logs per second
- Uplifting and maintaining services as the primary engineer for our pipelines in restricted government environments
- Designing web solutions for distributed systems to overhaul the user experience for internal stakeholders