Full Stack Software Engineer
CurrentBuild workflows to batch process large datasets on Amazon EMR using a mixture of Spark and Snowflake queries. Improve performance through job configuration and SQL optimization. Ensure data quality through rigorous data analysis and hardening of test cases.Write Python scripts to automate workflows, including generating a list of unmigrated data at runtime, comparing row counts of input and output data to trigger a PagerDuty alert, and enabling concurrent jobs by partitioning data at runtimeSupport Kafka consumers with topic changes, test case management, and business logic updatesMentor junior developer teammates to bring them to a productive state as quickly as possible through pair-coding, code review, and advice about navigating the larger organizationCommunicate with stakeholders on and across teams to clarify business intent, create alignment, and maintain a results-focused prioritizationShare solutions across teams to advance organizational knowledge and prevent reinventing of the wheelCreate and update Splunk Dashboards to enhance visibility and monitoring capabilities