Data Ingestion Lead
Current∙ Lead a team of developers responsible for fulfilling data sourcing requests from business customers so that the data can be consumed for reporting∙ Use Java and Spark-based processes running on Kubernetes to extract from GM databases into a production ESS cluster, then validate data quality and debug issues∙ Process an average of 30 sourcing requests per month ranging from bringing in a new table to full databases ingestion∙ Utilize Azure DevOps for task tracking and backlog maintenance, and build a monthly sprint allocating work to myself and each developer based on scope and resources available∙ Conduct a daily scrum call to track sprint tasks and identify any potential or current blockers∙ Maintain communication with each request's customer, set delivery expectations and timelines, and promptly address any issues