Development Manager
Current- Designed and implemented data integration processes to extract, transform, and load (ETL) data from social media platforms into Azure.- Responsible for creating/reviewing the architecture designs shared within the development team.- Ensure data accuracy, consistency, and completeness across all data sources. Identify and ensure awareness of dependencies with other teams both within a pillar and across pillars.- Coordinate with cross-functional teams, including IT, marketing, and analytics, to achieve project goals. - Experience in developing spark applications using PySpark in Databricks for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming the data to uncover insights into customer usage patterns.- Experience in developing pipelines in Azure Data Factory to ingest AdTech Data from Facebook, Twitter, Walmart, LinkedIn, Spotify, Snapchat data servers to Oracle data servers, transforming using Databricks & Data Flow and load.- Facilitate retrospectives that are blameless, factual, timely, open/publicized, and grounded in the spirit of avoiding repeating the same mistakes. Ensure these are published on every P1/outage, track root cause analysis, and specific follow-ups.- Lead a team of 10 and present data-driven recommendations to senior management to support strategic decision-making.
