I developed a Spark Structured Streaming framework to efficiently move data between layers, optimizing costs. I used Terraform for comprehensive module reviews and automation of infrastructure provisioning, configuration, and deployment, ensuring efficient and reliable processes. I also created reusable Terraform modules to speed up project onboarding. Additionally, I established lower environments with a custom privacy tool to ensure compliance with CCPA and GDPR regulations.

In my diverse data analytics role, spanning merchandising, Personalization, Target registry, digital AB testing, and Supply chain, I've excelled in optimizing ETL processes with Domo, significantly enhancing operational efficiency. As a leader in Target's gift registry analytics, I focused on improving customer experiences and identifying growth areas. My analyses extended to customer growth for Target in Google Express Shopping, execution of A/B tests on target.com, and extensive use of SQL for data extraction from Enterprise Kafka/RedStream BigRed, ensuring seamless integration and analysis in Domo. Adhering to Agile principles, I leveraged multiple metrics for forecasting, budget planning across product departments, and employed SQL for precise fraud detection in orders and returns. My proficiency includes Kibana for live streaming, creating Domo dashboards, and developing a data pipeline for efficient machine learning model operations. Supporting technical managers, I calibrated machine learning models, performed NLP on product reviews using NLTK, Gensim, Spacy, and BeautifulSoup, and engaged in data visualization with RStudio, utilizing libraries like ggplot2, lattice, highcharter, Leaflet, Plotly, sunburstR, and RGL. This comprehensive approach blends technical expertise, strategic thinking, and collaboration to drive informed, data-driven decisions.

Led end-to-end data pipeline orchestration, facilitating the seamless ingestion, validation, and storage of 8TB weekly raw data in Snowflake from diverse sources.Pioneered system administration and automation with multifaceted shell scripts in Linux, AWS Lambda, and EC2. Tasks ranged from Docker operations to integrating diverse systems and technologies. Designed and implemented streaming data ingestion pipelines with Apache Kafka and Snowpipe, collaborating closely with data stakeholders.Specialized in Snowflake data engineering, focusing on optimizing performance, scalability, and reliability of data processes.Collaborated with data scientists, analysts, and stakeholders to enhance data accessibility and usability. Understood their data requirements and delivered robust data pipelines and ETL processes tailored to support their work.