As a AWS Data Engineer, I Built the data landing zone, that includes data stored in Amazon S3, as well as data ingestion from other Customer data sources.Setting up Lake Formation and registering AWS S3 buckets and working IAM policies, Building of auto registering data in a metadata catalog, Building AWS Glue pipelines for data transformation and loading into Redshift, Building State Machines using STEP Functions. I have written final adjustments and tuning based on performance and test results. I Executed Proof of Concepts on different components. Data profiling with AWS DataBrew. I Scheduled STEP functions and connecting different AWS components with Event Bridge. I Worked with Product Owner to create Jira stories. I have Good understanding in all aspects of AWS including Code Pipeline, Cloud Formation, Lambda, Glue, Event Bridge, Secrets Manager, Redshift, RDS, and DMS. I have Created custom event bus and scheduling pipelines with Event Bridge.

I Ingested data from several sources, extracted online or offline guest information and created a Single Customer View, also called a “Golden Customer Profile”. I Designed, build, operated and optimized the data pipelines, data mapping and data models that run marketing platforms with a special focus on the Customer Data Platforms. Used Azure Data Factory for data ingestion (for datasets like Orders, ClickStream, Inventory). Augmented CDP capabilities with new data sets and new data integrations to enhance omnichannel view of guest and omni purchase history while following best practices from solution architect. I maintained existing features by improving and scaling supporting code, ensuring ongoing production support. I also Implemented new technology tools and frameworks where/when needed.

I Developed data pipelines using EMR, PySpark, Airflow to process & ingest 3PL data into Nike Datalake. I Executing POCs, Worked on DOMO & Snowflake Optimization. I also Worked on Cognos to Tableau Migration and repointing to Nike Data Lake from SQL Server. As a Data Engineer, I Standardized Curated Layer for all POS subject areas - Owned the design, approval and delivery of 3PL Curated layer for Inventory, Shipped, Demand, Cancels and Returns. I Automated - deployment automation of data extraction from 3PL portals with Robotics Process Automation. I did Data Quality Audit Framework - Implementing the Audit framework on the datasets, which will enable us to monitor the data quality more efficiently and provide data behavioral trends to the business. I have done Data Ingestion Framework - Building the new data ingestion pipeline using the 3PL automation framework will reduce the development effort and enforces a standard code across the 3PLs.

As a Data Consultant, I Cleaned prepared and optimized data at scale for ingestion and consumption. Troubleshoot complex data issues and performed root cause analysis to proactively resolve product and operational issues. I Implemented complex automated workflows and routines using workflow scheduling tools. Additionally I Anticipated identified and solved issues concerning data management to improve data quality.

I Performing end-to-end incident management. Responsible for time-critical User Service/ Infrastructure restoration, technical troubleshooting within a complex IT systems environment. Working with customers, internal IT and infrastructure teams, third party data providers etc. throughout the service restoration process. I Worked closely with problem owners, SMEs and other stakeholders to identify problem scope and escalate IT service outages to specialize engineering. Creating statistical reports and performing analysis on a weekly basis for areas of responsibility. I Effectively executed and drive continuous improvement for IT Change Management.