Data Engineer
Current- My responsibilities include:
- Data migration from Redshift to Snowflake.
- Utilizing Datacoves for creation of the dbt models.
- Conducting data lineage analysis and data validation.
- Utilizing Azure Pipelines and Airflow for orchestration. (ADF pipelines monitoring & troubleshooting)
- Python scripting for automation (PySpark, Pandas)