Data Engineer Senior Consultant/ Tech Lead
Current- Implemented ETL workflows to handle real-time and scheduled data ingestion, transformation, and loading, ensuring seamless integration with various data sources and destinations- minimizing manual efforts- Engineered scalable data pipelines using PySpark’s DataFrame API and SQL capabilities to perform complex transformations and aggregations on large.