Data Engineer
Current- Designed and built scalable and robust data pipelines with large volumes of data from various sources into data lake platform using Python, Spark, Pandas and Databricks.
- Work extensively with cloud-based technologies (special with Azure) to design and manage scalable data infrastructure.
- good familiarity with DBT, AWS services
- Provide technical guidance and mentorship to other data engineers in the group