Data Engineer
Current• Built processes supporting data transformation, data structures, metadata, dependency, and workload management• Created Jupyter Notebooks using python and utilizing Data frames and Spark SQL API for faster processing of datain Databricks.• Engineered workflows and pipelines to configure CI/CD of the deployment.• Developed and monitored of data pipelines.• Implemented complex, modern data platforms (Microsoft Azure) for enterprise customer