Data Engineer
Current- Cloud-based Pipeline Development: development of data pipelines for extraction, ingestion, and orchestration utilizing Azure Cloud, with a focus on Azure Data Factory and Databricks tools. - Data Processing: Proficient in SQL, Python, Pyspark for data manipulation. - Build Data Lake and Data Warehousing using Azure cloud, utilizing the following tools: Databricks, Data Factory, and CosmosDB. - Participated in a project utilizing Google Cloud Platform to migrate an Oracle database… Show more - Cloud-based Pipeline Development: development of data pipelines for extraction, ingestion, and orchestration utilizing Azure Cloud, with a focus on Azure Data Factory and Databricks tools. - Data Processing: Proficient in SQL, Python, Pyspark for data manipulation. - Build Data Lake and Data Warehousing using Azure cloud, utilizing the following tools: Databricks, Data Factory, and CosmosDB. - Participated in a project utilizing Google Cloud Platform to migrate an Oracle database to BigQuery, employing tools as Dataflow, Dataform, Composer, and Airflow for data migration and orchestration. - Data Visualization: Designed Power BI and Looker Data Studio dashboards to showcase KPI-driven insights, enhancing data-driven decision-making. - Code Maintenance & Version Control: Management of code changes and ensured consistency with GitHub for version control. Show less