Saurav Panda Email & Phone Number

Pune, Maharashtra, India

Working as a Data Engineer for a major Aviation Service based out of USA.Involved in migration of different subject areas related to Aviation from onprem to Azure Cloud and working on new transformation and development requirements.Data Pushdown to Teradata using Databricks and also storing data to ADLS.Metadata store in MYSQL server for automation use.Using Azure Data Factory for Orchestration and Building of pipelines,defining triggers, building alerts… Show more Working as a Data Engineer for a major Aviation Service based out of USA.Involved in migration of different subject areas related to Aviation from onprem to Azure Cloud and working on new transformation and development requirements.Data Pushdown to Teradata using Databricks and also storing data to ADLS.Metadata store in MYSQL server for automation use.Using Azure Data Factory for Orchestration and Building of pipelines,defining triggers, building alerts e.t.cUsing Databricks for Transformation and Processing of Data,Purging old Data,Setting up Unity Catalog, Setting up Disaster Recovery Environment e.t.cStorage in Azure Blob as well as Azure Datalake Gen2.CI/CD :- Github Show less

Bengaluru, Karnataka, India

Worked on building data pipelines and handled csv,psv,parquet,delta lake data,have experience on both AWS and azure and used cloud technologies such as Databricks, Datafactory,Datalake,AWS S3,Glue

Bengaluru, Karnataka, India

Bangalore Urban, Karnataka, India

Creating notebooks using azure databricksCreating pipelines using ADF for running notebooks and storing data in azure Storage Explorer Using SSMS for pulling Metadata Entries and using them to access data or write data to specific locationsUsing azure devops to run personal deployment pipelines and Git commands to push changes from VS code to azure devops repoGenerating hive views through ADF pipelinesClient: Gen re

Bengaluru, Karnataka, India

Building data warehouse using Redshift and pushing data to required target system.Preparing Athena scripts to catalog data and read from different sources like S3,Redshift.Processing structured and semi-structured data.Preparing Cloud-formation scripts.Using pyspark to write glue code-i.e creating jobs.Using step-function for scheduling jobs or cloudwatch event rule creation using Cron expressions.Client: Nassau Re

B.Tech, Computer Science, 8.96 Cgpa

+2, Science, 84%

10Th, Computer Science, 95℅