Results-oriented Data Engineer with over 3 years of experience in designing, developing, and optimizing data pipelines and infrastructures. Proficient in managing and analyzing large datasets to deliver actionable business insights.Core Competencies:Expertise in ETL development, data modeling, and warehouse design using Azure Data Factory (ADF) and Databricks.Skilled in Big Data technologies: Apache Spark, Hadoop, Hive, and PySpark for scalable data processing.Proficient in cloud platforms: Microsoft Azure, AWS, and data storage solutions like ADLS Gen2 and S3.Strong command over SQL, Python, and Spark SQL for data transformation and analysis.Experienced in implementing Medallion architecture for structured and optimized data layers.Looking for opportunities to leverage my expertise in big data and cloud technologies to solve complex data challenges and drive data-driven strategies.
Peaksense Technologies Private Limited
-
Data EngineerPeaksense Technologies Private Limited Apr 2023 - PresentBengaluru, Karnataka, IndiaDeveloped ETL pipelines for large-scale data migration using Azure Data Factory (ADF) and Azure Storage solutions.Implemented Medallion architecture to refine raw data into silver and gold layers, ensuring data quality and usability.Optimized data processing workflows with Databricks and Apache Spark, reducing runtime by 30%.Conducted data cleansing, transformation, and advanced analysis for business insights. (Data Engineer, Python, Sql, Etl, PySpark, Spark)
-
Junior Data EngineerPeaksense Technologies Private Limited Apr 2021 - Mar 2023Bengaluru, Karnataka, IndiaBuilt end-to-end ETL pipelines to extract, transform, and load data from MySQL to AWS S3 using AWS Glue and Spark.Performed data quality checks and validation using automated workflows, ensuring consistent and accurate datasets.Set up monitoring systems with AWS CloudWatch to track and resolve pipeline errors.Collaborated with teams to integrate data pipelines with Snowflake for analytics and reporting. (Data Engineer, Python, Sql, Etl, PySpark, Spark)
Onkar Shrivastav Education Details
Frequently Asked Questions about Onkar Shrivastav
What company does Onkar Shrivastav work for?
Onkar Shrivastav works for Peaksense Technologies Private Limited
What is Onkar Shrivastav's role at the current company?
Onkar Shrivastav's current role is "Immediate joiner | Data Engineer | Azure | AWS | Databricks | Apache Spark | Python | SQL | PySpark | Big Data | Cloud Solutions " | Transforming Ideas into Powerful Solutions.
What schools did Onkar Shrivastav attend?
Onkar Shrivastav attended Government College Of Engineering Aurangabad, Vivekanand Arts, Sardar Dalip Singh Commerce & Science College.
Not the Onkar Shrivastav you were looking for?
-
-
-
onkar shrivastav
India
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial