Omkar Shende Email & Phone Number

I am a highly motivated Data Engineer who develops end-to-end data pipelines and automates tasks. Through my experience with tools such as Python, PySpark, Pandas, SQL, and Databricks, I have gained a strong understanding of data engineering principles and am committed to continuous learning and growth in this field.Below mentioned are my expertise:Languages: Python, SQL, PowerShell, Shell ScriptingDatabases: SQL Server, PostgreSQL, MySQL, SQLiteFrameworks: Spark, Pandas, Pytest, Unittest, Scikit, Git, Docker, SeleniumTechnologies: GitHub, Azure Databricks, Postman, AWS Lambda, Glue, S3, EC2, ECRMachine Learning: Mathematics, Statistics, Machine Learning Algorithms

• 

  Data Engineer

  Circulants

  Jul 2022 - Present - Pune, Maharashtra, India

  • Developed a pipeline from scratch through an amalgamation of Python, Pandas, PySpark, PostgreSQL.• Automated Databricks pipeline's edge cases using PySpark.• Automated tasks using PowerShell, Linux Scripting. • Developed CI/CD Pipelines for the Data Movement.• Contributed to data engineering projects using a patchwork of tools such as SQL & Python.• Performed Data Transformations using Pandas, PySpark.• Collaborated with various functional units to understand reporting requirements and translate them into actionable reporting.• Prepared documentation during client meetings as well as on GitHub as per project requirements.