My area of expertise is in the design, development, and management of intricate data structures and pipelines. I have a great deal of experience with data engineering and am adept with technologies like Spark, PySpark, SQL, Python, Scala, Airflow, Databricks, Snowflake, Tableau, Power BI, AWS, and Azure. My specialty is using Spark-SQL and Databricks to execute data extraction, transformation, and aggregation and to extract useful information from a variety of file types. My areas of expertise include automating procedures for smooth data input and movement inside Azure cloud settings, orchestrating complicated operations using Apache Airflow and Oozie, and working with Azure Synapse Analytics, Azure SQL, Azure Data Lake Analytics, Azure Data Factory, and Azure Functions.I have also conducted user training sessions, troubleshooted data visualization difficulties, and optimized Tableau dashboards and reports for optimal performance. I have a strong background in serverless Spark application development using AWS Lambda, managing AWS infrastructure, and putting effective CI/CD pipelines in place. I also know how to create Python-based Map-Reduce flows, optimize Teradata batch processing scripts, and build PySpark-based ETL pipelines. In addition to improving data models for business intelligence tools like Tableau, Power BI, and DBT, I work collaboratively to guarantee efficient project management and productive cross-functional team cooperation. I am also skilled with Jira.
Questionguru.Net
-
Data EngineerQuestionguru.Net Jun 2023 - PresentBayside, California, United States
-
Senior Data EngineerHexaware Technologies Jan 2022 - May 2023 -
Senior Data EngineerSyneos Health Jun 2019 - May 2021Hyderabad, Telangana, India -
Data AnalystQualitykiosk Technologies Pvt. Ltd. Sep 2017 - May 2019Pune, Maharashtra, India
Harish P Education Details
-
Computer Science
Frequently Asked Questions about Harish P
What company does Harish P work for?
Harish P works for Questionguru.net
What is Harish P's role at the current company?
Harish P's current role is Skilled Data Engineer adept in AWS, Azure, Hadoop, Apache, Python. Expertise in crafting scalable data pipelines, driving informed decisions..
What schools did Harish P attend?
Harish P attended The University Of Texas At Arlington.
Not the Harish P you were looking for?
-
1sap.com
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial