Harishkumar A Email & Phone Number

Bengaluru, Ka, In

Coimbatore, Tamil Nadu, India

Project Name : Tax and Accounting - EDLRole : Product Software Engineer.Environment : Azure, ADF, ADLS, Azure Databricks.Tools Used : Azure, ADF, ADLS, Azure Databricks, Pyspark,Azure SQL, Workflows.Description: An enterprise data lake serves as a centralized repository designed for the storage, processing,and security of large volumes of data. It accommodates various data types, including structured, semistructured, and unstructured data, in their raw form. Data lakes are inherently flexible and scalable, offeringbusinesses numerous advantages.Role and responsibilities:• Interacted with Customer and understand the Requirements functionally andtechnically.• Gather and analyze requirements to ensure accurate data processing from source AzureSQL to Delta Lake.• Perform regular maintenance and updates to ensure system reliability and scalability.• Set up monitoring toolsto track system performance and health.• Taken the Responsibility of tracking and Resolving Application Related Issue.• Troubleshoot and resolve issuesrelated to event processing.• Communicate technical concepts and solutions effectively to both technical and nontechnical stakeholders.• Participate in meetings with clients to provide updates, gather feedback, and refinesystem requirements.

India

1Project Name : Amaze for capital marketsRole : Data EngineerEnvironment : AZURE, PYSPARK, AWS CLOUD, My SQL, POSTGRESQLTools Used : Azure storages, ADF -Pipelines, Databricks,PostgreSQLDescription: A capital markets firm in BFS services. Interacted with the customer to understand functional andtechnical requirements. Developed Spark and Python code based on these requirements. Identified andresolved technical difficulties through brainstorming. Developed and implemented code logic accordingly.Roles and Responsibilities:• In AZURE, from ADLS gen2 source we will get data and move it to Raw stage and creatingstagging/curation tables(delta) on top the Raw data using Pyspark.• By using spark apply rule validation on top of the raw tables data.• Build ADF pipelinesfor data movement from one folderto anotherfolderin ADLS storageaccount.• From ADF will call Data Bricks pyspark notebooks for Transformation.• Understanding the client requirements by studying functional document.• KT sessionsto team members on application functionality.• Involved in the preparation of test data.• Identified test requirement and checked if the test cases were complete to test thebusiness functionality.• Participating in regular status meetings and prepared weekly reports on the status ofthe application.

Hyderabad, Telangana, India

Worked as a Data Engineer for Microsoft Client.