● Total 5 years of experience as a Data Engineer in developing, analyzing, designing, and implementing Data Engineering and Analytics solutions by Azure Data Factory, Databricks, Azure Synapse, ADL, Azure SQL, & and Power BI ● Highly skilled in migration of on-premises SQL Server schemas to the cloud on Azure SQL Server DB and Azure VM and developed and maintained databases across both on-premises and cloud deployments ● Excellent in Extracting, Transformation, and Loading (ETL) using various tools like export/import data and SQL Server Integration Services. Created, developed, evaluated, and deployed Packages into production servers by creating package configurations ● Proficient in creating Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform, and load data from various sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool, and backward ● Hands-on experience in developing ETL pipelines in and out of the data warehouse using a combination of Data bricks, Python, and SQL/Snow SQL● Proficient in Ingestion of Large Datasets using Python, writing Python codes to automate the interaction, and downloading of data as per the data frequency from RESTful API, Azure Storage, FTP servers, or any client-side application that acts as a data source ● Skilled in setting up Data Lake in Azure and setup Azure Queue Storage (AQS) messaging between Azure Data Lake and trusted third-party providers in maintaining hash tables on SQL Server ● Proficient in SQL Server Integration Services (SSIS) and SQL Server Reporting Services (SSRS) with good knowledge of SQL Server Analysis Services (SSAS) and Power BI ● Expertise in developing visual, interactive reports using Tableau, Power BI, and other business intelligence tools for effective prediction and understanding of data analysis trends ● Proficient in importing, exporting, and cleaning databases using SQL, NumPy, and Pandas in Python● Team player with excellent interpersonal skills, self-motivated, dedicated, and understanding of the demands of 24/7 system maintenance and importing, exporting, and cleaning has good customer support experience ● Worked in an Agile environment and have good insight into Agile methodologies and Lean working techniques. Participated in Agile ceremonies and Scrum Meetings
Tech Mahindra
View- Website:
- techmahindra.com
- Employees:
- 109765
-
Tech LeadTech Mahindra Apr 2024 - PresentToronto, Ontario, Canada -
Azure Data EngineerManulife Jun 2022 - Jul 2024Toronto, Ontario, Canada● Designed and developed ingestion framework components in Python/PySpark on the Azure platform, aligning with both functional and non-functional specifications.● Led full lifecycle development activities on the Azure platform, from initial design to deployment, ensuring seamless go-live transitions.● Engineered comprehensive ETL pipelines utilizing MS Azure and MS SQL Server tools to facilitate efficient data movement within a corporate data management framework.● Engaged in data integration initiatives, collaborating with various teams to achieve seamless data integration across disparate systems and applications.● Coordinated with corporate data user groups to develop validation protocols and testing plans, conducted user acceptance testing, and relayed feedback to both development and maintenance teams.● Worked on Azure Architecture, design, implementation, and operationalization of large-scale data and analytics and warehousing solutions on Snowflake Cloud Data Warehouse.● Developed and maintained robust ETL/ELT pipelines in Snowflake, leveraging Azure Data Factory and Azure Databricks for efficient data ingestion, transformation, and loading from various sources● Implemented data processing pipelines in the Azure environment, managing data reception, transformation, and distribution to designated targets.● Oversaw data collection and ingestion from external sources, optimizing data flow and integration across diverse systems and platforms.● Develop and deploy stream processing solutions using Structured Streaming in Azure Databricks to process real-time data streams, detect patterns, and generate actionable insights in near real-time● Maintained and scaled data pipelines across Azure Data Lake Storage and Azure Synapse, leveraging Azure Data Factory and Databricks for high-performance data processing and analytics solutions -
Etl DeveloperProghut Solutions Jan 2019 - May 2022India● Designed and implemented process enhancements by automating error-handling techniques to increase the efficiency of data loads and reduce task failures ● Designed, created, and maintained SSIS (SQL Server Integration Services) packages to facilitate the migration of data to FNZ databases ● Implement data quality checks, validation rules, and error-handling mechanisms to ensure data accuracy, completeness, consistency, and integrity throughout the ETL process.● Designed and developed Extract, Transform, Load (ETL) workflows adhering to best practices, and create reusable components to optimize the efficiency and effectiveness of data migration processes ● Offered post-implementation support once the migration is complete, assisting both the project team and the service and support teams in identifying and resolving issues that may arise ● Collaborated effectively with internal teams and client stakeholders to understand their data requirements, gather feedback, and ensure alignment between technical solutions and business needs ● Continuously assessed and optimized the performance of ETL workflows and data migration processes to enhance efficiency, minimize processing time, and improve overall system performance ● Shared expertise and knowledge with team members, providing training and guidance on data mapping solutions, ETL development best practices, and migration processes
Rohit Kumar Education Details
-
Machenical Engineer -
Mechanical Engineering
Frequently Asked Questions about Rohit Kumar
What company does Rohit Kumar work for?
Rohit Kumar works for Tech Mahindra
What is Rohit Kumar's role at the current company?
Rohit Kumar's current role is Azure Data Engineer.
What schools did Rohit Kumar attend?
Rohit Kumar attended Punjabi University, Punjab Technical University.
Who are Rohit Kumar's colleagues?
Rohit Kumar's colleagues are Deepak Thonte, Kiran Bhat, Desh Raj Sharma, Akihiko Ohno, Bala Krishna Ulli, Jyoti Pagar, Shashank Gupta.
Not the Rohit Kumar you were looking for?
-
Rohit Kumar
Toronto, On -
Rohit Kumar
Vancouver, Bc -
Rohit Kumar
Entrepreneurship And Business Innovation Student At Manitoba Institute Of Trades And TechnologyWinnipeg, Mb -
Rohit Kumar
Greater Toronto Area, Canada -
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial