Aravindan N Email and Phone Number

• AWS Data engineer in Health care domain.• Created data warehousing solutions in Redshift through ad-hoc and automated frameworks using Python and AWS Services like S3, Glue, DynamoDB, Lambda and Athena. • Analyzed, Designed, Developed, and Maintained data pipelines to ingest, process, and transform large volumes of data from various sources into structured tabular format. • Created end-to-end ELT pipelines that runs in EC2 and updated to a more robust ETL framework that runs in AWS Glue jobs using Python, PySpark, Spark SQL and Boto3. • Developed complex workflows and orchestrated using AWS Airflow. • Managed data warehousing solutions, optimized performance to ensure fast and efficient data retrieval, data availability and security using Amazon Redshift. • Developed data validation and quality assurance procedures to identify and rectify data issues, ensuring data accuracy and reliability. • Reviewed colleague’s scripts during code reviews and validated the integrity of data output of their pipelines during peer reviews. • Created and maintained comprehensive documentation of data engineering processes, best practices, and standards for the team's reference. • Utilized Jira for Planning & tracking, Bitbucket for code management and also Governed data access to the internal research teams.

• Analyzing the dashboard requirements from the client Directors and Vice presidents and designing the Framework of data columns required for the creation of Dashboard. • Retrieving the data from the centralized database called Cornerstone using Hive. • Extracted, Transformed and Loaded data into Hive warehouse using PySpark for further validation and modifications.• Solving the issues that occur while data ingestion into the Big Data environment and rectifying the hive codes suitable for the environment. • Cleaning the data using PySpark as well as other Python libraries such as NumPy and Pandas. • Optimized spark codes using various methods for better performance and improved time consumption. • Creation of KPI Dashboard with Visuals as required by the Clients using Tableau. • Scheduling the data ingestion using Cron and Automating the data refresh in Tableau Server with set intervals of time.

• Analyzing the dashboard requirements from the client Directors and Vice presidents and designing the Framework of data columns required for the creation of Dashboard. • Retrieving the data from the centralized database called Cornerstone using Hive. • Extracted, Transformed and Loaded data into Hive warehouse using PySpark for further validation and modifications.• Solving the issues that occur while data ingestion into the Big Data environment and rectifying the hive codes suitable for the environment. • Cleaning the data using PySpark as well as other Python libraries such as NumPy and Pandas. • Optimized spark codes using various methods for better performance and improved time consumption. • Creation of KPI Dashboard with Visuals as required by the Clients using Tableau. • Scheduling the data ingestion using Cron and Automating the data refresh in Tableau Server with set intervals of time.