Digital Transformation Consultant for a leading bank

▪ Worked on cloud orchestration of AWS services for an insurance-based client which mapped feed formats that would then trigger the respective Extract, Transform and Load Jobs▪ Strategically ensured data validation from data ingestion till loading data to the downstream application▪ Engaged regularly with the client and optimized plan for better decision making

•Automation of Data Loading process to Redshift where a user would upload a file to S3 Location which would then trigger the Lambda Function and copy the data to Redshift Table.•Responsible for conversion of Greenplum DDLs to Redshift DDLs and migrating the data from S3 to Redshift using COPY command.•Wrote a python script that would convert Hive DDLs to Redshift and Redshift Spectrum DDLs.•Responsible for conversion of Shell Script to Python Script and running it through AWS Glue… Show more •Automation of Data Loading process to Redshift where a user would upload a file to S3 Location which would then trigger the Lambda Function and copy the data to Redshift Table.•Responsible for conversion of Greenplum DDLs to Redshift DDLs and migrating the data from S3 to Redshift using COPY command.•Wrote a python script that would convert Hive DDLs to Redshift and Redshift Spectrum DDLs.•Responsible for conversion of Shell Script to Python Script and running it through AWS Glue Job which would trigger the SQL Files present in S3 Location and implemented CloudWatch functionality to generate logs and SNS Topic to notify the subscribers.•Extensively used SPARK for Fast and accurate processing of large amounts of data.•AWS Glue to load, transform, and rewrite data in AWS S3 so that it can easily and efficiently be queried and analyzed.•Wrote a python script that would take out the partition details from S3 folders and load the data to Redshift Spectrum tables.•Support coding and technical issues related to Pyspark, Python, and SQL.•Increased the efficiency of a particular process saving 187 hours of manual work for the team.•Created External Hive Table on top of parsed data. Show less

•Automated a process that would take out the required information from SQLs and assign the complexity that would help the Project Manager in the Requirement Analysis Phase of the Project.•Responsible for conversion of Teradata SQL’s to GBQ SQL’s.•Mentoring 4 ASEs and assisting and helping them to understand the design and architecture of the project and helping them to convert the SQLs assigned.•Responsible for reviewing the code of the team members and ensuring whether it is good… Show more •Automated a process that would take out the required information from SQLs and assign the complexity that would help the Project Manager in the Requirement Analysis Phase of the Project.•Responsible for conversion of Teradata SQL’s to GBQ SQL’s.•Mentoring 4 ASEs and assisting and helping them to understand the design and architecture of the project and helping them to convert the SQLs assigned.•Responsible for reviewing the code of the team members and ensuring whether it is good to move to the production environment.•Responsible for performing Data certification including count validation, data validation, null check, aggregate check, and duplicate check. Show less

Gained 'Insurance' domain experience as I was a part of a fast-paced, agile development team, where the business provides raw banking transaction data which is then processed through an ETL workflow and provided back to the business for further use after performing some transformation to make the data in a required format. Here I have got an opportunity to explore concepts of 𝐂𝐥𝐨𝐮𝐝 𝐜𝐨𝐦𝐩𝐮𝐭𝐢𝐧𝐠, 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚, 𝐃𝐚𝐭𝐚𝐛𝐚𝐬𝐞. I have hands-on experience in 𝐏𝐲𝐬𝐩𝐚𝐫𝐤(Good… Show more Gained 'Insurance' domain experience as I was a part of a fast-paced, agile development team, where the business provides raw banking transaction data which is then processed through an ETL workflow and provided back to the business for further use after performing some transformation to make the data in a required format. Here I have got an opportunity to explore concepts of 𝐂𝐥𝐨𝐮𝐝 𝐜𝐨𝐦𝐩𝐮𝐭𝐢𝐧𝐠, 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚, 𝐃𝐚𝐭𝐚𝐛𝐚𝐬𝐞. I have hands-on experience in 𝐏𝐲𝐬𝐩𝐚𝐫𝐤(Good knowledge in Python along with basics of Spark), features of 𝐀𝐖𝐒(like 𝐒𝟑,𝐆𝐥𝐮𝐞 𝐰𝐨𝐫𝐤𝐟𝐥𝐨𝐰, 𝐒𝐐𝐒 𝐐𝐮𝐞𝐮𝐞, 𝐒𝐍𝐒 𝐭𝐨𝐩𝐢𝐜, 𝐋𝐚𝐦𝐛𝐝𝐚), and PostgreSQL & Oracle as part of Database.My daily work revolves around -Getting Business Requirements from Onshore Design Team and accordingly create Technical Data Model, Workflows(Design Level)Write high-quality code and maintain high test coverage across unit, functional and integration test suites.Creation of Glue Jobs.Collaborate with QA engineers, Technical Consultants and Project Managers. Show less

•Responsible for providing hands-on development, design, implementation, and support of business solutions based on IBM Integration Bus (IIB) technology.•Received appreciation from Project Manager and Client for Single-handedly handling the development and deployment of particular modules.•Provided support for last-minute changes to the delivery of the project.•Identified and Fixed an issue in the code where it was causing an issue in the Production environment•Successfully… Show more •Responsible for providing hands-on development, design, implementation, and support of business solutions based on IBM Integration Bus (IIB) technology.•Received appreciation from Project Manager and Client for Single-handedly handling the development and deployment of particular modules.•Provided support for last-minute changes to the delivery of the project.•Identified and Fixed an issue in the code where it was causing an issue in the Production environment•Successfully completed the testing of all the modules before moving to theProduction environment. Show less