Project: Data Orchestration Optimization and Cloud MigrationLeading US-based Hardware OrganizationOptimized and enhanced existing data orchestration workflows by transitioning from Airflow (Google Composer) to Databricks Workflows.Led the modification of logic to integrate IICS (Informatica Intelligent Cloud Services) for efficient data ingestion processes.Addressed business users' concerns by handling data modeling and troubleshooting issues related to the migration of Fusion data to the cloud.Collaborated on various projects focused on validating data designs, offering recommendations, and identifying optimization opportunities to improve performance and efficiency.

US hardware org for cloud migrations for their AI acquisitionsLarge Language Model Implementation:• Objective: Implemented LLM open source model to facilitate data querying via simple English language.• Roles and Responsibilities: Architected the solution and developed a functional apps.• Technologies Utilized: Dolly2.0, Databricks, Google Cloud Platform, Python, Code-bison, Text-bison, Langchain.• Achievements: Integrated Google Cloud-based text-bison as the LLM model in conjunction with Langchain to generate SQL queries based on user input. Designed an architecture to execute these queries within the Spark engine, fetching outcomes from Databricks' tables.• Collaboration: Worked with a team of two data engineers to transform the architecture into a working reality.• Learnings/Outcome: Initiated the project with the Dolly model but shifted to more efficient models available on the Google Cloud Platform to meet customer demands.Extraction of Oracle Fusion Data to Google Bucket:• Objective: Designed and implemented the complete data flow from Oracle Fusion Cloud to Google Cloud Platform without third-party applications.• Roles and Responsibilities: Conducted a proof of concept, architected the entire design, and translated it into a functional application using available technologies.• Technologies Utilized: SOAP, REST, Google Cloud Platform, PySpark, Python, Databricks, OCI, BICC, Oracle Bucket Storage, BigQuery.• Achievements: Successfully extracted data from Fusion application using BICC, transferred it to object storage, then loaded and transformed it into bronze and silver layers before reaching BigQuery as the gold layer. Managed the archiving of extracted data to clear the landing bucket space.• Collaboration: Worked individually but maintained regular communication with the client on project progress.• Learnings/Outcome: Gained in-depth knowledge of Oracle Cloud applications, their capabilities, and exposure to Oracle bucket storage APIs.

Client: DBS bankI work with a prominent Banking Client as a Big Data Developer, focusing on the migration of data from on-premises SAS datasets to Big Data systems.Responsible for migrating data and logical transformations from SAS to IBM s3a bucket within a Spark environment.Leveraging Hive as a SQL client for storing metadata information.Utilizing Apache Superset as a Business Intelligence (BI) tool to both query and validate data quality in Hive through Presto connectors.Carrying out all development tasks within the Cloudera DataScience Workbench using Python and Spark.Involved in the creation, deployment, and scheduling of jobs utilizing an inbuilt advanced data analytics platform, and maintaining version control through Bitbucket.

Client: American ExpressReceived client data in CSV format stored within SharePoint directory and Azure Blob Storage.Participated in project design and the creation of technical specifications.Developed code based on Key Performance Indicators (KPIs) using SparkSQL and stored the processed data in Azure Data Lake Gen2.Project operations followed an agile methodology.Engaged in daily client calls to ensure a comprehensive understanding of the project requirements.

I will spearhead the automation initiatives for a prominent lock Client.Overseeing the entire automation process from comprehending requirements to delivering complete automated solutions.Crafting Automation Test Scripts using Test Complete, specializing in JavaScript scripting language.Analyzing the outcomes of automation tests to ensure optimal functionality.Conducting training sessions for team members on automation practices and methodologies.Participating in the enhancement of an existing automation suite by introducing Behavior-Driven Development (BDD) tests.Engaged in automating a Robotic Arm (Dorna.ai) specifically designed for opening and closing doors.

Employed as an Automation Test Engineer, responsible for automating web-based applications using Java and Selenium.Integrated API and database automation to efficiently retrieve necessary data, significantly reducing execution time in the automation process.

● Engaged in a key banking project within the Payment Domain as a Validation Engineer.● Contributed as a Query Test Engineer at CVS Healthcare.