Leading team to migrate Hadoop, ETL to Google cloud stack.Python airflow to schedule, DBT wrapper for SQL converted code, Gitlab-GCP cloud repository to versioning and CI-CD

• Enhancement, tuning and support for Spark-Scala based Merchant reports, fetching data from various databases and Google cloud Big query and Oracle tables.• ETL pipeline design, develop and support engineer. Lead juniors on ETL technical stack.• Migrating the ETL pipeline to scala-spark jar and deploying to Google cloud - Bigquery. Scheduling the flow via Airflow, and using Google dataproc to deploy the code.• Team Lead - Mentor, Jira ticket dashboard, bug assignment and working with product teams. Stakeholder representation for critical bugs and permanent fix implementation

• ETL pipeline design, develop and support engineer. Lead juniors on ETL technical stack.• Building ETL pipeline and Data mart for Sales team.• Developing Scala-Spark jars, Unix Scripts. Designing and implementing staging to Reporting layer tables for multiple business use cases for sales cross sell, upsell and declines.• Integrating ETL pipeline to Salesforce Objects - Leads, Opportunities, SSO (Custom Object)• Migrating the ETL pipeline to scala-spark jar and deploying to Google cloud - Bigquery. Scheduling the flow via Airflow, and using Google dataproc to deploy the code.• Working with data scientists and business analysts code in Python scripts, converting it to production ready flow in GCP and Teradata.• Modeling the tables for GCP migration and Sales cross-sell data mart.• Converting Python pandas Dataframes into Scala-Spark transformations for production scheduled run.

• Explored methods to automate complex ETL workflows in Scala-Spark code in Talend.• Optimize and enhance existing transformation in spark-scala code for new business use case in RISK domain.

• Design, Develop and Support ETL workflows. Data extraction performed in Informatica and transformationperformed in Teradata BTEQ’s.• Migration of ETL Jobs into Spark-Scala jars. Using RDD, Datasets, Dataframes to transform data and load into google Big query.• Leading a team of size 4 in Technical design and implementation. Direct coordinated with clients on task, user stories, estimation, planning and tracking the progress.• Modeling the tables in star and snowflake pattern from denormalizing reporting data, used by multiple downstream Tableau reports.• I also led Offshore team members and coordinating with direct clients and other vendors.

Worked as Offshore lead - coordinated directly with clients on ETL deliveries using Teradata, Informatica and shell scripting. Worked with multiple vendors on delivery aspect.Senior Application Developer - Offshore Module leadClient - US based Insurance Company, Datawarehousing TechnologyTechnologies - Informatica, Teradata, Unix Scripting, Clearcase

Joined as Full time Student. Course Commencement - July 2012.Areas of Interest1. Database and Datawarehousing2. Data mining and Machine Learning3. Computer Vision4. Advance Imaging techniques using machine learning algorithms

Joined as Software Engineer Trainee. I have worked for 4 years in multiple domains - Banking, Travel, Telecom on different OLTP database systems and reporting layer.1. Software Development2. Technical focus group member for Database and Data warehousing project.3. Wide Experience in developing software for Domains of Banking, Telecom and Travel Industry4. Design and Develop - SQL, PL/SQL stored procedures as back end calculation for Tourism products and Telecom products.5. Development and maintenance of Reports in Crystal reports - with Microsoft SQL server SQL’s and SSIS packages jobs.