Rakesh N C Setty Email & Phone Number

Woodland Hills, Ca, Us

New York, Ny, Us

Purpose : Adobe Clickstream hourly batch files processing into GCP-BigQuery and address enterprise wide use cases shared by marketing and site merchandise business partners. Roles & Responsibilities :• Executing and Deliver multiple projects involving bigdata, GCP technologies.• Coordinate with Business to perform requirement analysis• Translating business requirements into technical stories and generating artifacts such a as STM (Source to target mapping), architecture and design document• Application architecture using different gcp products and services (pubsub/dataflow/dataproc/cloud functions)• Specialized in design and architecture of system integration in building data processing pipelines for batch and real time applications• Design and Developing data pipelines using GCP Product Suite Bigquery, Datpproc, PUB/SUB, Dataflow, Data Studio (Dashboards)• Writing DAGs (workflow) in python to process the data into BigQuery tables by calling predefined operators and orchestrating the tasks per the dependencies• Writing Optimized BigQuery sql to parse the array/nested data elements using UNNEST & REGEXP• Creating authorized views for end users to access in GCP and enforcing use of partition filter for Bigquery table with huge volume• Mentoring 10+ Data Engineers (Onsite/Offshore)• Working with the DevOps team to implement CI/CD pipelines GIT and Jenkins to standardize the approach which can be applied across the board• Driving requirements to SRE team (Prometheus & Grafana dashboard) to setup Monitoring alerts Mentoring team and developers• Working with google for enhancements or issues.

New York, Ny, Us

• Understanding business process and work closely with stake holders / project lead / manager & data molders to understand the business and functional requirements• Responsible for architecting and end-to-end delivery of the project from technical standpoint to consume the email and mobile preference data for Macys• Implementing the arbitration rules to update the preferences and capturing the preference & acquisition history to support other business use case• Supervise design throughout implementation process• Providing technical suggestion for critical problems and use-cases• Creating to process the data consume data into the HDinsight Hadoop DataLake and orchestrating it• Writing python scripts to execute Sqoop and merge sql scripts to load data in hive tables• Writing reusable shell scripts to perform certain generic activities (file operations, encryption, decryption, compression) • Writing hive sql to parse the array/nested data elements using Lateral view explode & REGEXP • Writing complex DB2 sql’s to support various reporting use cases• Coordinated with Offshore team to oversee the other development activity, code reviews and make sure it conforms to standard programming practice @ Macy’s• Manage multiple projects at once in design, development & implementation prospective• Providing MOM (Minutes of Meeting) and weekly/month status & project reports• Writing python scripts to execute Sqoop and merge sql scripts to load data in hive tables• Writing reusable shell scripts to perform certain generic activities (file operations, encryption, decryption, compression) which will save development and testing efforts by ~30%• Writing DAGs (workflow) in python to process the data into BigQuery tables by calling predefined operators and orchestrating the tasks per the dependencies• Writing BigQuery sql to parse the array/nested data elements using UNNEST & REGEXP• working with DevOps, control M , MFT to automate/schedule the developed processes

New York, Ny, Us

· Convert business use case or requirements into technical design document· Analysis, Design and development Datastage ETL tool and complex SQL to integrate the website & store data from various sources like Hadoop (HDFS), Oracle, DB2, MQ & Flat files into data warehouse.· Developed reusable shell / scala scripts to consume huge files from big-data/HDFS/Oracle to datalake using HIVE & Sqoop· Developed UNIX shell scripts to create validation frameworks and scripts to trigger the ETL jobs which are scheduled in Control-M scheduler.· Managing multiple projects and driving the projects in parallel from development phase to deployment.· Provide directions to team members on multiple ETL designs and implementation· Optimized performance of existing production jobs which were bottlenecks.· Interaction with System analysts, business users to understand their requirements during Plan and define phase of the project.· Preparation of deployment documentation to handover to support team for production support.· Followed the release engineering & defect management process using JIRA tool and used SVN for version management· Perform code reviews to make sure the coding is in line with the standards defined by macys architecture counsel· Perform gatekeeping for the production releases and providing sign off (technical standpoint) to migrate the code into higher environments

Katy, Texas, Us

Worked as Sr.Datastage Developer. • Analysis, Design and development of ETL jobs to load data into the netezza analytical datamart• Developed Linux / UNIX shell scripts to run the datastage jobs (SCD1 / SCD2 type)• Developed complex DB2 SQL queries to accomplish various business logics• Involved in Performance Tuning of ETL jobs• Create or Update technical documentations and support runbook • Working with UC4 enterprise scheduling team to configure the developed jobs and automate the data consumption

Teaneck, New Jersey, Us

New York, Ny, Us

Worked as Sr.Datastage Developer. Design and development of ETL jobs to address various business initiatives to support broad range of analytics use cases, which involved programs to understand customer behavior & increase customer engagement. • Analyzed, Designed and developed ETL jobs (Historical/Incremental load) to load data into the IDM DB2 database tables by extracting the data from IDM DB2 tables• Analyzed, designed and developed ETL jobs to consume the data from various source systems which involves processing Macys credit customer systems data, SEO (sourcing keywords data from coremetrics web analytics, search engines API - for indexed page counts, Brighedge)• Analysis, design and development of ETL jobs to create raw and score metrics (15+ raw & score metrics based on the unit sold, dollar amount, inventory, product view, conversation) which will help the group of MM's team to make decisions on product placement in Macys/Bloomingdales website• Developed Linux / UNIX shell scripts to run the datastage jobs• Developed complex DB2 SQL queries to accomplish various business logics• Involved in Performance Tuning of ETL jobs• Code check-in's into SVN and work with release team on promoting the changes to production environment• Migration of the Hadoop environments to consolidate into one datalake• Create or Update technical documentations and support runbook

New York, Ny, Us

•Involved in Pre-Profiling, which involves creating a document by analyzing the Stored procedures which is used by Business analyst for creating Business specifications•Analyzed the data in the source systems•Analyzed stored procedures developed in SQL Server 2003 used in OPMI•Designed and developed ETL jobs (Historical load) to load data into the OPMI5 Teradata database tables by extracting the data from SQL Server tables(Historical Load) using Teradata FASTLOAD method•Designed and developed ETL jobs (Real Time Process) to load data into the OPMI5Teradata database tables by processing the host MQ messages using Teradata TPUMP Method•Designed and developed ETL jobs (Non Real Time Process) which involves deletion of old data (Closed claims) from the Teradata database•Designed and developed ETL jobs (Recovery Process) which involves recovery of the missing claims at the time of failure of Real time process•Involved in Testing and documenting•Involved in Performance Tuning of Real time and Non real time processes ETL jobs which will use Teradata TPUMP utility as target stage•Involved in handling change requests and enhancement of the existing ETL change for version changes