Implementing Enterprise Datalake in Azure cloud with Databricks (spark). Part of the big data team to consolidate the data from an on prem HDInsight cluster to Azure ADLS.• Design/Develop jobs using Azure/Databricks/HDInsight/Python/Scala/HIVE/SPARK/SQOOP to pull logistics and campaign data to on premise Datalake (HDFS) as well as Azure cloud platform Datalake ADLS(HDFS) and DBFS (databricks file system) and provide Business users with analytical and aggregate data for KPI reporting. • Responsible for implementing Azure cloud bi data orchestration solution with data factory jobs to perform data collection and Ingestion into Azure Data lake and blob from heterogeneous source systems.• Responsible for creation of sparks jobs with Azure cloud with Azure Databricks notebooks on python/scala for movement of the raw data files from RAW to analytical to processed and aggregate layer with ORC, parquet and avro files to/within the Azure Datalake ecosystem to create enterprise customer data platform.• Designed and Developed an on premise HD insight solution to handle short term metric requirement for the CDP platform using python script to pull data from AWS S3, api’s and ftp servers. • Extensive experience working with Spark using Azure Databricks notebooks using python as well as scala. • Designed/Developed spark jobs using Azure data factory and scala notebooks to curate complex high volume hourly adobe analytics manager data from AWS S3

• Design/Develop jobs using UNIX/Informatica/HIVE/SPARK/PIG/SQOOP/TWS to pull viewership data to HDFS ecosystems and provide Business ready extracts to the downstream users. • Responsible for creating Informatica/Bigdata jobs/mappings/workflows to perform Ingestion/curation/extraction/publish frameworks for data collection and movement of the viewership metadata and activity data from Oracle to/within the Datalake ecosystem to create enterprise viewership platform.• Designed/Developed hive/spark jobs to curate complex high volume hourly STB data curation data. • Designed/Developed fpe encryption jobs to enable SPI data compliance on the datasets. • Developed framework to publish incremental data from HDFS to AWS S3 bucket. • Was responsible to build an enterprise platform for warehousing the business ready data and metrics for the TV viewership from multiple device platforms like IPTV boxes, Satellite STBs, Online Streaming (Mobile Apps, Smart TV, Browsers). • As part of this project associates from Cognizant own the platform architecture, designing data flows, development, unit testing and System testing as multiple Agile teams.• Gather understanding of the various Viewership source systems used by the ATT and perform source data analysis to provide the feasibility study and estimates for ETL / Big Data feeds for the Use Case under consideration. • Responsible in implementing the Models along with the architects so that the information that is represented in the heterogeneous source systems are available for analytical reporting by the Big Data COE teams. • Provide Post Production Support in understanding User issues and provide solutions in the form of enhancements, defect fixes, explanations for the applications deployed to production during the Warranty period.• Successful deployments of releases into production and job monitoring with TWS scheduler to ensure schedules are running as expected and clean data is loaded for downstream delivery.

Responsibilities• Represent the EBI technical team during source system Analysis and business requirement gathering with users.• Gather the reporting/ETL requirements along with the Business analyst as well as the completing the end to end upstream and downstream analysis to ensuring that the required data is not currently available in the existing data warehouse.• Create the data model and ensure that it confirms to dimensional modeling reporting needs.• Responsible for end to end verification of requirements gathered and the functional specifications and come up with technical design document and Source to Target mappings documents. • Development, review, testing of jobs involving extracting data from Oracle, SQLSERVER, Informix, MYSQL sources to the EDW in an Oracle EXADATA database.• Was having the responsibility to analyze and fix issues in production environment on priority basis. • Closely worked with the Enterprise business intelligence group to provide design suggestions and review the designs of projects on the same subject area. • Worked extensively on an Enterprise metadata management solution from scratch.• Extensively worked on Power Center client tools.• Worked on identifying Mapping Bottlenecks in Source, Target and Mappings to improve Performance.• Worked with source system teams to resolve data quality issues raised by end users. • Involved in reviewing technical documents, Unit test plans and test cases for QA and System testing.

Responsibilities• Active participation in requirements gathering and analysis of source data with the Data Analyst team.• Responsible for verification of functional specifications and Source to Target mappings documents created by Data analysis team• Worked closely with Business End Users and Business Analysts to gather and document the Requirements and translated them to functional specifications and Source to Target documents with the help of Data analysis team.• Involved in the creation of logical and physical designs to develop Database schemas and tables in dimensional modeling.• Created Technical specifications for ETL mappings using the FSD and S2T requirements.• Development of mappings involving extracting data from Flat Files, Mainframe files, DB2, Oracle, SQLSERVER and Informix sources to DB2 database.• Executed the role of onsite Coordinator by gathering the requirements, developing the high level designs for the mappings and executing the development with an offshore team.• Provide estimations for ETL deliverables and oversee the progress for quality ETL Deliverables.• Lead a team of five offshore resources.• Extensively worked on Power Center client tools.• Automated the failover strategy in scheduling of workflows using a locking process which was reused across the enterprise.• Developed tools to capture the end to end metadata as well as validating the daily data load metrics.• Created Power Exchange jobs for accessing the Mainframe data from files by creating data maps.• Used to take the deployment anchor responsibility for all modules across projects. • Developed UNIX Shell Scripts for scheduling the workflows using the third party tool called ESP • Involved in documenting technical documents, Unit test plans and also written test cases for Unit and System testing• Extensively worked in the performance tuning of the ETL processes.

• Was a System Analyst from Client side to understand the business logic and make sufficient additions to the existing HLD to capture all the requirements in the BRD. • Had the responsibility to come up with the design of Fact Tables, Dimensional Tables, handling Slowly Changing Dimensions, Data Mining and Data Validation. Preparing the approach documents and impact analysis for various system enhancements.• Involved in Data cleansing before loading into data warehouse.• Extensively used Mapplets and Reusable Transformations to prevent redundancy of transformation usage and maintainability.• Used workflow manager for session management, database connection management and scheduling of jobs.• Used the repository manager to create new users, to give permissions to users.• Was given the responsibility for creating the design and implementation documents, effort estimation, planning for coding & implementation, writing mappings, unix scripts and stored procedures and performance tuning the same to load data into staging area and then subsequent dimensions and facts. Performance tuning the mapping using pushdown optimization.• Had the responsibility to lead an 5 member team working in different technologies namely Informatica, Unix and Oracle and Netezza back end and Crystal and BO frontend.Environment: Informatica, Unix, Oracle, Neteeza, Crystal, Business Objects.

• Worked as the developer for coding & implementation, unit testing, writing stored procedures and performance tuning the same to load data into the schema which contains all the inventory data for British Telecom. This was done in coordination with the team in Tech Mahindra.• Was responsible for the overall functional testing of the reports.• Worked as a developer for Nordstrom offshore BI/Reporting project in Microstrategy.

Was part of the 1 SSC M F(P) to be imbibed into the IAF as a flying officer. Attended the training at AFA Dundigal, Hyderabad.

• Played the role of a developer and was involved in the development, testing and deployment of the DCMO code, which involved creating a database containing trouble ticketing related data.• The responsibility included writing PL/SQL stored procedures for population of the schemas as well as automating the process and writing mapping queries for populating the different schemas.