Design and Implementation of Integration service between MSSQL database and Netezza database using DataStage 8.5/9.1 and CDC generated Flat files. Developed prototype of DataStage jobs and its demo to the client along with its implementation on test environment. Converted 200+ DataStage jobs from 9.1 to 8.5 environment. Responsible for the assignments given by the client and its evaluation along with distribution of task in the team. Involved in overall requirement gathering and reporting back to the client.

Architecting Integration between IBM Change Data Capture and DataStage using CDC Direct Connect/File-Based technology. Providing support and Monitoring for CDC and DataStage jobs.Documenting the major components, this will be used in the project to achieve performance and re-usability. Performed Unit testing, UAT and deployment of jobs from UAT to Production environment. Optimizing and Troubleshooting of CDC subscriptions to reduce CPU/Memory utilization on Source DB. Exception handling on DS to maintain uninterrupted Jobs.

Optimizing the overall daily ETL process. Figuring out the major breakpoints to create a more flexible, potential and quick response ETL system. Requirement gathering from different teams to optimize their respective ETL processes. Deployment of BI patches on UAT. Development of SQL procedures for ETL.

Provided Technical support to the team as the ETL developer. Addressed best practices and productivity enhancing issues. Worked on designing and developing the Quality stage. Loaded data into load, staging and lookup tables. Staging area was implemented using flat files. Created jobs in DataStage to import data from heterogeneous data sources like Oracle 9i, Text files and SQL Server. Designing Data masking techniques to mask sensitive information when working with offshore.Assisted Mapping team to transform the business requirements into ETL specific mapping rules

Developing Complex ETL jobs with re-usability of the Jobs as key factor.Created development standards and ensured compliance for easy transition and maintenance.Responsible for Offshore development delivery, technical specifications and approval of IT Master Calendar. Interacted with users, functional team for gathering details necessary for ETL road map creation.Responsible for the maintenance of Data Model and creation of High Level ETL designs. Involved in creating Functional and scope documents for ETL process.

Data Warehouse is implemented using sequential files from various Source Systems.  Meeting with Source system users & Business Users to create data share agreements and BI requirements.  Involved in Defining Best practice docs, Development standards doc for DataStage Jobs.  Developed Mapping for Data Warehouse and Data Mart objects.