Build data pipelines in Airflow in GCP for ETL related jobs using different airflow operators.Creating alerting policies for Cloud Composer, Cloud Data fusion to notify on any job failure.Generated SQL/MDX queries and analyzed Cognos SQL, Native SQL to troubleshoot report issues.Create snowflake ingestion scripts and document the datasets to make data available for queryingAutomate data ingestion/ data migration into snowflake using airflowCreate extracts on the staged data… Show more Build data pipelines in Airflow in GCP for ETL related jobs using different airflow operators.Creating alerting policies for Cloud Composer, Cloud Data fusion to notify on any job failure.Generated SQL/MDX queries and analyzed Cognos SQL, Native SQL to troubleshoot report issues.Create snowflake ingestion scripts and document the datasets to make data available for queryingAutomate data ingestion/ data migration into snowflake using airflowCreate extracts on the staged data to make it available for business consumptionDeveloped data integration solutions between various source systems and Snowflake using Snow pipe and other ETL tools.Used Cloud shell SDK in GCP to configure the services Data Proc, Storage, Big Query.Designed and implemented end-to-end data pipelines using Pandas, transforming raw data from diverse sources into structured datasets for analysis and reporting.Used Version control systems includes Subversion (SVN), GIT Hub, and Clear Case.Led the migration of legacy data systems to Snowflake resulting in improved data accessibility and reduced processing time.Developed a utility which transforms and exports the data from GCP Cloud storage to GCP Cloud composer. Show less

• Involved in writing stored procedures, Triggers, User-defined Functions, Views and Cursors for both Online and Batch requests handling business logic and functionality of various modules• Did SQL performance monitoring and tuning of reporting data by optimizing indexes and stored procedures.• Involved in performance tuning of T-SQL queries and Stored Procedures.• Used different data flow elements like Flat File, OLEDB, Excel Sources, Destinations and Data Flow Transformations like… Show more • Involved in writing stored procedures, Triggers, User-defined Functions, Views and Cursors for both Online and Batch requests handling business logic and functionality of various modules• Did SQL performance monitoring and tuning of reporting data by optimizing indexes and stored procedures.• Involved in performance tuning of T-SQL queries and Stored Procedures.• Used different data flow elements like Flat File, OLEDB, Excel Sources, Destinations and Data Flow Transformations like Data Conversion, Conditional Split, Derived Column etc.• Wrote MDX queries and expressions for use in Front End BI Applications and created SSRS reports.• Developed and maintained data pipelines using Azure Data Factory, and monitored data processing and ingestion for quality and accuracy.• Implemented data warehousing solutions using Azure Synapse Analytics, and designed and developed data models and ETL processes.• Collaborated with data scientists and analysts to develop predictive models and data visualizations using Power BI.• Experience in OLAP cube modeling, including: MDX scripting, aggregations, partitions, dynamic dimension and cell security, KPI's, actions, write backs and perspective's development (SSAS).• Working with large dimensions to optimize ETL load and SSAS processing times.• Implemented SSAS dynamic dimension and cell security with user specific sub-set calculations Show less

• Created SSIS Reusable Packages to extract data from Multi formatted Flat files, Excel, XML files into Database and Billing Systems.• Capture business objectives and processes and design and develop a comprehensive application and solution.• Extract the data from various sources like SQL Server, Text files, and access into Data Warehouse• Works with SQL Server, SSIS technologies and has a good Data Warehouse knowledge and tools.• Extract Transform and Load (ETL) source data… Show more • Created SSIS Reusable Packages to extract data from Multi formatted Flat files, Excel, XML files into Database and Billing Systems.• Capture business objectives and processes and design and develop a comprehensive application and solution.• Extract the data from various sources like SQL Server, Text files, and access into Data Warehouse• Works with SQL Server, SSIS technologies and has a good Data Warehouse knowledge and tools.• Extract Transform and Load (ETL) source data into respective target tables to build the required data marts.• Documentation for all kinds of reports and SSIS packages.• Created SSIS Packages using Pivot Transformation, Fuzzy Lookup, Derived Columns, Condition Split, Term extraction, Aggregate, Execute SQL Task, Data Flow Task, and Execute Package Task etc.• Successfully conducted root cause analysis to identify the underlying issues and design solutions accordingly.• Involved in the data mapping sessions and creation of Data dictionary.• Migration of the data from one environment to another environment. Testing and analysis of the migrated data. Show less

• Experience in writing Stored Procedures, Views, and Functions in SQL using Oracle SQL Developer for data to SSRS reports.• Create new SSIS Packages to export flat file for customer. Created and executed SSIS packages to populate data from the various data sources for different data loading operations for many applications.• Gathered functional and non-functional client requirements to optimize the design of BI deliverables (reports, dashboards, alerts, visualizations).• Worked… Show more • Experience in writing Stored Procedures, Views, and Functions in SQL using Oracle SQL Developer for data to SSRS reports.• Create new SSIS Packages to export flat file for customer. Created and executed SSIS packages to populate data from the various data sources for different data loading operations for many applications.• Gathered functional and non-functional client requirements to optimize the design of BI deliverables (reports, dashboards, alerts, visualizations).• Worked closely with visual design team to select the appropriate visualizations for BI deliverables.• Created various complex Reports such as Tablix reports for static columns and matrix report types for dynamic pivot columns using SQL Server Reporting Services 2008 using Oracle 11g as the data source.• Involved in Analyzing, designing, building &, testing of OLAP cubes with SSAS and in adding calculations using MDX. • Created and designed solutions that use the SSRS gateway to interface between SSRS and a web front end (ideally flex) reports to make minimize the report execution time and to limit the no of records required.• Implemented Extraction Transformation and Loading (ETL) process by pulling large volume of data from various data sources using SSIS.• Designed and developed SSIS Packages for loading data from text files, CSV files to SQL Server databases using SSIS. Show less