- Spearheading the migration of on-prem tech-stack analytical solutions to Snowflake AWS Cloud solutions using data lake platform.- Developing data warehouse and data marts on Snowflake platform.- Creating AWS Glue ingestion pipelines for loading source data into the data lake in AWS S3 using incremental data load strategies.- Creating file formats and stages in snowflake to connect the S3 to snowflake for data load into snowflake raw zone.- Writing Snowpark procedures in snowflake for POC purposes for the transformation layer.- Writing DBT Models for transformation of raw data in the raw zone in snowflake.- Creating Snowflake Stored Procedures for loading data into the Raw Zones.- Training juniors with the tech-stack to make them ready for new roles.- Creating Airflow DAGs for orchestrating DBT models and ingestion pipelines.- Optimizing SQL on snowflake platform for time and cost optimization.- Implemented DBT tests to make sure the business rules are tested well after DBT run to identify any data or business scenarios if encountered.- Created a custom audit framework to keep an eye on data processing and loads which were given to all stakeholders to look for anomalies in the quality and volume of data.- Optimizing on-prem SQL Server platforms for better efficient usage of resources and reduced procedure run times to up to 200%.- Performed POC using AWS Redshift as an option to the data warehouse in place of snowflake for gauging loading and access performance.- Created budget load processes by loading data into existing dimension and fact tables without deterring the existing data for comparison of budget vs actuals in final reports. This was later automated by simply passing CSVs to S3 and running parameterized stored procedures.- Leading the research of new technologies and POC implementations.- Creating Power BI reports with RLS for business users.

- Working with team of professionals to ensure quality deliverables.- Work with clients to architect and manage data projects for on-time and quality executions.- Perform extensive research programs for new technologies and platforms.- Lead strategic partnerships with global organizations to solve data issues.- Establish policies & guidelines to adhere to world class Data Governance standards.- Setup Information Engineering in large scale organizations to get the most out of their data and refine data analytics & engineering practices.- Consult global firms to improve engineering processes for data division for optimized utilization of infrastructure and human capital- Perform Cost Optimizations for companies for their data infrastructure and platforms.

- Designing and Implementing database platforms, data warehouses and data models for scalable loads for efficient and fast operations.- Working with business teams to understand their analytical requirements and modeling and designing extensible and scalable data warehouses to suit their current and future needs.- Designing heavy duty ETLs with SSIS packages to extract heavy datasets from various source formats and applications.- Writing complex SQL and SSIS packages to perform intricate business algorithms to transform data which is further loaded in data warehouse.- Designing incremental warehousing solutions for fast paced and efficient loading.- Creating complex OLAP databases (SSAS Tabular) to cover all business scenarios and tuning it to decrease processing time and reduce the DAX execution time.- Creating Power BI reports for clients which can be used by CxOs for decision making.- Optimizing Data Layers including SSAS Tabular, SSAS Multi-Dimensional, SQL Server DW and SQL Server relational databases and servers for large scale data sets.- Writing complex DAX queries for retrieving data from SSAS Tabular models and using them into custom made charts in applications and Power BI reports.- Authoring SSRS reports which can be used by large set of users with proper authorization in place to follow the access matrix defined by management.- Implemented Dynamic RLS in SSAS Tabular with accesses related configurations stored in a fact mapping table which contained mapping of users to projects which they had access to. DAX implementation inside roles using dynamic RLS helped in configuring SSAS database for authorization. This removed the need to implement any additional security code in DAX scripts. It was resolved automatically once the user ID was passed in the DAX context.

- Wrote complex SQL scripts, views and stored procedures to achieve complex business case implementations with in the database.- Reviewing code of application developers to make sure optimized and standardized code is sent to production environments.- Automating Full, Differential and Log backups on production and UAT environments for better RTO and RPO matrices.- Created, deleted, modified and maintained indexes for better performance.- Created maintenance jobs for keeping the database server clean and up to date.- Took part in data model designing considering aspects like data storage, retrieval, ease of querying, extensibility of data model and optimized querying.- Lead the framing of security policies to create strong security grid for controlled access and maintaining certainty in data privacy.- Created documentation of system configurations, jobs, database objects and ADR (Architecture Decision Review) for easier handover, decision making and planning.- Optimized queries and reduced execution times upto 200% which provided faster page loads.- With improved capacity planning and database & server configurations, the database was made scalable upto 400% in Phase 1.- Created archive mechanisms to offload cold data into archive systems on a slower disk which can be accessed in case of auditing. This made the database performance faster upto 300% since the data was well managed in this case now.- Reduced the cost by implementing proper archival, backup and storage mechanisms reducing the requirements for RAM and CPU on the primary OLTP server.- Involved in making HA & DR decisions by evaluating cost, uptime and data usage requirements of the business.- Implemented SQL Server Log Shipping, SQL Server Transaction Log Replication & Always On Availability Groups to keep data platform up and running.

- Inherited a sluggish and erroneous BI system built on MSBI platform, studied it and made a plan for solving issues, optimizing it and taking in change requests with a priority matrix created keeping the business priorities in mind.- Solved ETL issues to make sure there were no failing ETLs by making changes in SSIS packages.- Added error logging configurations to SSAS multi-dimensional database to retrieve all the data issues that were being encountered and solved which were at SSAS level.- Solved the data issues generated by the ETLs to make sure not all valid business records went to NULLs and Unknown members in dimensions.- Solved issues in the data warehouse design to eliminate bogus, duplicate and bad records from the data warehouse for a cleaner DW and OLAP.- Optimized the ETL to make it run faster so that all jobs could complete within the 24 hour window which took 28 hours to complete previously.- Optimized the DW data model by revisiting data storage, data retention, data redundancy, combining fact and dimension tables, removing legacy requirements from system after discussion with business. This reduced the size of database by 60%.- Reducing the SSAS database processing time by 80% after optimizing the data model and SSAS OLAP design.- Optimized the SQL scripts and procedures used inside the ETLs to gain improvements upto 200% during ETL run times.- Reduced the ETL time to 4 hours overall.- Groomed freshers and junior resources to take up project tasks and execute well.- Solved issues in SSRS reports to make them accurate and precise for business to start trusting numbers and starting making decisions based on them.- Created source data profiling framework to spit out bad data and send it to source data administrators and business analysts to correct them and upload again so as to keep data warehouse clean and reporting accurate.

- Worked on creating database views on SQL server for business users to view data with limited permissions at the client site.- Created stored procedures to implement business logics in SQL which were used by application developers to show data.- Created User Defined functions to implement common business logic which were used across the development team so that code is reused.- Created stored procedures for SSRS report developers to display report data from the SQL Server database.- Made changes in existing SQL server views and procedures to suit the change requests from business.- Performed extensive data testing using SQL and excel to troubleshoot reported issues from support and business teams.