Responsibilities:• Led the implementation of efficient ETL workflows, reducing data loading time by 50% through handling Slowly Changing Dimensions (SCD-type-2) in the Data Warehouse.• Developed and managed data pipelines from extraction to transformation to loading in BigQuery, connecting various data sources such as Microsoft SQL server, Teradata, and REST-API endpoints.• Utilized Python airflow scheduling (DAG) and orchestrator for pipeline construction, integrated with Tekton (CI-CD pipeline) and Astronomer server. Managed Terraform code for GCP resource provisioning.• Collaborated on the deployment and configuration of dataproc service for batch and near real-time workload using Spark processing framework, and real-time streaming with dataflow service via pub/sub to ingest data onto BigQuery.Impact:• Enhanced data processing efficiency resulting in a 50% reduction in data loading time, ensuring up-to-date and accurate reporting.• Streamlined data extraction and transformation processes, facilitating smoother integration with various data sources.• Implemented scalable solutions for batch and real-time data processing, improving overall system performance and reliability.Awards:• Recognized for outstanding contributions to project efficiency and data processing optimization• Got two certification of appreciation for contributing to project and ad-hoc improvement and enhancement request

I had the opportunity to work on customer review feedback analysis aimed at improving the app features. I leveraged my expertise in Qlik-sense, Python, NLP, and Tableau to analyze large volumes of data and generate insights.Using NLP, I was able to extract meaningful information from customer reviews and feedback, providing valuable insights into their pain points and preferences. By utilizing Python for data cleaning and transformation, I ensured that the data was in a format that was easy to work with.In addition, I utilized Qlik-sense to create visually appealing dashboards and interactive reports, allowing stakeholders to easily understand the insights and make informed decisions. Furthermore, I used Tableau to create visually engaging data visualizations that conveyed complex information in a clear and concise manner.Through my efforts, the company was able to identify areas for improvement and make data-driven decisions to enhance the app's features, resulting in improved customer satisfaction and increased user engagement.