As a Sr. Data Engineer, Specialized in migrating on-premises data warehouses to Google Cloud Platform (GCP) and optimizing data pipelines for efficiency and scalability within cloud environments.Utilized Google BigQuery for large-scale data processing and analysis, and leveraged Dataflow for streamlining data integration and transformation.Employed Power Query to automate data extraction, cleansing, and transformation while integrating Alteryx with Tableau to create interactive and… Show more As a Sr. Data Engineer, Specialized in migrating on-premises data warehouses to Google Cloud Platform (GCP) and optimizing data pipelines for efficiency and scalability within cloud environments.Utilized Google BigQuery for large-scale data processing and analysis, and leveraged Dataflow for streamlining data integration and transformation.Employed Power Query to automate data extraction, cleansing, and transformation while integrating Alteryx with Tableau to create interactive and insightful data visualizations.Developed advanced calculated fields in Google Data Studio for enhanced reporting and designed robust data models in Qlik Sense for comprehensive analytics.Optimized Spark jobs on Google Dataproc for improved performance and resource management, and implemented Livy batch jobs for scalable processing of large datasets.Developed RESTful APIs for seamless submission and management of Spark jobs, ensuring data security and compliance within cloud environments through best practices and robust solutions. Show less

As a Data Engineer and Cloud Solutions Architect at The Container Store,Played a pivotal role in modernizing The Container Store’s data infrastructure.Designed and implemented scalable cloud solutions using Azure and AWS, enhancing data processing capabilities.Led the development and management of efficient ETL pipelines with Azure Data Factory and SSIS, streamlining data integration and transformation processes.Utilized big data technologies such as Hadoop and Spark to handle… Show more As a Data Engineer and Cloud Solutions Architect at The Container Store,Played a pivotal role in modernizing The Container Store’s data infrastructure.Designed and implemented scalable cloud solutions using Azure and AWS, enhancing data processing capabilities.Led the development and management of efficient ETL pipelines with Azure Data Factory and SSIS, streamlining data integration and transformation processes.Utilized big data technologies such as Hadoop and Spark to handle and analyze large datasets, providing actionable insights for business growth.Directed the migration of legacy systems to cloud environments, ensuring data accuracy and continuity.Collaborated closely with cross-functional teams to align data strategies with overall business objectives, contributing to digital transformation initiatives at The Container Store. Show less

As a Big Data Engineer,Developed and managed ETL pipelines using SQOOP, SPARK, and various file formats (RDBMS, CSV, XML) to ensure efficient data ingestion and processing.Designed and implemented a data delivery pipeline for automated updates to customer-facing data stores, enhancing data accessibility.Integrated Redshift with Power BI to create dynamic dashboards for advanced analytics.Created Dockerized backend applications with APIs, deployed on Kubernetes for scalable cloud… Show more As a Big Data Engineer,Developed and managed ETL pipelines using SQOOP, SPARK, and various file formats (RDBMS, CSV, XML) to ensure efficient data ingestion and processing.Designed and implemented a data delivery pipeline for automated updates to customer-facing data stores, enhancing data accessibility.Integrated Redshift with Power BI to create dynamic dashboards for advanced analytics.Created Dockerized backend applications with APIs, deployed on Kubernetes for scalable cloud solutions.Utilized Amazon EMR for big data processing on EC2 and S3, implementing secure and efficient data processing practices.Developed AWS Lambda functions to automate data processing tasks, including invoking Glue jobs based on S3 events.Created and maintained ETL processes in AWS Glue and Informatica for data migration and transformation.Collaborated with stakeholders and the Data Governance team to ensure data accuracy and compliance. Show less

At Mount Sinai Health System, I served as a Junior Data Engineer, where I was instrumental in designing and implementing data pipelines to support the organization’s data needs. I focused on data cleansing and transformation using Spark and Hive, ensuring high data quality and consistency. I played a key role in developing Spark SQL scripts and monitoring YARN clusters to optimize performance and availability. My responsibilities also included the migration of traditional systems to… Show more At Mount Sinai Health System, I served as a Junior Data Engineer, where I was instrumental in designing and implementing data pipelines to support the organization’s data needs. I focused on data cleansing and transformation using Spark and Hive, ensuring high data quality and consistency. I played a key role in developing Spark SQL scripts and monitoring YARN clusters to optimize performance and availability. My responsibilities also included the migration of traditional systems to Azure, leveraging services like Azure Data Factory for efficient data processing. Additionally, I worked on integrating and processing data from various sources, including HDFS and NoSQL databases, contributing to comprehensive data analysis and reporting solutions. My work supported various healthcare analytics projects, enhancing data-driven decision-making and operational efficiency across the health system. Show less

At Synchrony Technologies, I worked as a Data Analyst, focusing on developing and optimizing data workflows to enhance performance and reliability. My responsibilities included automating data processes using Python and Unix Shell scripting, which streamlined workflows and improved efficiency. I utilized Sqoop for real-time data ingestion and built internal visualization platforms to facilitate in-depth data analysis and comparison. Additionally, I worked with AWS technologies… Show more At Synchrony Technologies, I worked as a Data Analyst, focusing on developing and optimizing data workflows to enhance performance and reliability. My responsibilities included automating data processes using Python and Unix Shell scripting, which streamlined workflows and improved efficiency. I utilized Sqoop for real-time data ingestion and built internal visualization platforms to facilitate in-depth data analysis and comparison. Additionally, I worked with AWS technologies, including Snowflake and Redshift, to manage and analyze large datasets. I also played a key role in implementing end-to-end machine learning workflows, using libraries like Sci-Kit Learn and MLLIB for model development and deployment. My work supported data-driven decision-making and provided valuable insights into market and bond performance. Show less