Senior Data Engineer
CurrentAs a Sr. Data Engineer, Specialized in migrating on-premises data warehouses to Google Cloud Platform (GCP) and optimizing data pipelines for efficiency and scalability within cloud environments.Utilized Google BigQuery for large-scale data processing and analysis, and leveraged Dataflow for streamlining data integration and transformation.Employed Power Query to automate data extraction, cleansing, and transformation while integrating Alteryx with Tableau to create interactive and… Show more As a Sr. Data Engineer, Specialized in migrating on-premises data warehouses to Google Cloud Platform (GCP) and optimizing data pipelines for efficiency and scalability within cloud environments.Utilized Google BigQuery for large-scale data processing and analysis, and leveraged Dataflow for streamlining data integration and transformation.Employed Power Query to automate data extraction, cleansing, and transformation while integrating Alteryx with Tableau to create interactive and insightful data visualizations.Developed advanced calculated fields in Google Data Studio for enhanced reporting and designed robust data models in Qlik Sense for comprehensive analytics.Optimized Spark jobs on Google Dataproc for improved performance and resource management, and implemented Livy batch jobs for scalable processing of large datasets.Developed RESTful APIs for seamless submission and management of Spark jobs, ensuring data security and compliance within cloud environments through best practices and robust solutions. Show less