Senior Data Engineer
Current•Managed all stages of the Software Development Life Cycle (SDLC), including requirements analysis, technical design, coding, testing, and deployment, ensuring effective solutions for insurance data management.•Designed and implemented scalable ETL pipelines using Google Cloud Platform (GCP) services such as BigQuery and Cloud Storage to manage large insurance datasets.•Developed real-time data streaming solutions with Google Cloud Pub/Sub, enhancing data processing and integration for insurance claims and underwriting systems.•Utilized Dataflow automated templates for seamless data management between Google Cloud Storage (GCS) and BigQuery, improving data pipeline efficiency.•Using Talend, end-to-end ETL processes were designed and created, simplifying the integration of data from various sources into data warehouses and analytics platforms.•Experienced in Talend jobs were configured and optimized for data transformation, guaranteeing good processing performance and scalability even for big datasets.•Created and maintained complex data models and data warehouses in BigQuery to support analytics and business intelligence for insurance metrics.•Implemented automated ETL processes with Apache Airflow and Python scripts, optimizing ETL workflows and ensuring data integrity.•Integrated insurance data from several sources, such as policy administration systems and claims databases, into cloud-based data warehouses like Snowflake and Redshift, we designed and constructed ETL pipelines utilizing Matillion.•Collaborated with cross-functional teams using JIRA and Confluence to align data engineering efforts with underwriting, claims, and finance needs.•Executed AWS Glue tasks that optimized to extract, transform, and load data and insurance policy data into data lakes and Amazon Redshift.•Utilized Power BI for data insights and forecasting, analyzing insurance metrics, claims frequency.