Senior Data Engineer
CurrentI've acquired extensive experience in architecting and implementing data solutions tailored for financial analytics, leveraging Python, SQL, and Kubeflow. My expertise includes developing efficient ETL pipelines in Snowflake and integrating MongoDB and Apache Kafka for real-time data processing. I ensure timely and accurate data delivery through Airflow automation and utilize Google Cloud Storage and BigQuery for scalable, secure data storage. Engaged with various Google Cloud Platform (GCP) services including Compute Engine, Cloud Load Balancing, Cloud Storage, and Cloud SQL. Performed troubleshooting and fine-tuning of Talend Data Fabric jobs to optimize data processing efficiency andreliability on the Google Cloud Platform (GCP).Designing data models in Teradata and employing Google Cloud Dataflow for efficient streaming and batch processing are integral parts of my skill set. Worked collaboratively with cross-functional teams to fine-tune Talend Data Fabric configurations, ensuring optimal performance within the Google Cloud Platform (GCP) ecosystem.I collaborate cross-functionally to drive innovative, data-driven solutions in finance while prioritizing data governance and security. Utilizing Pandas and DBT for data transformation and analysis in financial datasets. My proficiency extends to streamlining data pipelines, implementing collaborative analytics, and deploying advanced analytics for deep financial insights. Additionally, I focus on enhancing data visualization and ensuring compliance with financial regulations, driving innovation through technology integration.