Senior Data Engineer
Data & InsightsSupporting the migration of our Hadoop and SQL Server environments to cloud-based tools such as Snowflake and Databricks. Utilizing dbt for data transformation, StreamSets for data ingestion, and Airflow for workflow orchestration within our analytics platform. Responsibilities have included managing and maintaining Hadoop, SQL Server, and Databricks environments, and contributing to the successful transition of our Cloudera cluster to these modern technologies. Ensuring data integrity and optimizing performance, I have conducted proactive monitoring, resolved issues, and implemented enhancements to maximize efficiency and reliability. Additionally, I have collaborated closely with data owners, data scientists, and stakeholders to deliver strategic data solutions and support new product initiatives.