My role as a Senior Data Engineer revolves around architecting scalable data solutions that drive strategic decisions. With expertise in Azure Data Factory, Databricks, and real-time analytics using Apache Kafka and Spark Streaming, I have significantly improved data processing times by 40%. The migration of critical datasets to the cloud under my leadership has not only enhanced real-time data access but also bolstered our operational analytics capabilities.My technical prowess extends to managing CI/CD pipelines and adopting AI tools to automate monitoring, ensuring high compliance and reporting standards. The successful implementation of these technologies at Texas Pharma allowed me to support public health analytics through improved data ingestion and predictive analytics platforms. Contributing to team efforts, we've established robust data governance frameworks, fortifying data security and compliance with industry standards.