Senior Data Engineer
CurrentExperienced in architecting and implementing robust data solutions within AWS environments, I bring expertise in a wide array of technologies and platforms to drive data-driven decision-making and optimize organizational efficiency. From designing data lakes on S3 with Glue for seamless data cataloging to orchestrating ETL workflows with PySpark within Snowflake databases, I ensure data integrity and accessibility throughout the extraction, transformation, and loading processes… Show more Experienced in architecting and implementing robust data solutions within AWS environments, I bring expertise in a wide array of technologies and platforms to drive data-driven decision-making and optimize organizational efficiency. From designing data lakes on S3 with Glue for seamless data cataloging to orchestrating ETL workflows with PySpark within Snowflake databases, I ensure data integrity and accessibility throughout the extraction, transformation, and loading processes. Skilled in managing distributed computing clusters with Hadoop and EMR, I leverage tools like Athena and Redshift for interactive querying and scalable analytics. With a focus on automation, security, and performance optimization, I excel in streamlining data pipelines, integrating real-time processing solutions, and implementing CI/CD pipelines for agile software delivery. My proficiency extends to diverse areas including API development, containerized deployments with Kubernetes, and agile methodologies, enabling me to drive impactful outcomes in complex data environments. Show less