Carlos Quezada Email & Phone Number

• Architected and deployed a secure analytics infrastructure on AWS using Terraform, enhancing data observability and reliability.
• Deployed Apache Airflow and developed custom plugins in Python to orchrestrate batch jobs for feeding applications, third-party integrations, business analytics, and alerting, streamlining robust batch pipeline.
• Engineered batch processing jobs using Apache Spark and Scala, extracting key insights from large datasets to provide customized features, leading to increased user satisfaction and retention.
• Developed analytics microservices APIs using Golang, Postgres and Redis, delivering complex real-time insights to the application with a Lambda architecture approach, achieving average responses times of under 10.
• Integrated OpenAI LLMs to construct a personalized AI coach, enhancing user experience through tailored support chat by using embeddings and dynamically generated prompts, increasing user engagement by up to 2 minutes.

Redwood City, CA, US

• Deployed Apache Airflow within a Kubernetes environment, ensuring efficient orchestration of data pipelines and seamless migration of legacy data jobs, reducing on-calls and improving monitoring and visibility.
• Led the migration of the data lake from S3/Hadoop to Snowflake, accelerating data-related projects delivery, reducing processing cost, and enhancing data management and governance.
• Engineered custom Airflow plugins and a CLI tool for synchronizing and migrating the legacy data lake to Snowflake, ensuring data consistency and timely availability for analytics.

San Francisco, CA, US

• Developed CI/CD pipelines, established code reviews and best practices, enhancing collaboration, code quality and reliability, anddeployment efficiency.
• Improved the performance, maintainability and robustness of key batch and streaming Apache Spark jobs through comprehensivecode refactoring, decreasing development time and increasing data jobs stability.
• Played a key role in hiring and mentoring new data engineering team members, fostering a collaborative and productive environment, contributing to reaching team KPIs.

New York, NY, US

• Technical Leader for the Presence Team and provide technical guidance to the Data Science team.
• Ensure engineering best practices and coding standards to produce readable, maintainable and extensible code, and reduce the risk of introducing bugs.
• Quickly learned and trained the engineering team on Golang, Kubernetes and Helm.
• Architected and implemented the WIFI signal ingestion pipeline for normalizing and preparing the data for real time streaming and bash processing. (Golang, GRPC, HTTP, MQTT, Kafka, Websockets, Docker, Kubernetes, Helm.
• Implemented the ingestion pipeline metrics, alerting and monitoring dashboards to provide visibility into the health of the systems and to oversee the behavior of each building being ingested (Prometheus, Graphana).
• Developed base line code for the Data Scientists team to ensure maintainability and coding standards. Set Amazon EMR cluster configuration for processing high volume of data. (Apache Spark, Scala, Amazon EMR, Amazon.

San Francisco, CA, US

• Technical leader on the Data Engineering team.
• Reduced Pagerduty alerts on the nightly batch jobs by doing a complete review and refactoring of Apache Spark code and improving the EMR cluster configuration. (Scala, Amazon EMR).
• Maintained and improved the data ingestion pipeline. Containerized the services to better utilize Amazon EC2 resources and improve the scalability and availability. (Scala, Cassandra, Docker,Jenkins).
• Implemented demo data in Apache Spark batch job for the sales and marketing teams to showcase the product to potential new customers. Developed network profiles feature to produce a more comprehensible clients’.
• Improved Cassandra schemas by denormalizing the tables and choosing better partition and clustering keys.
• Implemented and deployed Airflow and replaced Jenkins as the job scheduler and pipeline orchestrator tool for the entire data pipeline. Developed DAGs and Airflow plugins. (Docker, Python, Chef).

San Francisco, CA, US

• Resolved credit card transactions ingestion service performance and memory consumption problems by eradicating memory leaks and enhancing data streaming which drastically improved the uptime of the service..
• Implemented on time Payment Card Industry (PCI) compliance requisites required to obtain the certification. Secured sensitive data and PII information. (Java, Docker, Amazon ECS, Amazon KMS, RestAPI, Graylog).
• Collaborated with the Messenger team by adding additional back-end features.

Redwood City, CA, US

• Successfully designed and implemented scalable IOT data ingestion pipeline that consumes from the messaging service and uploads Parquet files to cloud repositories. (Java, Cassandra, RabbitMQ, Kafka, Avro, Parquet.
• Enhanced Data Snapshot service that produces and exports in various formats a full snapshot with the current state of devices and users. It performs data obfuscation and custom data transformations to protect PII.
• Refactored, containerized and implemented continuous deployment in order to transition from a Monolithic to a Microservices architecture. This sped up the deployment of the IOT platform from weeks to minutes. (Docker.

Atlanta, GA, US

• Enhanced internal ETL tool by adding GUI support and implementing additional data manipulation features.
• Designed and implemented X12 HIPAA EDI (837, 835, 834, 270, 271, 278, 277, and 999) data importation and exportation.
• Improved Daktronics protocol implementation.

New York, NY, US

Responsible for teaching basic skills in electronic mail, Microsoft Word, Microsoft Excel and Microsoft Power Point.Projects:- Class Attendance Control:Analyzed and developed software solution for decrease manual activities and improve the accuracy informing statistics to headquarters.

Santiago, CL

Responsible for requirements definition, design, development and maintenance of financial industry software.Coordinated with quality assurance department and external services providers.Collaborated with project managers, internal clients and stakeholders.Accomplishments:- Debts Collection Project:Analyzed software requirements and designed database for a.

Santiago, CL

Requirement Analysis, database modeling, development, client coordination.Accomplishments:- Construction Project Management:Enhanced budget accuracy, reduced response time to clients and centralized the information for a construction management platform by the migration and development of a new platform.- Management Data-warehouse:Improved management.

Requirement Analysis, database modeling and development for a healthcare system.

Ingeniero Informatico, Tecnologias De La Informacion

Ingles Avanzado, Lenguaje

Postitulo En Gestion Informatica, Gestion Ti