I am a data engineer with experience in designing, implementing, and monitoring data pipelines. I work on extracting and collecting data from various sources, including APIs, databases, and external sources, using technologies like BeautifulSoup for web scraping. I implement data transformation and provisioning processes for timely analysis, utilizing AWS Glue, Spark, AWS Lambda, Athena, S3, and RDS. I use Docker, Kubernetes, and Terraform to automate the deployment cycle with CI/CD. I have experience in integrating asynchronous messaging using SQS and RabbitMQ, developing Python scripts and applications for data manipulation and analysis, managing NoSQL databases like DynamoDB and MongoDB, and configuring and monitoring cloud services using CloudWatch. Additionally, I am responsible for monitoring and observability of microservices using Datadog, ensuring real-time detection and propagation of alerts via Slack in cases of inconsistencies, errors, or system integrity failures. I am always eager to learn new technologies and methodologies and share my knowledge and experience with the team.I am also a master's student in Computer Science at UNESP, currently involved in a research project in the field of public security. My work involves dealing with unstructured textual data from various heterogeneous sources. I am performing tasks such as data scraping and fusion, exploratory analysis, data engineering, and applying machine learning techniques for valuable insights.
-
Engenheiro De DadosVisaState Of São Paulo, Brazil -
Data EngineerBanco Bmg Mar 2024 - PresentData Engineer working in the DataLake.- Orchestration of pipelines using Apache Airflow in a cluster on AWS EKS.- Performed ingestion of Data Warehouses into the DataLake.- Participated in the development of a tool for ingestion of multiple and heterogeneous data sources.- Implementation of data ingestion pipelines using AWS EMR.- Massive data integration using PySpark and AWS EMR with query parallelism.- Data storage using S3 and availability using AWS Athena.- Implementation of Data Mesh architecture and distributed queries using Trino. -
Data EngineerWill Bank May 2021 - Feb 2024São Paulo, São Paulo, BrazilData Engineer assigned to the Credit Engine:- Design and implementation of highly efficient data pipelines, ensuring timely data ingestion, processing, and availability for analysis. Utilizing AWS Glue, Spark/pyspark, S3, AWS Lambda, Athena, MongoDB, and RDS.- Extraction and collection of data from various sources, including APIs, databases, and external sources. Using technologies like BeautifulSoup for web scraping.- Implementation of monitoring and observability for microservices using Datadog, ensuring real-time detection and propagation of alerts via Slack in cases of inconsistencies, errors, or system integrity failures.- Development and automation of CI/CD pipelines using GitHub Actions and Docker and Kubernetes environments.- Use of Terraform for infrastructure provisioning and management as code.- Building and managing resilient distributed microservices clusters using AmazonMQ.- Collaboration with Data Scientists to identify analysis opportunities and develop analytical solutions to optimize credit processes and enhance customer experience.- Implementation and configuration of asynchronous message queues with Amazon SQS.- Development of Python scripts and applications for automation and integration.- Utilization of DynamoDB for efficient storage of structured data. -
Software EngineerStratelli May 2020 - Jun 2021I developed a mobile application using PHP Laravel to create a robust API, applying DDD and TDD practices. I implemented CI/CD with GitHub Actions, hosting on AWS EC2, and a database on RDS. Additionally, I integrated a Socket.IO server for real-time chat and used AWS S3 for storing user profile images. The result was a timely delivery, with clean and tested code, following the best practices of the software engineering community, ensuring scalability and a smooth user experience.
-
Software EngineerEficaz Marketing E Tecnologia Dec 2020 - May 2021Marília, São Paulo, BrazilSoftware engineer working directly on the development of APIs, integrations between e-commerce platforms, using and applying DDD, SOLID principles, and CI/CD processes tailored for microservices. -
Software EngineerOrçapá Aug 2019 - Mar 2020Marília, São Paulo, BrazilSoftware Engineer working with APIs, TDD, CI/CD workflows and communication with Mobile applications.
Leonardo S. Education Details
-
Computer Science -
Computer Science -
Computer Science
Frequently Asked Questions about Leonardo S.
What company does Leonardo S. work for?
Leonardo S. works for Visa
What is Leonardo S.'s role at the current company?
Leonardo S.'s current role is Engenheiro de dados.
What schools did Leonardo S. attend?
Leonardo S. attended Universidade Estadual Paulista Júlio De Mesquita Filho, Univem - Centro Universitário Eurípides De Marília, Etec - Escola Técnica Estadual De São Paulo.
Who are Leonardo S.'s colleagues?
Leonardo S.'s colleagues are Nicholas Mark, Grace Yu, Andy Field, Alejandra Daniela Addario, Jazmin Burks, Xide Low, Craig Cox.
Not the Leonardo S. you were looking for?
-
Leonardo S Souza
Cybersecurity Manager | Mba | Engineer | Architect | Ics | Ot Security | IiotSão Paulo, Sp -
-
Leonardo Santos
São Paulo, Brazil2hotmail.com, ativas.com.br1 +819831XXXXX
-
Leonardo S. Braga
Rio De Janeiro, Rj -
Leonardo S.
Head It /|\ It Manager || Gerente De T.I | System Administrator || Administrador De Sistemas | Cloud Aws || Computação Em Nuvem | Network Security || Segurança De Redes | Information Security || Segurança Da InformaçãoSalvador, Ba
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial