Carlos Castro

Carlos Castro Email and Phone Number

Data Engineer | Databricks | Azure | AWS | PySpark | Big Data | ETL | Redesigned the data architecture using PySpark and Python to optimize performance and reduce costs by 28%. @ EloGroup
brazil
Carlos Castro's Location
Fortaleza, Ceará, Brazil, Brazil
About Carlos Castro

I'm a data engineer with a degree in electrical engineering and four years of programming experience. My passion for technology is mainly reflected in my programming skills in Python, PySpark and SQL. I specialize in building and optimizing ETL and data modeling. I have knowledge of Databricks, Snowflake, DBT, cloud computing (Azure and AWS) and Data Warehousing.I have a natural inclination for problem-solving, always seeking to understand the particularities of each challenge and provide tailor-made, efficient solutions. My strategy is based on the constant search for knowledge and the ability to adapt. I am motivated by challenging projects that contribute to my professional development.

Carlos Castro's Current Company Details
EloGroup

Elogroup

View
Data Engineer | Databricks | Azure | AWS | PySpark | Big Data | ETL | Redesigned the data architecture using PySpark and Python to optimize performance and reduce costs by 28%.
brazil
Website:
elogroup.com.br
Employees:
434
Carlos Castro Work Experience Details
  • Elogroup
    Data Engineer
    Elogroup May 2023 - Present
    As a Data Engineer in a multidisciplinary team, my role involves data modeling and the provisioning of customized architectures to meet the specific demands of each project, guaranteeing its integrity and efficiency. I always seek solutions that are scalability-oriented, economically viable and secure.Main highlights:>> I implemented a data architecture using Databricks as Software as a Service (Databricks Workflow, Unity Catalog, Databricks SQL) in a Big Data project, where all the data remodeling was done using Python and PySpark, decommissioning SAP BW and generating a 22% reduction in the annual cost of the data architecture.>> I led the data modeling for an on-premises Big Data project, using technologies such as Hadoop, Hive, Presto, Python and PySpark.
  • Favo
    Data Engineer
    Favo Jul 2022 - May 2023
    As a Data Analysis Engineer, I led the construction of ETL processes using tools such as Airflow and DBT to ensure data quality, efficiency and low cost. I developed optimized SQL queries in Snowflake and AWS Athena, as well as automating data pipelines with DAGs in Airflow. I also migrated legacy tables, integrated processes via APIs and used the AWS Cloud with version control in Git and GitHub.Main highlights:>> I developed the ETL process by incorporating the DBT tool into our stack, with the aim of improving data quality, increasing efficiency, scalability and ease of maintenance, as well as reducing processing costs by 8%.>> Implementation of an incremental update approach for datalake databases, resulting in a reduction of more than 30% in processing costs.
  • Fortes Tecnologia
    Analytics Engineer
    Fortes Tecnologia Dec 2021 - Jul 2022
    As an Analytics Engineer in a multidisciplinary team, I am responsible for creating Data Preparation Flows using Power Query and Python (ETL), as well as implementing Databases using the Python language. I structure table relationships within the database using Python and develop efficient SQL queries. In addition, I contribute to the creation of dashboards and KPIs in MS Power BI, using Dax and M, to offer valuable insights to stakeholders.Main highlights:>> Conducting the comprehensive structuring and consolidation of all the company's databases, with a focus on guaranteeing the integrity and accuracy of the information stored. By automating the data pipeline, the process is managed efficiently, reducing problems of inconsistency and guiding the company towards the effective adoption of a data-driven culture.>> Development of a preliminary forecasting study aimed at preventing customer losses, resulting in estimated revenue of R$200k per year.
  • Eneva
    Analytics Engineer
    Eneva Aug 2020 - Sep 2021
    As a Jr. Analytics Engineer, my responsibilities include automating the integration of data from the SAP MM system with Excel, using VBA. Performing data processing to evaluate the annual cost, financial useful life, MTBF (Mean Time Between Failure) and MTTR (Mean Time Between Repair) of the unit's assets. General reports are prepared using Power BI. Automating operational routines linked to the process of planning maintenance orders for the units.Main highlights:>> I developed an automated process that resulted in a significant 85% reduction in the time needed to generate reports on the unit's assets.
  • Grupo Dunedain
    Financial Analyst
    Grupo Dunedain Nov 2017 - Feb 2019
    As a Financial Analyst, my responsibilities range from creating and applying indicators in the Pine Script language to consolidating and analyzing the results of daily operations. In addition, I manage KPIs related to Yield, Opportunity Risk, Average Operating Time, among others, seeking to automate the analysis of possible capital allocations using tools such as Excel.

Carlos Castro Education Details

Frequently Asked Questions about Carlos Castro

What company does Carlos Castro work for?

Carlos Castro works for Elogroup

What is Carlos Castro's role at the current company?

Carlos Castro's current role is Data Engineer | Databricks | Azure | AWS | PySpark | Big Data | ETL | Redesigned the data architecture using PySpark and Python to optimize performance and reduce costs by 28%..

What schools did Carlos Castro attend?

Carlos Castro attended Universidade Federal Do Ceará, Colégio Master.

Who are Carlos Castro's colleagues?

Carlos Castro's colleagues are Lucas Inocêncio, Thiago Leite De Moura E Souza, Henrique Ostmann, Felipe Freitas, Angelica Iglesias, Leonardo M., Vitória Jane Costa.

Not the Carlos Castro you were looking for?

  • Carlos Castro

    Software Engineer .Net | Asp.Net Core | Flutter | Postgresql | Sql Server
    Nova Iguaçu, Rj
  • Carlos Castro

    São Paulo, Sp
  • Carlos Castro

    Project Manager | Devops | Release Manager | Azure | Aws | Sysadmin |
    São Paulo, Sp
  • Carlos Castro

    Sales Manager Bra | Tsc Printronix Auto Id | Rfid | Labeling & Tracking Solutions | International Relations | Business Management | Trading | Family Entrepreneur |
    São Paulo, Brazil

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.