Calili Dos Santos Silva

Calili Dos Santos Silva Email and Phone Number

Desenvolvedor de código aberto @ Apache Spark
Jequié, BA, BR
Calili Dos Santos Silva's Location
Jequié, Bahia, Brazil, Brazil
About Calili Dos Santos Silva

Currently a Platform Data Engineer, focusing on data governance and data catalog, aiming to create value and promote knowledge management across teams, stakeholders, and the company.- Reduction and Regularization of Analytical Tables: Reduced and regularized over 50% of the company’s analytical tables by implementing automated data cleaning and regulatory data management routines in datalake storage;- Integration with Domain Strategy: Enabled the integration of the data catalog with the company’s domain strategy through datacontracts fed by stakeholders;- Platform Product Support and Evolution: Actively involved in the support and evolution of platform solutions, including: i. continuous delivery of streaming ingestion via Kafka topics; ii. product quality analysis (Prisma, Synopsys, monitoring); iii. automation of catalog data support, ...Technical Skills:- Languages and Frameworks: Python (advanced), Node.js, ASP.NET, Machine Learning;- Big Data & Data Architecture: Airflow, Azure Cloud, Delta Lake, Spark, Time Series;- Software Engineering and Machine Learning: FastAPI, Pandas, Scikit-learn, TensorFlow, and expertise in Machine Learning;- DevOps and Automation: Shell Script, DevOps practices, continuous delivery and integration, Machine Learning lifecycle;Academic Background:- Software Developer from Trybe- Master’s in Economics and Bachelor’s in Business Administration with an MBA in Financial Management, Control, and Auditing from FGV

Calili Dos Santos Silva's Current Company Details
Apache Spark

Apache Spark

View
Desenvolvedor de código aberto
Jequié, BA, BR
Website:
apache.org
Employees:
2333
Calili Dos Santos Silva Work Experience Details
  • Apache Spark
    Desenvolvedor De Código Aberto
    Apache Spark
    Jequié, Ba, Br
  • Xp Inc.
    Platform Data Engineer Ii
    Xp Inc. Sep 2024 - Present
    São Paulo, Brasil
    Support and evolution of agendas for:- Data Catalog- Data Contracts- Data Quality - Data Monitoring- Cleaning and regulatory data management of datalake storages
  • Xp Inc.
    Data Engineer
    Xp Inc. Sep 2022 - Aug 2024
    Member of the company's Data Platform, working on:Projects:- Enabling data catalog in the Azure from scratch environment (ACR, AKS, Blob Storage, Azure Pipelines, ...)- Automation of streaming ingestion from Confluent-Apache Kafka (self service CD pipeline)- Automated monitoring of unused Power BI artifacts (ETL from Microsoft APIs with notification of artifact shareholders)- Power BI Seal (Definition and automated diagnosis of artifact to be certified)- Prototyping and implementation of automation to support the data catalog, covering common use cases (ALMAbot)- Automated routine for cleaning and managing regulatory data from datalake storagesImprovements:- Support and Evolution of the Data Catalog- Batch engine migration in Databricks workspaces, enabling integration with Datadog- Support for platform users (Airflow, Databricks, batch engine and Data Quality)- Analysis of platform products (based on Prisma, Synopsys, logs and other sources)- CD pipeline for Airflow dags migration- Evolution of monitoring of company data products- Evolution of the data teams’ quality panel- Mapping data domains via data contracts- Enabling regulatory data signaling from data contracts
  • Conexão Transportes
    Business Analyst
    Conexão Transportes Oct 2015 - Sep 2022
    Jequié, Bahia, Brazil
    Support activities in management on financial process, organizational and customer relationship processes, focusing on the efficiency and quality of the service provided by the company: - Mapping and monitoring its internal processes; - Developing technological and operational solutions in administrative routines; - Contributing to the sale and after sales in the relationship with customers and suppliers.

Calili Dos Santos Silva Education Details

Frequently Asked Questions about Calili Dos Santos Silva

What company does Calili Dos Santos Silva work for?

Calili Dos Santos Silva works for Apache Spark

What is Calili Dos Santos Silva's role at the current company?

Calili Dos Santos Silva's current role is Desenvolvedor de código aberto.

What schools did Calili Dos Santos Silva attend?

Calili Dos Santos Silva attended Trybe, Universidade Estadual De Santa Cruz, Fundação Getulio Vargas, Universidade Estadual De Santa Cruz.

Who are Calili Dos Santos Silva's colleagues?

Calili Dos Santos Silva's colleagues are Jie Wen, Dmitriy Pavlov, Dennis Hamilton, Palash Chauhan, Xun Liu, Gabe Harbs, Jia Guo.

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.