• As the first Data Engineer hired for the Brazil office, established organizational goals and processes, including leading the hiring efforts for the team• On the Business Intelligence team, focused on extracting and analyzing Sigma's metrics, creating a metadata/administration portal utilizing technologies such as Airflow, Jupyter Notebook, Snowflake, and Sigma API integration• The portal served as the foundation for various initiatives, including an automated process to archive unused dashboards, cost reduction actions, and identification of deprecated tables to address inaccuracies in dashboard data• Collaborated with high-cost processing teams to optimize queries and reports, resulting in an average 35% reduction in costs

• Extensive experience delivering customized data processing solutions for a diverse range of large and small organizations• Expertise in data extraction from various sources, including databases, internal/external APIs, and CSV files• Proficient in data transformation leveraging technologies such as Spark, Python algorithms, DBT, Lambda functions, and Airbyte• Skilled in processing and cleansing data in data lakes, implementing the bronze/silver/gold layers approach, utilizing Parquet files, AWS Athena, and AWS Glue• Successfully executed projects involving real-time data processing using messaging systems like Kafka and Azure Data Hub, as well as change data capture (CDC) techniques• Actively contributed to the hiring process, conducting technical interviews and developing tests and questions to identify and onboard talented data engineers• Served as a mentor, providing guidance and leadership to train and empower junior data engineers in their professional development

Leader, Data EngineeringAlice (employee #43)• Spearheaded the development of robust data pipelines utilizing Airflow and DBT, empowering the organization with efficient data processing and analytics• Implemented visualization tools, such as Metabase and Looker, to enable data-driven decision-making across the company• Played a pivotal role in ensuring data privacy and compliance with HIPAA regulations, while optimizing the AWS architecture for enhanced scalability and performance• Provided valuable user and project support, enabling teams to effectively leverage data for operational and strategic purposes• Contributed to the early adoption and subsequent customization of the data science infrastructure, including the initial SageMaker-based environment and a more tailored solution"

Proficient in managing real estate transaction databases and optimizing data science pipelines. Skilled in employing advanced techniques such as Optical Character Recognition (OCR), PDF processing, and data extraction to organize and enhance database accuracy.Developed a Slack bot integrated with Elasticsearch to enable efficient retrieval of real estate transactions, even with challenging address formats.Accomplished in streamlining data pipelines within Databricks, resolving memory bottlenecks, and establishing Python/Flask endpoints for machine learning model services. The project also required the implementation of various data processing techniques, including OCR, PDF processing, and the extraction of free-text information using regular expressions, machine learning models, and conditional random fields.

"Data Availability Specialist (prior to merger with Grin)• Responsible for ensuring seamless data access across diverse teams• Successfully addressed challenges, including real-time replication of non-SQL databases (AWS DynamoDB) to a PostgreSQL database with read-only replicas, while utilizing Metabase as the primary visualization tool• Defined a comprehensive data catalog and conducted calculations of essential business intelligence metrics such as Churn, EBITDA, and Trips per day• Provided training and user support to traineesStreet Intelligence Squad Lead (post-merger with Grin)• Led the development of various geospatial visualizations using a Kepler.gl-based tool• Optimized different aspects of operations, including efficient deployment of scooters in the morning, redistribution throughout the day, identification of high-risk regions, and strategic opening of new parking points"

As the Lead Data Engineer at BelugaDB, I spearheaded the management of a 20-machine Spark cluster, facilitating the efficient processing and movement of approximately 3 terabytes of data per day from relational data sources such as MySQL and MS SQL Server. I implemented data un-normalization techniques and seamlessly stored the transformed data into Elasticsearch for enhanced search capabilities. Additionally, I played a pivotal role in collaborating with data science teams, providing valuable support in deploying their models into production environments.

Extension courses on the Apache ecosystem (Hadoop 2, Hive, HBase, Spark, Zookeeper) and Data Warehouse

During my fixed-term contract, I excelled in developing microservices dedicated to machine learning models focused on natural language processing and chatbots. I demonstrated proficiency in data preparation, cleaning, and training to optimize machine learning models' performance. Additionally, I efficiently managed the acquisition and formatting of large text databases for seamless integration into natural language models.

As a valued member of the Big Data and Data Science team, I actively contributed to enhancing SEO metrics and customer retention. My primary focus was on developing recommendation systems to optimize web navigation, enhance user experience, and drive targeted direct marketing initiatives. Through my contributions, I played a crucial role in improving overall business outcomes and ensuring a seamless customer journey.

Working as Data Scientist and full stack developer.

Create and implement solutions in data analysis, data mining and big data problems for YouFind clients. Search and understand new technologies in data science and big data, like Hadoop, Spark, HBase, Amazon ERM, etc.

• Responsible for several projects focused on improving ETL pipelines and reporting, primarily based on Microsoft SQL Server• Key focus areas included: Data analysis, such as customer classification and clustering, up-selling and cross-selling campaigns, Market Basket analysis, time series analysis for revenue (utilizing ARIMA and other autoregression models), product evaluations, A/B test results, and general statistical analyses

ETL, metrics/KPI creation, dashboards, data cubes and reports using Pentaho and Cognos, working with big companies (Telefonica, Maritima Seguros, TVA e Grupo Wizard). Data exchange with mainframes using XML. Installing Pentaho and Postgres in Mac Servers for BI portal to deliver complete solutions. Data marts and data warehouse modeling, using agile methodology to deliver weepy new metrics and informations.

Migration from old Cobol ERP to Delphi with MS-SQL Server. Requirement analyst and database modeling. Later, implementing new IT solutions, and communication with a second subsidiary. Interfacing with a automated elevator system (mini-loader) for checkout logistics.

Support to internal services, Solaris and Linux development in shell script, Java and Perl. Sybase and Oracle databases, SQL and Stored Procedures.

Business Intelligence integration project using Pentaho (Open BI), Java Swing and JSF Development.

ERP Devepment using Delphi and MS SQL Server.

Desenvolver todas as atividades relativas a empresa