Diego Oliveira Email & Phone Number

Pernambuco, Brasil

Contract: Department of health of Pernambuco - SESData architecture, star schema data modeling, big data ETL and analytics with health data: elective surgeries, exams, consultations, beds.Main resources:- Apache Airflow;- DBT;- Pentaho PDI (ETL);- SGBD(SQL): PostgreSQL, OracleSQL and SQL Server;- SQL queries;- DBeaver;- Python/Jupyter Notebook;- Power BI, Power BI Report Server, Qlik Sense;- Linux;- Git;- Draw IO;Main activities:- Use of SQL queries from relational databases: PostgreSQL, OracleSQL, SQL Server for data validation, cleansing and analytics;- Use of ETL tools: Pentaho PDI and DBT (Data Build Tool) to transform Big Data between data source, intermediate layers, data warehouse, data mart, activity automation (report/analysis extractions, e-mail);- Use of data pipeline orchestration tool: Apache Airflow (Python) to manage DAG processes and monitor process logs;- Use of visualization tools: Microsoft Power BI and Qlik Sense for the development of health (surgeries, consultations and examinations) and financial analytical reports;- Use of Python and Jupyter Notebook for data validation and automation;- Use of GIT for code versioning;- Project documentation development;

Amadora, Lisboa, Portugal

Data engineering and analytics with line fixed services.Main resources:- FlowOne/Instant Link;- Catalog Designer;- Customer Ingisht;- CSPF (Docker, K8S and Grafana);- SQL queries/Apache Hive;- Apache Hadoop, Spark and Airflow;- Python(Streamlit, Jupyter Notebook and RPA);Main activities:- Use of Apache frameworks: Spark, Hadoop and Hive for Big Data manipulation;- Use of Python/Jupyter Notebook for manipulation, cleaning and validation of telecommunications service data, and process automation to generate metrics/indicators for data analysis;- Use of open-source framework (Python/Streamlit): for the development of web system as a business analysis system;

Eusébio, Ceará, Brasil

Modeling and development of data engineering in the pharmaceuticals company to generate insights from structured data for decision making:Main resources:- Google Cloud Platform (GCP);- Cloud Scheduler;- Pub/Sub;- Cloud Function;- Cloud Storage/Bucket;- BigQuery;- PostgreSQL;- SQL queries;- Metabase Open Source;- Python/- C/C++;- ESP8266 (microcontroller);- ERP;Main activities:- Use of C language and electronic components (ESP8266 microprocessor, detectors and etc.) for the development of IOT (Internet of Things) system;- Use of GCP cloud services (Google Cloud Platform) - Cloud Scheduler, Pub/Sub; Cloud Function, Cloud Storage/Bucket, BigQuery, PostgreSQL, SQL queries, to develop the data engineering system in hospital sanitizing industry;;- Use of Python for data consumption via API (ERP and GCP) and development of exploratory analysis of hospital sanitation data.- Metabase Open Source as a business analysis tool;- Trainer in the use of systems and data acculturation in the industry.- Software Documentation and Agile Development;

Fortaleza, Ceará, Brasil

Data driven system development to provide a better assistance to children facing poverty (Child Fund) Main resources:- CVS (Child Verification System);- Microsoft Excel;- Microsoft Power BI;- PostgreSQL;- Python/Streamlit;Main activities:- Use of Python for the ETL process (deduplication, unification, aggregation, anonymization of data);- Use of Python for web scraping and activity automation;- Use of Microsoft Excel for data cleaning and analysis;- Use of Power BI for data visualization and analysis;- Use of Python, Streamlit and PostgreSQL to develop a CRUD system - (create, read, update, delete) as data entry to optimize data manipulation of children and young who are supported by the company;- Responsible for suggesting technologies, frameworks and tools for continuous technological improvements in the company;

Fortaleza

Acting in the area of ​​technology with the aim of transforming the people with social vulnerability into professional, personal and social characteristics:- Data Science: Python/Google Colab/Excel;- App Development (Programming in Blocks - App Inventor);- Database - Google Firebase Database Realtime;- Internet of things (Arduino, ESP8266 and sensors);- Hackathon - Project Development;- Design Thinking and STEAM Methodology;

Fortaleza

Customer support in Internet, IP Telephony and cable TV services:- VOIP;- DNS/TCP;- IP;- Network and subnetwork addressing;- IPV6, WLAN;- Operating System;- Network devices;

Postgraduate Degree, Network Virtualization

Activities and Societies: - Introduction to Data Networks; - Introduction to Cloud Computing; - Programming for Automation; - Operating.

Postgraduate Degree, Industry 4.0

Activities and Societies: - Production and Industry Fundamentals; - Data Science; - Artificial intelligence; - Internet of Things; - Big.

Bachelor Degree, Telecommunications Engineering

Technician Degree, Computer Network

British English, English