Allan Gadelha Email & Phone Number

Aracaju, Se, Br

I work as a Data Engineer allocated to an international client, focusing on building a Datalake.Contributions:- Contributed to technical and functional documentation, detailing project stages and solutions for issues encountered during the environment setup.- Utilized Git, following best practices for version control to ensure code integrity.- Developed Python scripts to access AWS Glue and perform data transformations using PySpark and SQL. Validated job results through AWS Athena.- Used Jenkins to build branches created in Azure, allowing for an isolated DAG to be created for testing the developed jobs. These DAGs are executed using EMR clusters. In case of failures, I performed debugging using logs from Airflow and AWS EMR.Technologies Used:- Microsoft Azure- Azure DevOps- Git- Python- PySpark- SQL- Jenkins- AWS- AWS Glue- AWS Athena- Airflow- Terraform

Controle de AtivosContribuí para a criação de um Relatório de Controle de Ativos da empresa no Power BI.Contribuições:- Realizei requisições da Graph API no Power BI para coletar os dados necessários para o relatório, utilizando as versões beta e v1.0 da API.- Documentei o projeto, detalhando o processo de requisição da API, a criação da aplicação no Azure Active Directory e os passos para realizar requisições no Power BI. Incluí etapas de solução de problemas para erros encontrados e possíveis questões futuras devido ao uso da versão beta.- Contribuí para a criação inicial do modelo semântico, configurando a estrutura básica e a modelagem de dados.- Contribuí para a criação dos gráficos iniciais para responder às perguntas-chave.Tecnologias Utilizadas:-Git-Azure DevOps-Azure Data Factory-Graph API-Power BI

Currently, I am responsible for Bichinhos Academy, where I am working on structuring and organizing the teaching and mentoring processes for the community.Contributions:- Organizing the structure of the Academy, including the creation of roadmaps for various technological areas.- Coordinating senior volunteers who are willing and validated to teach classes and organizing the process for these classes to take place.- Developing the leveling process to ensure that members are ready to join the Squads.- Developing a feedback system for teachers, helping them continuously improve their classes.- Developing a mentoring system so that students can ask questions related to the available classes and other various topics.

I assumed the position of Leader of the Data Squad, where I acted as both Leader and Technical Leader, helping members with questions and project development.Contributions:- Organized bi-weekly sessions where I selected datasets for members to work on, providing continuous support and culminating in presentations of the results obtained.- Assisted members with questions in Git, programming, statistics, and Machine Learning.- Was always available to answer questions, often helping members outside the community with technical issues, whether for work or personal projects.- Mentored new members, providing technical guidance and constant support.Technologies Used:- Python- Git- GitHub- PyTorch- TensorFlow- Matplotlib- Polars- Pandas- Numpy

I assumed the position of Leader of the Data Engineering Squad, where I acted as both Leader and Technical Leader:Contributions:- Designed and implemented a Bot for Discord using Python to automate the collection of public information from members.- Mentored and guided the team in the creation of the Bot.Technologies Used:- Python- Git- GitHub

Contributions:Development of Data Pipeline:- Designed and implemented an ETL data pipeline using data from Google Analytics and the Google Analytics API.- This process involved extracting, transforming, and loading (ETL) data from Google Analytics.- Automated the process using GitHub Actions, facilitating development and deployment.Creation of Educational Content:- Developed classes and data-related content for the organization’s students.- Enabled students to effectively understand and apply data concepts.Development of Automated Dashboard:- Currently working on creating an automated dashboard using Streamlit.- This dashboard will integrate the data processed by the data pipeline, providing an interactive and up-to-date visualization of the insights obtained.Technologies Used:- Python- Pandas- Streamlit- Git- GitHub- GitHub Actions

Weather Data Scraping:British Client. The project involved extracting weather data from 350 locations provided by the client. In the initial delivery to the client, I obtained data from 321 of the provided locations. After receiving confirmation from the client, I significantly expanded the dataset.- Expanded the dataset from 321 to 3,833 locations, representing an increase of over 1000%.Technologies Used:- Python- Selenium- BeautifulSoup- LoggingCosmile Europe Data Scraping:The project entailed extracting all data from the Cosmile Europe website, which advertised around 30,000 entries for different cosmetic ingredients.- Extracted data for 14,848 ingredients. Due to the website's structure, additional web scraping processes were required on other sites to obtain more keywords for use on the Cosmile Europe site.- I initiated this project to enhance my web scraping skills, even without receiving client feedback, and decided to pause progress due to this.Technologies Used:- Python- Selenium- Requests-HTML- Pandas- LoggingData Migration:Brazilian Client. The project involved migrating data from the client's legacy system to a new management system. I developed a pipeline for the ETL (Extraction, Transformation, and Loading) process of the files.- Created a pipeline to perform ETL of legacy data, involving extraction, transformation, and loading of data into the new system.Technologies Used:- Python- Pandas- OpenpyxlKeywords Web Scraping:Brazilian Client. The project involved collecting the frequency of specific words in works by various authors. I developed a script to parse all available documents and identify the specified keywords.-Developed a script to analyze document content and extract specified keywords.Technologies Used:- Python- Glob- PyPDF2- Regular Expressions (Regex)

Aracaju, Sergipe, Brasil

I worked with data from medical exams conducted by HUSE (University Hospital of Sergipe) over a span of 4 years, with a focus on preventing overbooking.During the scholarship, I utilized the Python programming language, along with Pandas and Torch tools. Unfortunately, I had to cancel the scholarship prematurely due to health reasons.

Translation and Proofreading of Documents, Texts, and Videos

Aracaju, Sergipe, Brasil

I worked on Pollution Routing Problems (PRP) using a metaheuristic search strategy. Programming languages such as Python and R, along with libraries like NumPy and Pandas, were employed in this project.The activities of the scholarship were focused on finding the shortest distances between 'n' points, taking into consideration variables such as weight, distance, fuel consumption, vehicle speed, costs, maintenance, overall condition of a road network, among others.

Fortaleza, Ceará, Brasil

I worked with a team where the focus was to analyze, clean, and organize data related to the Systems and Digital Media course with the intention of discovering potential reasons and causes for student attrition. During the scholarship, programming languages like Java and JavaScript were used, and JSON was also employed.

Bachelor Degree, Applied And Computational Mathematics

Bachelor Degree, Systems And Digital Media

Incompleto, troca de curso para outra Universidade.