Sergio Valencia Email & Phone Number

Málaga, Al, Es

- Developed Spark processing using Scala via Maven and Databricks for business intelligence and reporting processes.- Designed analytical solutions through ETL processes, making use of different technologies such as relational databases, Hadoop file system, CosmosDB, Azure Datalake, SQL Server and Host files.- Implemented solutions on Azure data factory to orchestrate multiple transformations processes from multiple sources and automate data pipelines.- Responsible for the upkeep of data training models, aimed at customer characterization and classification through Spark to drive the creation of insightful analyses and strategic business models.

- Developed solutions on Python (pyspark ) for business intelligence and reporting processes at Avianca, optimizing these processes on Databricks for efficient data processing.-Orchestrated the creation of data-driven workflows using Azure Data Factory and Azure Synapse Analytics components, ensuring timely execution of periodic tasks.-Designed and implemented analytics solutions employing ETL processes, integrating various technologies including data warehouses, data lakes, delta tables, and relational databases for streamlined consumption and reporting.

- Implemented solutions and applications developed in IIB in the midleware stage.- Deployed and created Back-End REST applications using Node and Java for different clients in the banking induystry such as Banco Popular, Grupo Aval and Banco Davivienda.-Implemented Python appplications to automate file comparison to enhance the efficiency of monitoring multiple logs, ensuring the health of environments by detecting discrepancies and errors more effectively. - Developed and implemented ETLs for the recollection of data from the clients to analytic tools using SQL and Java.

-Implemented solutions and applications developed in IIB in the midleware stage.-Employed Python solutions for automating file comparison, thereby optimizing the monitoring of multiple logs. This approach significantly bolstered our ability to detect discrepancies and errors, thereby ensuring the robustness of our environments.