Daniel S. Email & Phone Number

Ottawa, Canada · Remote

- Administered on-premise data model repository environment (Jedox/SQL Server).- Migration of data models and repositories from on-premise platform (Jedox/SQL Server) to new analytics platform (Domo and AWS RDS Postgres).- Developed data integration solutions using APIs to improve report updating processes for stakeholders (data analysts). - Frontend: Excel JS/React - Backend: Python (FastAPI, Pydantic, SQLAlchemy, PyDomo) - Infrastructure: AWS ECS/ECR/RDS- Engineered data integration system via SFTP using Python on AWS Lambda, RDS Postgres, and REST APIs.- Provided support to stakeholders for report updates, issue detection, and application of fixes.- Managed SaaS analytics platform (Domo) and handled various demands related to service interaction through its APIs.- Expanded expertise in Data Engineering while functioning as a software developer.

Brazil

- Migrated legacy data warehouse system to a new well-structured data lake, using the medallion architecture (layers raw, bronze, silver, and gold) with Spark as the data processing engine and persisting tables in Delta Lake format.- Orchestrated ETL pipelines using Apache Airflow and ran them on a Kubernetes cluster on the AWS cloud, ensuring data feeds the dashboards on the Tableau platform for all company users.- Collaborated with cross-functional teams to design, build, test, and maintain the company's Big Data and Advanced Analytics platform on the AWS cloud.- Developed data profiling using PySpark and created technical documentation for internal business areas and processes, incorporating factors such as technical design, data manipulation, ETL, and storage management.

Remote

- Migrated 10+ ETL built previously in Tableau Prep to data models in BigQuery using SQL (CTEs + Analytic/Window Functions + dbt) orchestrated in Apache Airflow (Cloud Composer).- Improved accuracy of internal address database by integrating geolocation services (OpenStreetMap REST API) using Cloud Functions and Python.- Drafted technical documentation for internal business areas and processes, incorporating factors such as technical design, data manipulation, ETL and storage management.

Remote

- Supported the design, building, test and maintenance of Dotz's Big Data and Advanced Analytics platform.- Developed data profiling using PySpark and PyDeequ (AWS Open Source Lib).- Built integration with SFTP servers using Python, Apache Airflow and Secret Manager.- Built pipeline to extract, cryptography and transport data inter-cloud (Azure Blob Storage/AWS S3/GCP Cloud Storage) using Python and Shell Scripting (OpenSSL).

São Paulo, Brasil

- Designed customized data collection models for specific visualization tasks, using Alteryx.- Developed intelligence-sharing dashboards using Tableau, providing company-wide access to collected data.- Responded to specific BI requests from Logistics and Trade personnel, creating data packets with requested information in easily understandable formats.- Building reverse ETL to power a service’s REST API to keep the customer informed about the delivery time of their purchase.

São Paulo, Brazil

- Migrated over 10 MS Access data flow processes to Alteryx, saving 50+ hours of manual work every month. - Developed an intuitive system for standardized data reporting in customer care.- Prototyped and later implemented a follow-up process that doubled the number of Know Your Client (KYC) and Investment Suitability form fulfillments.- Produced over 20 reports on business performance and customer satisfaction, presenting key findings to various stakeholder groups.- Worked with cross-functional teams to structure problems, identify appropriate data sources, extract data and develop integrated information delivery solutions.

São Paulo, Brasil

- Installed, configured, and managed databases in UNIX/Linux environments.- Created roles and users and managed their privileges.- Monitored and analyzed database activity to identify and prevent incidents and recommend performance improvements.- Participated in situation management of incidents to support database operations.