Oscar Lopez Martinez Email & Phone Number

Dublín, Dublín, Irlanda

* Engineering of data pipelines that feed the Data Lake from different internal and external sources* Contributed to create a collaborative transformation layer where Business Analyst can manage the logic that drives each pipeline* Created and fine tuned of Spark jobs, including AWS EMR and Glue, SQL queries (Spark SQL and Redshift), Scala and Python code, using functional programming approach* Worked on the Data API that allows clients to run data extracts for the datasets they are assigned to* Creation of a service that runs many queries in parallel using AWS Batch. Performs data quality checks, encrypts the files and uploads them to SFTPTechnologiesAWS EMR, AWS Glue, AWS S3, AWS DynamoDB, Airflow, dbt, AWS Redshift, AWS Lambda, AWS Cloudwatch, Terraform, Python, Scala, AWS Neptune, AWS Opensearch, AWS Batch, Docker, AWS Secret Manager, AWS CodeBuild, Jenkins, AWS Quicksight

Dublín, Dublín, Irlanda

* Design, depelopment and roll out of in-house ETL and Data Quality frameworks. It uses Scala, Java 11, Spark, Hive, Kafka, Akka, Maven, Jenkins, Artifactory, Ansible, JUnit, Scalatest, Scalacheck, Mockito* Provide tuning and performance reviews on Spark jobs, Hive queries and data distribution* Develop different libraries based on Scala, Spark, Python, PySpark, Hive, Kafka, Neo4j, ArangoDB among others. Used Docker, Kubernetes and Openshift to host some of them* Extract and analyze data lineage using Spark, Graph modelling, ArangoDB and Python networkX* Use Machine Learning to apply Data Quality checks as data arrives

Dublin

* Creating and maintaining a Data Warehouse based on Python and Netezza. * Kimball based architecture including different SCD types* Worked on unit testing on Python ETL using unitest and mock modules* Design a graph database for taxonomy and ontology of the resources using ArangoDB, Neo4j and Linkurious among others

Ireland

• Design and Develop new functionalities of the existing datawarehouse, based on Kimball. Tools used are SSIS, SSRS, SQL Server 2012 and Tableau 8.1.• Migration of the existing TFS 2010 source code repository into TFS 2013. We also use Team Builds to run the Unit Test Framework on the Continuous Integration strategy. • Design and develop a Python platform that collects data from Twitter and save information on streaming basis into MongoDB and Neo4j. Use D3.js to represent data on streaming and on its historical evolution• Design and implement a MDM and Data Quality platform

Madrid Area, Spain

Playing different roles described as following:• Big Data Architect and Team leader for GroupM, a World leader in marketing communications. The project used Scala, Python, Hadoop, HDFS, Map/Reduce, Hive, Pig, Sqoop, MongoDB. I defined the architecture and helped on the development of data pipelines into the Data Warehouse. • Scrum Master, Country Delivery Manager and Team Leader for GroupM. This role includes responsibilities as project management, capacity planning, risk identification and mitigation and technology solution review. The project goal is to gather information from different datasources on several EMEA locations using Microsoft SQL Server 2012 BI stack products and TFS 2010.

Madrid Area, Spain

Working on several projects and customers, with the following key responsibilities: • Project management and achievement of BI user needs, including Marketing, Finance, IT, Selling, and Purchasing departments. • Management of a skilled development team, distributed over different places. • Analysis, design and development of Datawarehouses and Datamarts for our clients. • Design and development of Dashboards and Balanced Scorecard, providing our customers a platform to perform analysis and trends on Business Processes like Revenue, Expenses, Supply-Chain, Orders, Service, General Ledger Balance, making business decisions more effective.

Madrid Area, Spain

Designed and built a reliable and scalable management solution to USG People Spain. I was in charge of the team and made the analysis, design and development of the main management app for their business.