Eduardo Lovera Hirano Email & Phone Number

Welcome to my profile! 👋I am a data engineer skilled in transforming raw data into meaningful results, and here is how I can assist you in achieving your data goals:- Cloud Computing: hands-on experience with various AWS services, including DynamoDB, S3, RDS, Glue, Athena, Kinesis Firehose/Stream, SQS, SNS, Lambda, Step-functions, EC2, ECS, ECR, and Redshift.- Spark: professional experience with fine tunning Apache Spark pipelines for big data processing and analytics for one of the biggest banks in Latin America. One of these contributions reduced the workflow from 10h to the 1h mark required in the SLA by significantly reducing the amount of data scanned (partitions, filters and selecting the right columns) and by reducing the data shuffling through out the application. Another one of my contributions helped reducing a the construction of a graph data structure from an execution time of 20h to 20 minutes by understanding the bottlenecks of the application (pandas) and applying the right tools (GraphFrames - Spark).- Event-driven and serverless solutions specialist: hands-on experience in developing pipelines in the Kappa architecture by leveraging AWS tools integration.- Data Warehouse, Data Lake, Data Mesh, Data Lakehouse: Knowledge designing and implementing the right data solution that will bring the most value by facilitating data access and discovery.- Elasticsearch / Opensearch: Expertise in leveraging Elasticsearch and Opensearch for efficient search and analytics capabilities.- Work experience building ETL and ELT data pipelines using Python, addressing complex IO and CPU-bound problems.- Apache Airflow: Proficient in developing and monitoring Airflow pipelines.- Infrastructure as Code: Skilled in IaC with Terraform and AWS CloudFormation to efficiently provision and manage cloud resources.- Snowflake: Knowledge of the Snowflake platform for scalable and performant data warehousing.- Extensive working experience in RDBMS (PostgreSQL, MySQL) and SQL querying, manipulating, and extracting insights from data.- Highly experienced in working with NoSQL databases, handling unstructured data at scale.- Git - Github, Gitlab and azureDevOps.- Docker containers for ECS.- Linux.- Full-stack Development: Adonis.js, Next.js (Typescript), React, API, ORM- Power BI/Excel: Power BI and Excel for data analysis - increased client anual revennue in 16% = R$ 4 MiIf you seek a dedicated data engineer with a strong technical background, let's connect!

• 

  Universidade Tecnológica Federal Do Paraná