Tech Leader | Big Data Specialist
Rio De Janeiro
Technical Team Leader for Big Data and Business Intelligence.Main activities: Big Data solutions architect with MIT specialization in this field.Leading the Big Data project, supporting all Big Data activities and initiatives: Migration of the current Oracle DW environment to Hortonworks (HDP 2.6) and Dell EMC Isilon.Creation of an exploratory Hadoop environment (HDFS - Dell EMC Isilon / Hadoop - Hortonworks HDP 3.1) with automatic data and metadata refresh from the production environment to leverage data discovery, data playground, and data modeling initiatives. Implementation of a reference architecture for sandbox: Greenplum DB.Implementation of a reference architecture for Fast Data: SpringXD, RabbitMQ, Flume, Kafka, NiFi, and Gemfire. Experience with MPP databases such as and Greenplum DB, Hive, and HAWQ.Integration between Oracle and Hadoop environments using Sqoop and Oracle Golden Gate. Development of dashboards and reports in Power BI, SAS Visual Analytics, and SAS Enterprise Guide. Continuous interaction with the currently served business areas of the project, supporting scope definition and requirements analysis.Interaction with the software factory responsible for solution development, monitoring the evolution of demands and other requests and activities.Definition and support to the factory in the architectural decisions of the Big Data ecosystem. Support to the internal project team in defining solution architecture for projects of small, medium, and large complexity.Main point of contact of the team responsible for modernizing Big Data environments. Support to the production team in the implementation of Big Data projects. Extensive experience in handling large volumes of data (PB).