I work as a data engineering consultant, my main activity is developing data pipelines using Pyspark and SQL on the AWS stack using a wide variety of services such as AWS Glue, S3, Athena, EMR and others. I act on projects for the banking sector, on fronts such as anti-fraud processes, money laundering prevention, customer relations and loans.

I work with development of data pipelines, using a full range of tools such as Streamsets, Kafka, Hive / Impala, Hbase, python and others.I have experience in process development in batch and streaming modes.I have experience with Google Cloud architecture using services such as Cloud Functions, Data Store, Data Flow, Apache bean, Datastore and Bigquery.I worked on projects for the financial sector, on fronts such as anti-fraud processes and calculation of the rate of means of payment transactions and among other fronts.I currently work on a project for the retail sector, developing data integrations and building data marts to be consumed via dashboards.

Development of processes for extracting bases with segmentation of customers and prospects according to profile, for marketing campaigns and generating reports. Modeling and development of ETL for DBM, BI or point bases. Statistical analysis of Data Quality, to maintain information. Data consumption automation.

I acted on the development and maintenance of BI reports and dashboards, from requirements analysis to the development of processes and layouts. Development and modeling of dimensional and relational ETL.

I worked on monitoring and maintaining data replication processes between databases, data corrections (data quality), testing procedures and triggers, creating scripts and Jobs to automate processes.