Senior Data Engineer
Current• Python, SQL, TensorFlow, scikit-learn, Pandas • AWS (Glue, Redshift, S3), Apache Spark, Apache Hadoop, Apache Kafka • Docker, Git • ETL, Big Data, Machine Learning• Equivalent Job Titles: Data Engineer, Data Scientist, Machine Learning Engineer, Big Data Engineer, Cloud Data Engineer.--Henrique played a role in modernizing data handling and analysis for a prominent U.S.-based tech company, transforming their data infrastructure into a more scalable, cloud-based solution. He led the architecture and development of data pipelines and storage solutions, enhancing data accessibility and processing capabilities.His work involved designing and implementing ETL processes, utilizing Python and SQL for data transformation and manipulation. He deployed these solutions on AWS, leveraging services like AWS Glue, Redshift, and S3 for optimized data storage and retrieval. Henrique also utilized Apache Spark for data processing, ensuring high performance and scalability.He integrated machine learning models into the data pipeline, using TensorFlow and scikit-learn for predictive analytics and insights generation. This approach allowed for more accurate forecasting and decision-making based on real-time data analysis.Henrique's knowledge of big data technologies like Apache Hadoop and Kafka enabled the handling of large-scale data streams and efficient data processing. He also ensured data quality and integrity through rigorous testing and validation processes.By utilizing Docker for containerization and Kubernetes for orchestration, he streamlined the deployment and scalability of data services. His approach to data engineering contributed to the company's ability to harness its data, driving strategic business decisions and growth.