Big Data Engineer position. I have a bachelor's degree in computer engineering and over three years of experience as a big data engineer and also two years as a software engineer. I am passionate about solving complex problems across a full spectrum of technologies using big data tools and frameworks.Current responsible for developing and maintaining data pipelines using ETL processes. I used Scala, Spark, and Hive to gather, store, process, and analyze large datasets from multiple sources. I also collaborated with the business team to implement their data analyst pipelines requests. I helped define data governance policies and support data-versioning processes. I also maintain the current pipeline in production.Some of my achievements include:- Developing a Hadoop system that improved the performance and scalability of the company's big data infrastructure- Implementing a streaming framework using Kafka that allowed real-time data ingestion and processing from various sourcesstrong understanding of distributed systems, data warehousing. I have experience with SQL and RDBMS databases such as Redis and Microsoft SQL and Sybase as well. I have knowledge of Core Java, Linux, SQL, and Bash scripting. I also have good interpersonal skills and a positive attitude. I enjoy working in a team environment and learning new technologies.
-
Natixis In PortugalVila Nova De Gaia, Pt -
Data EngineerVolkswagen Digital Solutions Jul 2024 - PresentPorto, Portugal -
Big Data EngineerNatixis In Portugal Oct 2017 - Nov 2024Porto, PortugalDesigned and developed ETL processes to integrate data from various front systems into a data warehouse, serving as the main source for risk analysis platformsTroubleshot and resolved Spark issues and improved data processing performance and efficiencyParticipated in the reserve team project to calculate the required capital reserves for contingency scenarios, meeting tight deadlines and quality standardsConducted a proof of concept for Airflow as a potential tool for workflow automation and orchestrationProof of condept on SingleStore with goal improving user data visualization -
Software DeveloperNatixis In Portugal Sep 2017 - Sep 2019Porto, PortugalMake part on an agile team, where the main goal is to improve their internalapplication for the traders, giving information of the profit and loss of the bank.Also fix bugs on a very short time to take less impact on the system which need torun 24/7 without any major error. -
Software Engineer InternCelfocus Mar 2017 - Sep 2017PortoDevelop a software tool to help Quality Assurance testers perform there test withmore accuracy, keeping track of there test, and share between those with other teamsand projects to save time on identical tests.To know more about Quality Assurance also made part of Vodafone QA on theirproject internet in the car so I could share the tool I develop and improve at the sametime the tool.
José Santos Skills
José Santos Education Details
-
Artificial Inteligence -
Computer Software Engineering
Frequently Asked Questions about José Santos
What company does José Santos work for?
José Santos works for Natixis In Portugal
What is José Santos's role at the current company?
José Santos's current role is Big Data Engineer.
What schools did José Santos attend?
José Santos attended Instituto Superior De Engenharia Do Porto, Instituto Superior De Engenharia Do Porto.
What skills is José Santos known for?
José Santos has skills like Asp.net Mvc, Webpack, Spring Security, Xml Schema, Linux, Nagios, Gruntjs, C, Jquery, Node.js, Assembly Language, Spring Mvc.
Not the José Santos you were looking for?
-
José Santos
Lisbon -
José Santos
Vila Nova De Gaia -
1glartek.com
-
José Santos
Ermesinde -
José Santos
Ovar
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial