Big Data Developer
As a Big Data Developer Scotia Bank as client, I am responsible for developing data solutions utilizing SQL, Hadoop, and Diyotta technologies. My role involves enhancing data extraction processes from various sources and providing data solutions to different teams within the bank. Additionally, I excel at fixing SQL and Hadoop code to ensure efficient data workflows. I am also experienced in transferring files between environments using Bash and SFTP applications. Key Responsibilities: Develop innovative solutions on Hadoop and SQL platforms to optimize data extraction and integration from diverse sources. Collaborate with cross-functional teams to understand their data requirements and deliver effective solutions tailored to their needs. Identify and resolve code issues, ensuring accurate and efficient data retrieval by troubleshooting and debugging SQL and Hadoop code. Create comprehensive documentation for code, processes, and workflows to facilitate knowledge sharing and adherence to best practices. Work closely with data architects and data engineers to design and implement robust data models and efficient data pipelines. Keep up-to-date with industry trends and emerging technologies related to big data processing and analytics