I am a Big Data Engineer with a Master of Engineering degree from Cornell University and a Bachelor of Science degree from Western University, specializing in Computer Science and Mathematics. I have over two years of experience working at RBC, one of the largest banks in Canada, where I applied my skills in Spark, Hadoop, Hive, Machine Learning, Data Mining, Elasticsearch, Ni-Fi, OpenShift Container Platform, and Docker to various projects and initiatives.At RBC, I worked with a team of data engineers, analysts, and scientists to build and maintain scalable and secure data pipelines, platforms, and applications for the Fraud IT department. I contributed to the development of Elasticsearch Python and Java clients, Kafka Python and Java clients, Ni-Fi clusters, Elasticsearch curator, and Scala parsing component, among others. I also supported the migration of data and applications to the cloud using OpenShift and Docker. I am passionate about solving complex data problems and delivering innovative solutions that enhance the customer experience and the business value. I am eager to join an organization that values data-driven decision-making, collaboration, and continuous learning.
-
Software DeveloperAmazon Web Services (Aws) Nov 2024 - PresentSeattle, Wa, Us -
Cloud Support Engineer - Big DataAmazon Web Services (Aws) Dec 2023 - Nov 2024Seattle, Wa, Us -
Big Data EngineerRbc Jun 2020 - Aug 2022Toronto, Ontario, Ca• Optimized Fraud Detection Systems: Architected and implemented a robust Ni-Fi Cluster data system leveraging Java, Hadoop, EKS, Kafka, and Hive, enhancing support for 7+ machine learning-based fraud detection projects and monitoring over 5 million transactions across 30+ types; achieved a 30% increase in capacity and score accuracy while decreasing processing speed by 30%. • Storage and Cost Efficiency: Engineered a storage compression job using Scala and Spark, resulting in a 90% reduction in Hadoop storage by consolidating JSON, ORC, and Parquet files; saved 50 TB of space monthly and cut down machine learning model training times by 30%, with the solution shared across teams via a Docker image. • System Upgradation and Integration: Led the upgrade of the Hadoop Eco System to Cloudera Data Platform (version 2.6.5 to 3.3.0) for all Fraud IT projects; seamlessly integrated the existing HDP environment with AWS S3 buckets and Dataiku, enhancing system resilience, efficiency, and contributing to a significant reduction in storage costs. • SQL Optimization and Data Retrieval: Resolved a myriad of SQL issues for the Data Science Team, fine-tuning queries and enhancing data retrieval speeds in the Hive environment, thereby improving the efficiency and effectiveness of data analysis processes. • Cloud Migration and System Resilience: Spearheaded the rewrite of jobs to migrate terabytes of data daily, supporting cloud migration and bolstering system resilience for all Fraud IT projects; utilized tools including OpenShift Container Platform, Docker, Jenkins, IBM Urban Code Deployment, and Helios, and ensured smooth operations by resolving production environment issues in Hadoop, Hive, Spark, NiFi, Ambari, and Elasticsearch. -
Technical System Analyst --- Fraud ItRbc Sep 2018 - Aug 2019Toronto, Ontario, Ca• Fraud Detection Support: Actively supported fraud detection applications by vigilantly monitoring daily financial transactions across 20+ transaction types, utilizing a diverse set of techniques including machine learning, big data, streaming technology, Hadoop, Elasticsearch, Kafka, and Hive SQL to ensure system integrity and accuracy.• Data Stream Pipeline Establishment: Effectively established secure and efficient data stream pipelines using Apache NiFi clusters, ensuring seamless authentication with Kerberos across Development, QA, and Production environments, thereby enhancing data flow and system reliability.• Processing Time Optimization: Developed and implemented a parsing component in Scala, achieving a substantial reduction in processing time from 1 second to 0.40 milliseconds per transaction, which significantly enhanced the throughput and responsiveness of the fraud detection system.• Machine Learning Model Support: Enabled advanced querying and aggregation capabilities in Elasticsearch, facilitating the feature training of machine learning models using Python and Java, thereby contributing to the continual improvement and accuracy of fraud detection mechanisms. -
Software Developer InternOcean Nursery Ltd. Jun 2018 - Sep 2018• E-commerce Website Development: Contributed to the development of the e-commerce platform songsco.com, enhancing its capabilities to efficiently sell landscaping services and a diverse assortment of plants to online demographics, resulting in a streamlined user experience and expanded market reach.• API and Database Creation: Engineered a robust online data center (API) and database using Java, React, MySQL, and Spring MVC framework, ensuring seamless data management and retrieval capabilities that enhanced the efficiency and responsiveness of the website.• Internal Management Website Development: Designed and implemented an internal management website featuring employer login, daily check-in, printing services, and forum services, thereby centralizing administrative tasks and fostering effective communication within the organization.
-
Full-Stack Developer InternE-King Technology May 2016 - Sep 2016• Investment Management Platform Development: Developed and implemented a comprehensive web application platform at a subsidiary company of Hainan Airlines, a Fortune 500 entity, enabling efficient management of investments, profit and interest calculations, money transfers, and data management, utilizing technologies such as MySQL, PHP5, Laravel Framework, and Apache httpd.• Linux Environment Configuration and Research: Conducted extensive research on Linux systems and successfully set up a robust environment for PHP, MySQL, and Httpd, ensuring a seamless and efficient development process for web applications.• Codebase Maintenance and Debugging: Diligently maintained the codebase and swiftly implemented bug fixes, contributing to the stability and reliability of the developed applications and ensuring continuous and smooth operations
Jiarui(Jordan) Yang Education Details
-
Cornell UniversityMaster Of Engineering - Meng -
Western UniversitySpecialization In Computer Science And Minor In Mathmatics -
University Of Toronto MississaugaMath And Statistics
Frequently Asked Questions about Jiarui(Jordan) Yang
What company does Jiarui(Jordan) Yang work for?
Jiarui(Jordan) Yang works for Amazon Web Services (Aws)
What is Jiarui(Jordan) Yang's role at the current company?
Jiarui(Jordan) Yang's current role is Software Developer @ AWS.
What schools did Jiarui(Jordan) Yang attend?
Jiarui(Jordan) Yang attended Cornell University, Western University, University Of Toronto Mississauga.
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial