Jiarui(Jordan) Yang Email & Phone Number

Seattle, Wa, Us

Seattle, Wa, Us

Toronto, Ontario, Ca

• Optimized Fraud Detection Systems: Architected and implemented a robust Ni-Fi Cluster data system leveraging Java, Hadoop, EKS, Kafka, and Hive, enhancing support for 7+ machine learning-based fraud detection projects and monitoring over 5 million transactions across 30+ types; achieved a 30% increase in capacity and score accuracy while decreasing processing speed by 30%. • Storage and Cost Efficiency: Engineered a storage compression job using Scala and Spark, resulting in a 90% reduction in Hadoop storage by consolidating JSON, ORC, and Parquet files; saved 50 TB of space monthly and cut down machine learning model training times by 30%, with the solution shared across teams via a Docker image. • System Upgradation and Integration: Led the upgrade of the Hadoop Eco System to Cloudera Data Platform (version 2.6.5 to 3.3.0) for all Fraud IT projects; seamlessly integrated the existing HDP environment with AWS S3 buckets and Dataiku, enhancing system resilience, efficiency, and contributing to a significant reduction in storage costs. • SQL Optimization and Data Retrieval: Resolved a myriad of SQL issues for the Data Science Team, fine-tuning queries and enhancing data retrieval speeds in the Hive environment, thereby improving the efficiency and effectiveness of data analysis processes. • Cloud Migration and System Resilience: Spearheaded the rewrite of jobs to migrate terabytes of data daily, supporting cloud migration and bolstering system resilience for all Fraud IT projects; utilized tools including OpenShift Container Platform, Docker, Jenkins, IBM Urban Code Deployment, and Helios, and ensured smooth operations by resolving production environment issues in Hadoop, Hive, Spark, NiFi, Ambari, and Elasticsearch.

Toronto, Ontario, Ca

• Fraud Detection Support: Actively supported fraud detection applications by vigilantly monitoring daily financial transactions across 20+ transaction types, utilizing a diverse set of techniques including machine learning, big data, streaming technology, Hadoop, Elasticsearch, Kafka, and Hive SQL to ensure system integrity and accuracy.• Data Stream Pipeline Establishment: Effectively established secure and efficient data stream pipelines using Apache NiFi clusters, ensuring seamless authentication with Kerberos across Development, QA, and Production environments, thereby enhancing data flow and system reliability.• Processing Time Optimization: Developed and implemented a parsing component in Scala, achieving a substantial reduction in processing time from 1 second to 0.40 milliseconds per transaction, which significantly enhanced the throughput and responsiveness of the fraud detection system.• Machine Learning Model Support: Enabled advanced querying and aggregation capabilities in Elasticsearch, facilitating the feature training of machine learning models using Python and Java, thereby contributing to the continual improvement and accuracy of fraud detection mechanisms.

• E-commerce Website Development: Contributed to the development of the e-commerce platform songsco.com, enhancing its capabilities to efficiently sell landscaping services and a diverse assortment of plants to online demographics, resulting in a streamlined user experience and expanded market reach.• API and Database Creation: Engineered a robust online data center (API) and database using Java, React, MySQL, and Spring MVC framework, ensuring seamless data management and retrieval capabilities that enhanced the efficiency and responsiveness of the website.• Internal Management Website Development: Designed and implemented an internal management website featuring employer login, daily check-in, printing services, and forum services, thereby centralizing administrative tasks and fostering effective communication within the organization.

• Investment Management Platform Development: Developed and implemented a comprehensive web application platform at a subsidiary company of Hainan Airlines, a Fortune 500 entity, enabling efficient management of investments, profit and interest calculations, money transfers, and data management, utilizing technologies such as MySQL, PHP5, Laravel Framework, and Apache httpd.• Linux Environment Configuration and Research: Conducted extensive research on Linux systems and successfully set up a robust environment for PHP, MySQL, and Httpd, ensuring a seamless and efficient development process for web applications.• Codebase Maintenance and Debugging: Diligently maintained the codebase and swiftly implemented bug fixes, contributing to the stability and reliability of the developed applications and ensuring continuous and smooth operations

Master Of Engineering - Meng

Bachelor Of Science - Bs, Specialization In Computer Science And Minor In Mathmatics

Bachelor Of Science - Bs, Computer Science, Math And Statistics