Ray Kim Email & Phone Number

Toronto, Ontario, Canada

Data Engineer in Degree and Marketing Data Engineering building a data lakehouse on AWS Databricks- Built data pipelines in Python and Spark to ingest and process Google Ads and Zoom Webinar data on Databricks for marketing and paid media insights- Automated the validation and reporting for quarterly business metrics, reducing manual effort for earnings calls and revenue reconciliation by 66%- Developed a scalable pipeline to simply enable/disable data sharing with university partners, supporting the seamless scaling of degree programs- Redesigned/optimized the student success and SEO metrics data pipelines and dashboards, achieving a 33% improvement in data latency and a 50% faster response time for Looker dashboards- Led a group of 3 data engineers in designing and implementing end-to-end degree data pipelines in Spark with dbt to migrate data from AWS Redshift to Databricks- Developed pipelines, automating the extraction and Gen AI sentiment analysis of call transcripts by converting PDFs to text in Python and processing the data in Spark, resulting in a $1.5M revenue lift for marketing

North Vancouver, British Columbia, Canada

Architecture Owner of Insurance Data and Reporting- Designed and optimized end-to-end data pipeline solutions on Hadoop, ensuring robust and efficient data flow while simplifying architecture for scalability and performance- Enhanced Spark pipelines in Scala by identifying and mitigating data skewness in complex logic, resulting in a 50%+ improvement in processing performance and efficiency- Resolved critical production issues across a diverse tech stack, including big data systems, Spark pipelines, Hadoop ecosystem, and Oracle, ensuring minimal downtime and timely resolution- Provided strategic guidance to a team of 20 engineers on data pipeline development and deployment, continuously removing roadblocks to ensure timely project delivery and successful outcomes

North Vancouver, British Columbia, Canada

Big Data Tech Lead and Architecture Owner in the BC Enhanced Care Coverage project- Developed Spark pipelines in Scala to extract and consolidate historical Insurance vs. Claims data enabling machine learning model training and testing for a new Care Coverage model- Architected the migration from mainframe to Hadoop and Operational Data Store, providing integrated solutions for Application Services and enabling the creation of advanced analytics solutions- Designed and implemented a data transfer framework in Scala using JDBC connectors to transfer data from Hadoop to RDBMS- Maintained and enhanced in-house Scala and Spark development/testing frameworks, improving pipeline development efficiency and standardization for the engineering team- Provided technical support and resolution to 15+ data engineers/consultants, addressing roadblocks and ensuring uninterrupted progress on project deliverables- Supervised solution integration and deployment during project releases, ensuring the efficient execution of deployment plans and the smooth transition of new features into production

North Vancouver, British Columbia, Canada

Data Engineer building a data warehouse on Hadoop ecosystem in multiple projects including pilots- Developed ETL data pipelines in Scala & Spark to process raw data for data science applications and generate actionable reports for operational analytics- Built a Kafka Spark streaming/batch framework to parse XML messages and ingest data into MapRDB/Parquet, used in 30+ solutions- Contributed to the development of in-house Spark frameworks, standardizing best practices for data pipeline development and automating the CI/CD process for improved efficiency- Designed and implemented an automated testing solution using Scala & Spark to validate the data ingestion process and ensure the data quality across 500+ tables- Integrated end-to-end solutions for data ingestion, Spark pipelines, and Tableau reports, managing production CI/CD, and scheduling via SVN, Jenkins, and Control-M

North Vancouver, British Columbia, Canada

ETL Developer and Business Intelligence Developer in the Corporate Data Warehouse (CDW) decommissioning project- Designed DataStage ETL jobs to successfully migrate monthly data solutions from Oracle CDW to IBM EDW- Translated complex PL/SQL, SAP, and Cube reports into DB2 SQL, replicating solutions and reports to ensure consistent business intelligence capabilities across platforms.- Automated data validation using DataStage jobs, ensuring the successful migration and integrity of hundreds of tables- Developed and enhanced 10+ Tableau reports for the Accounting and Finance departments, improving report design for better readability and usability.- Led Tableau training sessions for 20+ business users, enabling them to effectively use Tableau for data visualization and reporting.- Managed the deployment of Tableau reports

Experimental Robotics Laboratory - Burnaby, Canada

Robotics R&D Assistant under Dr. Shahram Payandeh building a remote-controlled cloud robotics for elderly people- Designed the robot for given requirements and researched suitable hardware components based on mechanical and robotics engineering fundamentals- Tested the hardware components of the robot with Python to collect dynamics metrics of the components to implement the hardware-control codes.- Designed and developed a web application to remote-control the robot in HTML/CSS/JavaScript and integrated the web with the hardware-control codes- Integrated the web application with Node.js and Apache to send/receive commands between the web and robot and to host the application over networks- Added bidirectional video and audio communication system between the user and robot using WebRTC and monitoring system showing the robot's state and metrics- Documented a user manual describing how to use the robot and technical manual describing the end-to-end development process for maintenance