Data engineer with nearly 2 year of experience in SQL, Python, data warehouse. Proven experience in data modeling and SQL, data integration as well as data pipeline building. An enthusiastic thinker who enjoys identifying and solving problems, both in technical and non-technical, with logical and creative approaches also passionate in learning new technologies and finding productive ways to achieve goals.
-
Data EngineerTouch 'N Go Group Jul 2023 - Jul 2024Kuala Lumpur, Federal Territory Of Kuala Lumpur, MalaysiaFraud Detection (Neo4j)-Designed a tailored graph model that suits the fraud detection use case.-Configured Neo4j on remote instances, optimizing performance and enhancing security.-Built an incremental data pipeline that is running daily to load the base data from DataWorks into Neo4j using Pyspark.Reshaping and Reorganizing Cloud Data Warehouse -Implemented a standardized naming convention for tables in the cloud data warehouse.-Developed and documented Standard Operating Procedures (SOP) for naming conventions to ensure consistency and ease of dataretrieval.-Collaborated with cross-functional teams to plan and execute seamless table migrations.-Improved overall system performance and streamlined data access by strategically relocating tables. Reconciliation and Settlement Report-Developed SQL queries for ingesting data from diverse sources such as Kafka and MySQL, aligning with QA requirements.-Created shell scripts to export data to Alibaba Cloud OSS, ensuring seamless data flow.-Scheduled and automated the data pipeline, enhancing efficiency with regular execution and error handling mechanisms. Data Governance & Security-Designed and developed an interactive dashboard to monitor the company’s employees for not having excessive permissions on DataWorks thus preventing data leakage by not allowing them to query sensitive tables.-Implemented Label-based Access Control (LBAC) on Alibaba Cloud to enhance the security of sensitive data within the company's databases.-Configured and applied labels to specific columns containing sensitive information, ensuring a fine-grained access control mechanism. -
Data Engineer InternPpg Sep 2022 - Jul 2023Selangor, Malaysia-Developed a data pipeline to load source data including history data from FTP server to ADLS storage using Azure Data Factory.-Cleaned up the FTP server by increased its capacity up to 50% thus enabling the server to store more source data from the data provider.- Monitored and managed multiple data pipelines, ensuring data accuracy and stability.- Optimized an existing data pipeline by reducing the Copy Activity in Azure Data Factory from 40 into 1 activity to reuse the functionalities with dynamic parameters.- Reduced the weight of the existing data pipeline, making it more dynamic and which can lower the cost.
Alvin Hee Jun Sheung Education Details
-
Computer Science -
Smk Seri RaubScience Stream
Frequently Asked Questions about Alvin Hee Jun Sheung
What is Alvin Hee Jun Sheung's role at the current company?
Alvin Hee Jun Sheung's current role is Data Engineer.
What schools did Alvin Hee Jun Sheung attend?
Alvin Hee Jun Sheung attended Universiti Teknologi Malaysia, Smk Seri Raub.
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial