Peter Lee Email & Phone Number

台灣 臺北市

In data team, I am responsible for building up data infrastructures and designing pipelines.Data engineer:1. AWS services. 2. Airflow migration from 1.0 to 2.X (Amazon Managed Workflows for Apache Airflow).3. EMR.4. PostgreSQL.5. Load Balancer + log service design.DevOps: 1. Terraform (Terragrunt).2. Ansible.3. Flux CD.4. K8s.Due to the team downsize and layoff, I also take the of DevOps role in 2022.In Feb 2023, Snapask layoff all… Show more In data team, I am responsible for building up data infrastructures and designing pipelines.Data engineer:1. AWS services. 2. Airflow migration from 1.0 to 2.X (Amazon Managed Workflows for Apache Airflow).3. EMR.4. PostgreSQL.5. Load Balancer + log service design.DevOps: 1. Terraform (Terragrunt).2. Ansible.3. Flux CD.4. K8s.Due to the team downsize and layoff, I also take the of DevOps role in 2022.In Feb 2023, Snapask layoff all engineer in the company. Show less

Taipei City, Taiwan

Taipei

In data team, I am responsible for building up data infrastructures and designing pipelines. I have huge passion for learning new knowledge and sharing with members. In addition, I am expert in optimizing the performance of a system by introducing new technology.Data Collection and Exchange:1. Design different algorithms and pipelines for automatic data exchange with business partners.2. Design the backend system for data collection of Data SDK. The system reduces the time… Show more In data team, I am responsible for building up data infrastructures and designing pipelines. I have huge passion for learning new knowledge and sharing with members. In addition, I am expert in optimizing the performance of a system by introducing new technology.Data Collection and Exchange:1. Design different algorithms and pipelines for automatic data exchange with business partners.2. Design the backend system for data collection of Data SDK. The system reduces the time to update data from a day to an hour and achieves a cost reduction of 40% for ETL machines.3. Deploy Elastic Stack to validate and visualize data from each new client in real time.Data Architecture1. Introduce the Kubernetes Engine to automate the process of deployment and monitoring, significantly reducing the cost by 75% and the personnel expenses by 20 hours.2. Provide advices about architecture design as well as deployment of Kubernetes with Istio, Cloud Function, Apache Airflow, Compute Engine, Serverless service and so on.Data Application1. Build up a platform for highly customized tagging services. The platform gives each individual ID different kinds of tags such as personal interests, language, age, and gender and reports the tagging rate of each tag.2. Optimize the pipeline of data update to directly generate files and reports and achieve a personnel expense reduction from 2 weeks to less than 1 hours.Continuous Integration and Deployment1. Design the complete CI/CD pipeline including building Docker images, deploying to Container Registry, 2-hours deploying images on the Kubernetes cluster, and deploying images on application environment after conducting unit tests.Data MigrationMigrate existing projects and the ETL pipeline from AWS to GCP. Transfer data from Hive and S3 to GCP. Set up a Gitlab server in GCP. Build up ETL pipelines for effective and efficient data migration, which is very important for team members to access the latest data on GCP. Show less

Taipei City, Taiwan

PDIS is a high-level government organization in Taiwan. PDIS is also Ministry of Digital Affairs: Audrey Tang’s office. Our goal is to incubate and facilitate public digital innovation for the government(Like 18F in the United States). For example We design a guide for government data exchange API, we also fix some unreasonable flow and law. Our systems were based on open source project. Besides, we want the people to collaborate with the government. We connect the communication with people… Show more PDIS is a high-level government organization in Taiwan. PDIS is also Ministry of Digital Affairs: Audrey Tang’s office. Our goal is to incubate and facilitate public digital innovation for the government(Like 18F in the United States). For example We design a guide for government data exchange API, we also fix some unreasonable flow and law. Our systems were based on open source project. Besides, we want the people to collaborate with the government. We connect the communication with people. PDIS helped the government’s conference for streaming online, the citizen can share their opinion anytime and anywhere. After we collected the citizen comment, based on this information. We will collaborate with other government departments, then we improve the government system. Let the citizen can make our government better. In PDIS, I developed many projects. For example the Line Bot, this bot integrated with the internal calendar system. It provides our member important information. We can start a job in Bot, these jobs will fire in our cloud. For integrating with the government system, I designed an API service. This service provides data to the reservation system and Electronic Billboard. All of these services were deployed in our cloud. I also involved in other open source projects. Like Sandstorm cloud and Rocket.Chat, I was a contributor to these projects. For open government meeting, I developed a package to display a subtitle in real-time streaming. Without needed any commercial software, all of the services we use open source project. I also want to bring a new feature like a real-time face labeling system. So, I involved to Google Tensorflow and I also contributed it. These changes were accepted from the community. I also share the experience in NVIDIA forum and Github. You can find more information in my cv and websites. Show less

Taiwan

Project:SDK Developement, Geofence, App Development

Master'S Degree, Computer Science

Master'S Degree, Computer Science

Bachelor Of Engineering (B.E.), Computer Science