Jamie Liu

Jamie Liu Email and Phone Number

Software Architect @ Shenzhen Pingan Bank Co., Ltd.
shenzhen, guangdong, china
Jamie Liu's Location
Shanghai, China, China
About Jamie Liu

Familiar with kubernetes components, building kubernetes platform for AI model training and inference. Familiar with distributed storage system, such as Etcd, Ceph, GlusterFS and Ganesha NAS.Familiar with Linux system, Python, C, Shell, and tools such as ansible and git. Familiar with X86 storage server and automation test, including integration, performance and stability test. Open source enthusiast, contribute to open vStorage, ceph, secondary development of kubernetes, hyperledger.Contact info: ljshoot@hotmail.com

Jamie Liu's Current Company Details
Shenzhen Pingan Bank Co., Ltd.

Shenzhen Pingan Bank Co., Ltd.

View
Software Architect
shenzhen, guangdong, china
Employees:
17
Jamie Liu Work Experience Details
  • Shenzhen Pingan Bank Co., Ltd.
    Ai Platform Architect
    Shenzhen Pingan Bank Co., Ltd. Jan 2018 - Present
    Shanghai City, China
    1. Kubernetes AI platform for offline trainingRun ML frameworks like TensorFlow, PyTorch, pySpark with jupyter notebook in docker container, retrieve training data from S3 object storage, get CSV file from Hadoop platform, manage training task with kubernetes job. Support Spark on kubernetes, horovod distributed training framework and volcano job scheduling.2. Kubernetes AI platform for online inferenceUse S3 object storage as model repository, deploy AI models with tfserving and torchserve model server, support multi-model serving, dynamic model loading and unloading and live model update.Build a common model inference platform with kfserving, serving ML frameworks like Tensorflow, PyTorch, PMML and ONNX. Support istio traffic management, blue-green deployment and canary release.3. GPU management and virtualizationManage GPU as a resource pool within kubernetes cluster, and allocate GPU resource according to the GPU utilization. Hook CUDA driver API to isolate device memory and switch CUDA context for GPU virtualization. Share GPU among all nodes of the cluster by rCUDA (Remote CUDA).4. Blockchain BAAS platform based on KubernetesBuilt a Hyperledger fabric blockchain verification platform, and developed a blockchain service gateway for channel and chaincode operations. It was used for immutable ledger storage scenarios such as asset certification and labor wage payment.
  • Wanda Cloud Company
    Technical Lead
    Wanda Cloud Company Jun 2016 - Jan 2018
    Shanghai City, China
    1. Ceph object storage for massive small files and Persistent Volume provisioningTune Ceph configuration to improve performance, cosbench stress test showed the IOPS was increased by nearly 2 times. It had stably carried more than one billion small pictures, and the daily increment was nearly 5 million. RBD random write 4k block IOPS increased by nearly 40%. Located the cephfs kernel client performance issue during synchronous IO. Dynamic volume provisioning for kubernetes allowed ceph RBD and glusterfs volumes to be created on-demand.2. Real-time log analysis with pySpark streamingCollected container json-file logs with fluentd and pushed to kafka for consumption. Logs were pushed into elasticsearch for query, and analyzed by spark streaming to generate statistics such as QPS and latency, which written into redis for real-time alarm.
  • Iqiyi.Com
    Staff Software Engineer
    Iqiyi.Com Dec 2014 - Jun 2016
    Shanghai City, China
    1. Open vStorage converged storage for Virtual MachinesOpen vStorage, similar to VMware vSAN, was a grid storage router. It turned Swift object into block storage, SSD cache was used to ensure the read and write performance. As the key contributor, responsible for porting the code to Centos 7 and supporting systemd manager. Tuned performance and found out the bottleneck during md5 hash dedup, avoided the issue by taking dedup for os image volume and non-dedup for data volume.2. High-performance NAS storage system based on glusterfs and ganeshaGlusterfs as the backend storage and ganesha as the NAS server, built high-availability NAS service through LVS and keepalived load balance. Implemented Rest API management interface with python flask. Solved performance issue, located NFS client hang problem caused by LVS TCP long connection.
  • Emc
    Senior System Integration Engineer
    Emc Feb 2012 - Dec 2014
    Shanghai
    1. Storage server integration testSystem Verification: Define test requirement, verify the integration of server modules such as BMC, BIOS, POST, etc. Run automation testing to verify storage platform performance and reliability, analyze System Event Log, locate system hardware and firmware issues. Access backend storage array via iSCSI HBA and run end-to-end test, measure the IOPS and throughput of the VNX storage platform.2. Develop server storage diagnostic systemNetwork Diagnostic: review HW design spec and release plan, define test requirement, write user space device driver for traffic test, solve the problem of random packet loss on the Management Module Control Stations.Secondary development of Vendor API: write Vendor API specification, verify and integrate vendor API library into EMC diagnostic system. Locate issues found during integration and performance testing, and work closely with Vendor to reproduce and resolve issues.ODM Project: implement traffic test based on linux socket, performance test with iperf, debug with wireshark.
  • Ericsson
    Software Engineer
    Ericsson Mar 2010 - Feb 2012
    Shanghai
    1. Ethernet Driver Development: Based on P4080 communications processors with data path, configure Data Path Acceleration Architecture HW, write 1G and 10G Ethernet driver, support 8 OS clients to handle traffic independently by hypervisor mechanism, and work as a virtual Switch.2. Multi-site teamwork: team members are from USA, Sweden and Australia,run the project in agile model, which deeply improves the communication and team work skills.
  • Creative Labs
    Software Engineer
    Creative Labs Mar 2008 - Mar 2010
    Singapore
    1. Desktop Daemon: Handle D-Bus method call request from other processes,monitor udev system events, broadcast event to registered applications when system configuration changes.2. Applet Framework Design: Make applet as a Dynamic Link Library, design the applet framework based on MVC design pattern, implement system configuration applet.
  • Siemens
    Intern
    Siemens 2006 - 2007
    西门子中国研究院

Jamie Liu Education Details

Frequently Asked Questions about Jamie Liu

What company does Jamie Liu work for?

Jamie Liu works for Shenzhen Pingan Bank Co., Ltd.

What is Jamie Liu's role at the current company?

Jamie Liu's current role is Software Architect.

What schools did Jamie Liu attend?

Jamie Liu attended East China University Of Science And Technology.

Not the Jamie Liu you were looking for?

  • Jamie Liu

    Back To The Marketing World, Still Love Community
    Hangzhou
  • Jamie Liu

    Chinese Supplier | Annual Export Value Of Us $12 Million |13 Years Of Excellent Production Experience | Customized Home Storage Solutions | Certified Quality Products |Bsci, Fsc, Iso9001, Sedex, Sqp, Wca
    Shanghai, China
  • Jamie Liu

    Rsm At Texas Instruments
    Beijing, China
    5
    stericsson.com, ti.com, ti.com, ti.com, ti.com

    3 +121447XXXXX

  • Jamie Liu

    It Headhunter
    Hangzhou

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.