• Designed and developed a full billing system used for aggregate all the customers’ cost on our platform.• Responsible for the development and maintenance of an internal distributed object storage system like amazon s3 (100PB) and currently working on designing and developing a new neo storage backend, inspired by Facebook's F4, capable of storing EB-level data at around 15% lower cost than the original version.• Led the development of a file system around the object storage infrastructure, designed to be compatible with POSIX and provide write caching (based on Fuse), along with providing massive small file aggregation indexing, similar to Haystack (Facebook). This system stores and indexes billions of small files to support data supply for AI training, improving the efficiency of expensive hardware utilization during LLM training.• Managed the construction of an internal unified data center, responsible for data governance, and designed and developed an auto-scaling P2P data supply service to enhance the efficiency of data cleaning ETL.• Conducted research on DirectIO and IOUring and successfully applied them to internal storage services, doubling I/O read-write bandwidth.• During the internship at MEGVII, customized and delivered a private version of the platform (including object storage) for over 40 microservices to clients (CI/CD, Operator, Helm, Bazel, dockerize).
赵文杰 Education Details
-
北京科技大学Infomation Security
Frequently Asked Questions about 赵文杰
What company does 赵文杰 work for?
赵文杰 works for 字节跳动
What is 赵文杰's role at the current company?
赵文杰's current role is 软件开发工程师.
What schools did 赵文杰 attend?
赵文杰 attended 北京科技大学.
Who are 赵文杰's colleagues?
赵文杰's colleagues are Rakesh Shan Rajan, Binyue Liu, Bo Liu, 王璐瑶, Yang Xu, Jasmine Si Yen Shan, Dan (Emily) Luo.
Not the 赵文杰 you were looking for?
-
Wenjie Zhao
Application Specialist | Insides Sales, Aftermarket-Solution, Technical SupportVancouver, Bc
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial