Principal Staff Software Engineer
CurrentStarted inLabs initiative to improve documentation for engineers. An inLab succinctly describes how to accomplish some task. Wrote the first 5 inLabs. Reviewed inLabs contributed by engineers. Over 200 inLabs have been contributed by over 160 engineers. LinkedIn uses inLabs to improve engineering productivity.Designed a data validation system (Data Sentinel or DS) with these principles:♦ Can check data during development, testing, or production.♦ Can declaratively specify data checks (assertions) to validate data.♦ Can inspect a report to see which assertions have succeeded or failed.♦ Report can be consumed by programs in workflows to allow automatic failure handling.♦ Produce a comprehensive statistical digest of the dataset.Designed and built a complete initial version of DS that included the assertion language, a complete set of assertions, the assertion checking framework, and the statistics generation framework. DS is implemented using Apache Spark and Scala. Add UDF support, path expressions, collection assertions, date/time support, support for AI features, etc. Will be presented at ICDE 2020.Worked with the offline data infrastructure team to design, build, and support the Data Sentinel Service (DSS). Led a cross-organizational team consisting of data engineers, full-stack engineers, UI engineers, and AI engineers. Provided leadership on design, implementation, group discussions, OKRs, stand ups, etc. Launched the service in under 5 months. Over 400 datasets from multiple teams have been validated using DSS. Transitioned leadership to the data infrastructure team. Continue as overall Tech Lead for the effort across LinkedIn.Participated in Security Champions program. Completed the Stanford Advanced Computer Security Certificate program.Mentored two dozen engineers and 3 interns. Serve on senior engineering promotion committee.