Ming-Yuan Lu personal email
- Valid
Data engineer @ WSJ. Background of PhD in experimental particle astrophysics at the University of Wisconsin-Madison. Specialize in building data pipelines to help solve real-world problems.Specialities:• Programming: Python, Scala, C/C++, Bash, SQL, OpenCL• Data modeling, schema design• Distributed computing: AWS(VPC, EC2, S3, EBS, IAM, Security Group, Network ACL, Cloudwatch), Apache Spark, Apache Airflow• Data streaming: Apache Kafka, Amazon Kinesis, Amazon MSK• Databases: PostgreSQL, TimescaleDB, Apache Druid• Visualization: Matplotlib, Grafana, Seaborn• Data analysis: NumPy, Pandas, SciPy, Hypothesis Testing, Regression Analysis• Tools: RESTful API, Flask, Git, GitHub, Linux• Physics
-
Senior Data ScientistEnigma LabsNew York, Ny, Us -
Senior Data ScientistStealth Startup Jan 2022 - PresentMountain View, Wy, Us -
Data EngineerThe Wall Street Journal Aug 2020 - Jan 2022New York, Ny, Us• Worked with data analysts and scientists to define data models and analytical approaches to analyze customer data to mine actionable insights for the newsroom.• Used Spark Structured Streaming, AWS S3/Kinesis/EMR/Aurora/ECS/MSK, Kafka, and Druid to develop a cloud data ETL pipeline in Scala that collects, enriches, cleanses, and aggregates custom user-tracking data in web and mobile platforms to inform editors on content performance. The pipeline ingested over 40 million events per day and delivered insights within minutes from user clicks• Optimized PostgreSQL queries and database configurations to achieve better query performance by up to 25 times and reduce costs• Supported the provisioning of pipeline infrastructure and data APIs using Terraform• Collaborated with various teams across the organization to define and advise data strategies. Supported data QA and troubleshooting• Interfaced with product owners and project managers to facilitate the use and leveraging of corporate data in a programmatic way to drive business decisions -
Research AssistantUniversity Of Wisconsin-Madison Feb 2014 - Apr 2020Madison, Wi, UsDeveloping interferometric data analysis methods to apply to data from the Askaryan Radio Station in order to search for cosmic neutrinos. Handling physics data processing. Developing physics simulation softwares in C++. -
Teaching AssistantUniversity Of Wisconsin-Madison Sep 2013 - Jan 2014Madison, Wi, UsAssisted teaching of Physics 103, general college physics level. Lead discussion sessions and labs. -
Research AssistantUniversity Of Wisconsin-Madison Sep 2011 - Aug 2013Madison, Wi, UsDevelop trigger and filter algorithms for the Askaryan Radio Array, a neutrino telescope at the South Pole using radio detection techniques. -
Data Engineering FellowInsight Data Science Jun 2019 - Aug 2019San Francisco, Ca, Us• Built a distributed pipeline on AWS to analyze the Global Database of Events, Language, and Tone dataset. Stored analytics in TimescaleDB and presented spatial and temporal evolution of news sentiments towards user-queried social/political topics (git.io/bubblebreaker)• Used Spark to process 5.2TB of GDELT data from S3. This includes applying text-cleaning techniques for readability and calculating statistics of the most popular topics• Stored computation results with TimescaleDB. Built webapp with Grafana for visualization and easy query -
Research AssistantLeung Center For Cosmology And Particle Astrophysics Sep 2010 - Mar 2011Tested and calibrated digitizer chips for linearity and timing precision.
-
Undergraduate ResearcherNational Taiwan University May 2007 - Dec 2007Taipei, Northern Taiwan, TwUnder the Fundamental Science Education Program of Taiwan's Ministry of Education, designed and constructed a photon detector using microelectronics techniques and labView. -
Summer StudentAcademia Sinica, Taiwan Jul 2007 - Aug 2007Taipei City, Taipei City, TwResearched the star formation of protostellar system IRAS 16293-2422
Ming-Yuan Lu Skills
Ming-Yuan Lu Education Details
-
University Of Wisconsin-MadisonParticle Astrophysics -
National Taiwan UniversityPhysics
Frequently Asked Questions about Ming-Yuan Lu
What company does Ming-Yuan Lu work for?
Ming-Yuan Lu works for Enigma Labs
What is Ming-Yuan Lu's role at the current company?
Ming-Yuan Lu's current role is Senior Data Scientist.
What is Ming-Yuan Lu's email address?
Ming-Yuan Lu's email address is tu****@****ail.com
What schools did Ming-Yuan Lu attend?
Ming-Yuan Lu attended University Of Wisconsin-Madison, National Taiwan University.
What skills is Ming-Yuan Lu known for?
Ming-Yuan Lu has skills like Research, Latex, Microsoft Office, Data Analysis, C++, Physics, Python, Microsoft Excel, Astrophysics, Opencl, Linux, Unix.
Free Chrome Extension
Find emails, phones & company data instantly
Aero Online
Your AI prospecting assistant
Select data to include:
0 records × $0.02 per record
Download 750 million emails and 100 million phone numbers
Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.
Start your free trial