Ming-Yuan Lu

Ming-Yuan Lu Email and Phone Number

Senior Data Scientist @ Enigma Labs
New York, NY, US
Ming-Yuan Lu's Location
New York, New York, United States, United States
Ming-Yuan Lu's Contact Details

Ming-Yuan Lu personal email

About Ming-Yuan Lu

Data engineer @ WSJ. Background of PhD in experimental particle astrophysics at the University of Wisconsin-Madison. Specialize in building data pipelines to help solve real-world problems.Specialities:• Programming: Python, Scala, C/C++, Bash, SQL, OpenCL• Data modeling, schema design• Distributed computing: AWS(VPC, EC2, S3, EBS, IAM, Security Group, Network ACL, Cloudwatch), Apache Spark, Apache Airflow• Data streaming: Apache Kafka, Amazon Kinesis, Amazon MSK• Databases: PostgreSQL, TimescaleDB, Apache Druid• Visualization: Matplotlib, Grafana, Seaborn• Data analysis: NumPy, Pandas, SciPy, Hypothesis Testing, Regression Analysis• Tools: RESTful API, Flask, Git, GitHub, Linux• Physics

Ming-Yuan Lu's Current Company Details
Enigma Labs

Enigma Labs

View
Senior Data Scientist
New York, NY, US
Ming-Yuan Lu Work Experience Details
  • Enigma Labs
    Senior Data Scientist
    Enigma Labs
    New York, Ny, Us
  • Stealth Startup
    Senior Data Scientist
    Stealth Startup Jan 2022 - Present
    Mountain View, Wy, Us
  • The Wall Street Journal
    Data Engineer
    The Wall Street Journal Aug 2020 - Jan 2022
    New York, Ny, Us
    • Worked with data analysts and scientists to define data models and analytical approaches to analyze customer data to mine actionable insights for the newsroom.• Used Spark Structured Streaming, AWS S3/Kinesis/EMR/Aurora/ECS/MSK, Kafka, and Druid to develop a cloud data ETL pipeline in Scala that collects, enriches, cleanses, and aggregates custom user-tracking data in web and mobile platforms to inform editors on content performance. The pipeline ingested over 40 million events per day and delivered insights within minutes from user clicks• Optimized PostgreSQL queries and database configurations to achieve better query performance by up to 25 times and reduce costs• Supported the provisioning of pipeline infrastructure and data APIs using Terraform• Collaborated with various teams across the organization to define and advise data strategies. Supported data QA and troubleshooting• Interfaced with product owners and project managers to facilitate the use and leveraging of corporate data in a programmatic way to drive business decisions
  • University Of Wisconsin-Madison
    Research Assistant
    University Of Wisconsin-Madison Feb 2014 - Apr 2020
    Madison, Wi, Us
    Developing interferometric data analysis methods to apply to data from the Askaryan Radio Station in order to search for cosmic neutrinos. Handling physics data processing. Developing physics simulation softwares in C++.
  • University Of Wisconsin-Madison
    Teaching Assistant
    University Of Wisconsin-Madison Sep 2013 - Jan 2014
    Madison, Wi, Us
    Assisted teaching of Physics 103, general college physics level. Lead discussion sessions and labs.
  • University Of Wisconsin-Madison
    Research Assistant
    University Of Wisconsin-Madison Sep 2011 - Aug 2013
    Madison, Wi, Us
    Develop trigger and filter algorithms for the Askaryan Radio Array, a neutrino telescope at the South Pole using radio detection techniques.
  • Insight Data Science
    Data Engineering Fellow
    Insight Data Science Jun 2019 - Aug 2019
    San Francisco, Ca, Us
    • Built a distributed pipeline on AWS to analyze the Global Database of Events, Language, and Tone dataset. Stored analytics in TimescaleDB and presented spatial and temporal evolution of news sentiments towards user-queried social/political topics (git.io/bubblebreaker)• Used Spark to process 5.2TB of GDELT data from S3. This includes applying text-cleaning techniques for readability and calculating statistics of the most popular topics• Stored computation results with TimescaleDB. Built webapp with Grafana for visualization and easy query
  • Leung Center For Cosmology And Particle Astrophysics
    Research Assistant
    Leung Center For Cosmology And Particle Astrophysics Sep 2010 - Mar 2011
    Tested and calibrated digitizer chips for linearity and timing precision.
  • National Taiwan University
    Undergraduate Researcher
    National Taiwan University May 2007 - Dec 2007
    Taipei, Northern Taiwan, Tw
    Under the Fundamental Science Education Program of Taiwan's Ministry of Education, designed and constructed a photon detector using microelectronics techniques and labView.
  • Academia Sinica, Taiwan
    Summer Student
    Academia Sinica, Taiwan Jul 2007 - Aug 2007
    Taipei City, Taipei City, Tw
    Researched the star formation of protostellar system IRAS 16293-2422

Ming-Yuan Lu Skills

Research Latex Microsoft Office Data Analysis C++ Physics Python Microsoft Excel Astrophysics Opencl Linux Unix Science Simulations University Teaching Shell Scripting

Ming-Yuan Lu Education Details

  • University Of Wisconsin-Madison
    University Of Wisconsin-Madison
    Particle Astrophysics
  • National Taiwan University
    National Taiwan University
    Physics

Frequently Asked Questions about Ming-Yuan Lu

What company does Ming-Yuan Lu work for?

Ming-Yuan Lu works for Enigma Labs

What is Ming-Yuan Lu's role at the current company?

Ming-Yuan Lu's current role is Senior Data Scientist.

What is Ming-Yuan Lu's email address?

Ming-Yuan Lu's email address is tu****@****ail.com

What schools did Ming-Yuan Lu attend?

Ming-Yuan Lu attended University Of Wisconsin-Madison, National Taiwan University.

What skills is Ming-Yuan Lu known for?

Ming-Yuan Lu has skills like Research, Latex, Microsoft Office, Data Analysis, C++, Physics, Python, Microsoft Excel, Astrophysics, Opencl, Linux, Unix.

Free Chrome Extension

Find emails, phones & company data instantly

Find verified emails from LinkedIn profiles
Get direct phone numbers & mobile contacts
Access company data & employee information
Works directly on LinkedIn - no copy/paste needed
Get Chrome Extension - Free

Aero Online

Your AI prospecting assistant

Download 750 million emails and 100 million phone numbers

Access emails and phone numbers of over 750 million business users. Instantly download verified profiles using 20+ filters, including location, job title, company, function, and industry.