Data Scientist
San Francisco, California, Us
Measured map data quality through survey construction and evaluation. Devised sampling strategies based on map feature distributions and business priorities to achieve confidence and representative coverage. Analyzed human judge responses to mitigate erroneous data to ensure metric trustworthiness.Designed, launched, and analyzed multiple experiments for map data product launches. Based on internal services affected, utilized A/B and/or switchback experiment designs. Curated relevant metrics to track changes across multiple departments, e.g., ETA accuracy, fare prediction, or system latency. Coordinated with other teams during experiment design and execution to ensure other ongoing experiments were not confounded.Created and maintained dashboards to surface operator behavior during data product creation. Investigated results to identify which product creation steps were more time-intensive or error-prone, leading to the reallocation of resources and recalculation of product completion estimates.Estimated downstream business impact of granular map data improvements. Identified which business metrics could or could not be confidently attributed to the upstream changes. Developed new techniques and metrics in service of this goal that were also utilized in other projects. Additionally, identified issues in current system architectures or inter-department knowledge sharing and proposed changes for future work.