Data Scientist Principle
Worked in an engineering team working on data logger devices on electric busses and trucks. Worked to adapt existing telemetry logger data pipeline architecture to use Python Spark and Databricks Delta Table architecture and notebooks instead of on-site servers. Helped plan and execute code migrations, converted code for cloud migration including database migration of existing telemetry database, and was produced code notebooks with analysis, documentation, and charts to provide insights from live streaming data received from truck telemetry loggers in the field. Worked to plan, develop, test, and validate new data pipelines and dashboards as opportunities for analysis came up.Worked with team to provide data and analysis as needed with the goal that users become comfortable enough to get their own data as needed from the provided data pipelines and dashboards. Wrote documentation and code notebooks with in-line markdown documentation sometimes as "demo" notebooks to make it clear what the analysis was with runnable code snippets to verify function and purpose.Wrote code notebooks with full explanations of methods and data to encourage discussion, provide clear explanations, and facilitate repeatable research through providing live code to test and verify.