Principal Data Engineer
Current- Designed the Compassion Outcomes Framework (COF) , a DSL-driven technology integration platform for Monitoring & Evaluation and Program Effectiveness research. Like a "SQL of outcomes or KPIs", COF provides users with declarative YAML syntax that configures XLSForm survey generators, scalable data pipelines, integrations with data tools like ODK, Kobotoolbox, SurveyCTO, QuestionPro and Qualtrics and Translation platforms like Tolgee. COF has over 9,000 commits (most users previously did not have Git experience) with over 4,000 variables managing hundreds of surveys in dozens of countries, enabling longitudinal research via variants across contexts and demographic strata.- Designed the Compassion Data Model (CDM), which leverages code generators and JSON schemas to apply a logical abstracted model across a wide variety of data fabric technologies. Data modelers generate Pulsar function event mappers at the same time they generate Snowflake data warehouse views, applying data governance (like role based access and classification) from a single source of truth. CDM models are flattened for SQL, are nested JSON for APIs, and leverage open source technology to generate code models for languages like Go, Java, Python and TypeScript.