Dan Allen Email & Phone Number

Winston-Salem, Nc, Us

New York, New York, Us

Leadership & Team Building• Led data team to deliver our Data Platform, empowering applications, data ops, and analytics across various business functions.• Hired and mentored data engineers, scientists, and software engineers, building a high-functioning team.• Implemented agile project management, delivering on thousands of tickets across epics, tasks, stories and R&D spikes.• Fostered a culture of honesty, humility, hunger, and happiness, emphasizing collaboration and mutual support.Technical Expertise & Innovation• Architected and managed data platform infrastructure on open-source software deployed to Kubernetes on AWS [Data Lake (S3 + Iceberg); Lakehouse/Query Engine (Trino); Data Security/RBAC (Ranger); Operational Data (CockroachDb); Data Integration (Airbyte); Data Orchestration (Argo); Distributed Compute (Spark); Data Catalog (Data Hub); Analytic Workbench (Jupyter); BI Dashboard (Superset)].• Created our data platform to provide portfolio companies and third parties with lower-cost alternatives to high recurring cost software licenses helping startups conserve cash.• Populated our new data lake with internal and external data sources, enabling data-driven decision-making across RH Associates.• Researched and evaluated AI solutions, including Llama 3, Gemini for Business, OpenAI assistants, and ChatGPT-4o, analyzing pros and cons for security, scalability, cost, and implementation. Business Impact & Cost Savings• Automated data pipeline for portfolio financial transactions, saving $100k/year and 60 hrs/month of associate time, providing faster, more accurate data.• Deployed data platform to an operating company, saving $100k annually in license fees.• Led BIaaS project and supported data operations for an OpCo, saving over $70k.• Set up initial data stack (Fivetran, dbt Cloud, Snowflake, and Looker) to meet business needs while building our data platform infrastructure.• Interviewed engineering roles within RH and portfolio companies.

Broomfield, Co, Us

• Led data migration from on premise SQL Server to Azure SQL Managed Instance• Lowered recurring expenses for data storage by half by implementing page compression for transactional data and columnar data storage for analytic data stores while maintaining SLA• Led efforts to complete backfill of 20 years of global gridded weather data generating terabytes of data offering improved coverage, quality and new data assets for our customers• Tuned database performance for API requests to provide 10x faster SLA for key partnership • Cut data access time by 15x by encoding coordinates into location key eliminating the need for costly joins and spatial operations between temporary tables and lookup tables• Decreased latency by over 2x on calculations that delivered planting dates and other agronomic alerts to over 200k smallholder farmers throughout Africa via bulk SMS messages• Consolidated over 150 sharded databases into one database leveraging partitioned tables• Tuned and rewrote queries and indexes after cloud migration to take advantage of new feature offerings and hardware performance to speed up response time by 4x• Wrote python code to integrate satellite precipitation data and containerized the ETL using Docker which facilitated deployment for DevOps team and adoption by business operations• Administered data servers (SQL Server, Postgres, Hive, Azure SQL, Geoserver) across multiple on premise and cloud data servers configuring them to act in concert to deliver value

Broomfield, Co, Us

• Led research on new technologies (Hadoop, Hive, Spark, Presto, NoSQL, Vertica, Redshift, AWS Aurora, AWS Athena, Machine Learning, CockroachDB, Splunk and more)• Scaled up solution on a single server to Hadoop cluster cutting process time from 10 hours to 4 minutes• Created new products for commodity traders that rendered key insights based on the difference in the next two weeks weather from normal in critical commodity growing areas• Automated daily feeds of thousands of custom histograms and maps for service subscribers• Modeled 10+ years of daily crop stress every 9km in sugarcane growing areas globally and stored within ORC files for querying in AWS Athena yielding key insights for clients• Researched over 100 competitors and ranked each across multiple dimensions and identified whether we were at a competitive advantage or disadvantage• Interviewed industry experts and potential customers to gather market intelligence and inform design decisions for new products saving critical development time for engineers

Broomfield, Co, Us

• Administered the development and implementation of a DBMS for the processing, storage, manipulation of terabytes of interpolated weather data and access through a SaaS offering• Documented and inventoried all data assets in a data dictionary including details on how the data factory generates them so that the operations team has a quick resource for questions• Surveyed data assets internally and data opportunities externally, discerning what are best available data and the subsequent cost of integration and managing new assets within system

• Integrated and curated critical data sources into new business assets that are still in use today• Generated custom, proprietary data products for customers including a 30-year global long term normal gridded database delivered to one of largest agrochemical company in the world• Consulted on custom location intelligence and knowledge-based systems for clients

• Moved from decentralized MS Access databases to centralized master database managed within SQL Server allowing for single source of truth and scaling up to global grid surfaces• Administered extensive work in database setup, optimization, best practices, and capabilities• Designed and implemented the execution of daily rule- based and deterministic turf disease models to predict potential turf disease risk and expose data through web services for users

• Developed two requested plug-in modules for our core desktop software offering• Created a new desktop software package that ingested and rendered high resolution soil data• Led custom territory assignment application development, configuration, and consulting

Basel, Basel, Ch

• Built spatial data warehouse to facilitate ad hoc analysis for environmental fate scientists• Supported the selection of terrestrial ground study locations and drinking water test sites• Spearheaded innovative ways to visualize data including 3D terrain flythrough simulations• Streamlined satellite image processing to facilitate watershed delineation and classification• Created and led four GIS lab sections, a final lab and booklet for a 5-day training workshop

• Managed programs and initiatives across quality control, industrial engineering work, and incentive payroll system providing weekly visibility of production and progress on projects

• Introduced innovative new ways to record, organize and analyze data as well as reporting channels to quickly investigate and pinpoint problems, correct them and assure quality

• Performed frequency checks, time studies and methods analysis of jobs to introduce an incentive program based on labor cost that increased mill production and operator pay

Greensboro, North Carolina, Us

• Created a soil index database for the soil coverage and maintained the street centerline data

M.A., Geography With Concentration In Geographic Information Science.

B.A., Geography