Daniel Bigelow Email & Phone Number

Data Quality/Resiliency: • Implemented and designed data pipeline auditing and automated failure recovery systems, reducing on-call incidents from 6 per month to 1 per year. • Identified and reduced single points of failure in the data processing architecture. • Designed data systems to enforce separation between various stakeholders’ sensitive data.Infrastructure Design/Management: • Designed and maintained an 80-node Hadoop/Hive cluster, used for batch data processing. • Developed a streaming data pipeline using Kafka and a 56-node PostgreSQL cluster. • Managed data team assets in the company AWS account, reducing S3 storage costs by 20%. • Re-engineered EC2-based data processing pipeline to use Lambda, reducing average latency from 5 minutes to 2 seconds and dramatically reducing downtime and costs. • Built and maintained a custom data processing management engine in Python, responsible for coordinating between data processing pipelines built on a variety of technology stacks.Cross-team Collaboration: • Collaborated with product team to design more efficient data formats and ingestion strategies. • Gave presentations to sales and marketing team to make our data processing capabilities easy to understand and market to new customers. • Collaborated with analytics team to develop custom Java plugins for our ETL suite, allowing them greater flexibility in data analysis.Data Analytics • Developed interactive dashboards and alerting systems, driving company engagement with data and providing real-time business intelligence insights. • Used Python and PostGIS to develop dashboards for geographic analysis, creating reports for sales and marketing teams to provide insights on how customers’ usage varies by region.

Developed high-level intent recognition using actor diffusion networks, performed research in distributed multi-agent control, adapted existing intent recognition system to work in parallel, to allow real-time intent recognition for crowded environments, gave presentations on robotics and artificial intelligence to prospective students and visiting groups from the community.

Created interface between simulated naval environment and prototype intent recognition system, assisted with various graduate research projects.

Master Of Science (Ms), Computer Science And Engineering

Bachelor Of Science (Bs), Computer Science