Principal Software Engineer
Boston, Ma, Us
Architect, team lead and/or contributor for many systems in the organizationDeveloped a robust web scraping system for collecting online video data, powering True Reach®, using Ruby, Storm, Kafka, Jetty, Vertica and MySQLContributed to the development of edge event logging and ad-serving systems using Java and JettyPrototyped and helped develop a real-time video event processing system built on Storm, Redis, Kestrel, Kafka, Vertica, HDFS, Avro, Hive and Amazon AWSDesigned a system for collecting Tweets related to online video using Ruby, Storm, Vertica and HadoopDeveloped a system for collecting data related to online advertisement placements using RubyConverted cron scheduling jobs to Azkaban workflowsPrototyped an interactive online ad experience using WebRTCDeveloped a video comparison tool using MySQL and FFmpegImplemented a sharded MySQL solution for event processing with LuaImplemented a full text search cluster for over 300 million videos using Lucene/SOLRDeveloped batch processing jobs in Java, Map/Reduce, Pig and CascalogProvided relational and columnar database expertise across many systemsHelped maintain various Ruby on Rails applications for monitoring and organizing online video dataManaged an off-shore Ruby on Rails development team