Software Engineer
CurrentResearched replacement of existing Oracle RDMS and HP Autonomy IDOL with Storm, Hadoop, Spark and Cassandra, HBase, Hive and Pig. Technical proof of concept components created. Designed and implemented ETL application using Oracle 11g, PL/SQL packages, procedures, functions, Advance Queuing, Scheduler, UTL_HTTP, Java stored procedures, and HP Autonomy. The ETL system on average routed, processed and analyzed over two million social media messages a day.Responsible for ensuring all data collected from Kapow robots and other collection agents flowed through ETL and into analytic systems.Responsible for ensuring all system changes were interoperable with ETL and other system components.Assisted with design and implementation of earlier version of ETL application using Java, Apache ActiveMQ, MySQL, Hibernate, and Content Analyst.Assisted with design and implementation of reporting and administration dashboard using PHP, jQuery, and Oracle SQL for Analysis and Reporting functions. Implementation of the dashboard reduced data configuration and processing errors by 80% as well identification and resolution of problems from weeks to hours.Supported the design and implementation of another dashboard application using ExtJS, ColdFusion, and MySQL. The dashboard gave insight into collections, ETL and analytics health for the first time in the history of the program. SQL tuning, maintenance, and mentoring.Assisted with the design and implementation of RFID passport reader/writer using Windows Mobile 5 and .Net compact framework. Assisted with re-architecture, re-design and implementation of legacy application using C# and SQL Server. The resulting user interface simplified and standardized workflows in addition to increased worker productivity. The updated architecture reduced O&M costs by 60%.