Consulting on the design and implementation of databases using PostgreSQL and Timescale for high-frequency time series data for data engineering.

Developing data ingestion pipelines and architecture for automated engineering workflows to provide actionable intelligence for petroleum operators. As Principal PostgreSQL DBA architected on-prem and managed AWS RDS PostgreSQL database clusters. Supported successful SOC2/ISO27001 audit and certification. Implemented a TimescaleDB extension for high-frequency (150k events/second) ingestion of well events.

As a Solutions Architect in the Data and Machine Learning Managed Services department, I design, implement and provide support to meet the needs that companies have to process their data to satisfy their business questions. phData specializes in Big Data solutions, where Big Data is defined as data that is too large, too complex or arrives too quickly to be processed by a single computer, database or data warehouse. I have more than six years of experience architecting solutions using the Hadoop software suite to manage and process Big Data for companies large and small.

As a Principal Consultant focused on the Hadoop Ecosystem I provide solutions that meet our client's BigData processing needs. Some examples of projects that I completed this year include:1. The evaluation and implementation of Envelope, a tool from Cloudera Engineering that consists of pre-developed Spark Streaming code segments and a framework that runs a graph of steps specified by a JSON control file. Envelope was evaluated for a benefits management company that needed a replacement ingestion tool for their production Hadoop processing cluster, and the evaluation showed that Envelope could be used to develop ETL pipelines that met their SLA requirements2. Implementation of Hortonworks Cloudbreak for a telecom that wanted to operate a set of AWS-hosted clusters to store and process 9PB of data. Cloudbreak provides for rapid provisioning and management of clusters in the cloud (AWS, Azure, Google, OpenStack) using Ambari blueprints to specify node configuration, service daemon placement, cluster and service specifications, etc.

As a senior consultant with Avalon Consulting I provide infrastructure, architecture, design and application development consulting services in the areas of BigData, Analytics, Search and NoSQL software solutions as well as software product implementation services centered on packages such as Cloudera and Hortonworks (Hadoop Ecosystem), Lucene/Solr/ElasticSearch, MarkLogic, Mongo and others, as well as meet any other needs of Avalon Consulting's clients.As examples of the types of engagements we provide, my last two projects of 2016 included:1. A performance tuning project for a multi-tenant Hadoop cluster operator that wished to validate for their customers that their clusters were performing at peak throughput. I ran a suite of benchmarks on one of their typical clusters and provided some configuration changes to provide minor enhancements. Then, I examined a number of client Hive queries and recommended rewrites to improve performance, since the current Hive cost-based optimizer is not as robust as the equivalent optimizer in RDBMSs (Oracle, MySQl, PostgreSQL) and many Hive users do not educate themselves in how to optimize their queries.2. A Hadoop Administration project for the third largest U.S. telecom to install and configure a new DataLake consisting of four secure clusters: DEV, CI, PROD, and DR, develop the operational procedures for code development, code test, production implementation and disaster recovery, and training of new administrators (from RDBMS DBAs). This has been an extremely interesting project, since the telecom is completely new to Hadoop, and must modify their existing Enterprise standards for the Hadoop DataLake environment.Working at Avalon has given me exposure to cutting edge technologies through their partnerships with Hortonworks and Cloudera, allowing me to work with technologies like Kudu, Impala, Kite, Hortonworks DataFlow, and ES-Hadoop.

As a Cloud Software Developer in the Intelligent Automation for Cloud (IAC) development team, I worked to develop RESTful APIs in Python for middleware between the client GUI and the managed data center components (cloud) managed by Cisco's IAC product. I worked to implement the OpenStack Barbican secure keystore for storage and management of credentials the client needs to access cloud components.

As a Field Engineer for EMC/Pivotal, I installed installed and configured several data appliances with the PIvotal Hadoop Distribution and the Greenplum Distributed Database for customers in the Aerospace/Commercial Lending vertical.

As a Client Services Engineer, I develop python-based ZenPacks to extend the Zenoss Enterprise monitoring/management product to match Clients' unique configurations and needs. I am specializing in the development of ZenPacks for the Hadoop ecosystem, including specific distributions such as MapR and Pivotal/Greenplum, as client's needs dictate. As a former DBA, I have an interest in running databases and data warehouse on Hadoop, including HBase, Hive, Accumulo and Dynamo, as well as using Cascading to allow the development of Map-Reduce in languages like Scala (Scalding) and Clojure (Cascalog).

Responsible for the development and maintenance of HP Reputation Digital Vaccine (RepDV). The HP RepDV database uses IPv4, IPv6 and Domain Name System (DNS) security intelligence feeds from multiple sources to provide uploads into the HP TippingPoint Intrusion Prevention System (IPS) or Security Management System (SMS) appliances for active network protection.

I have developed designs for Hadoop/Big Data clusters using Xeon 5500 and E5-2600 processors and either 10GB ethernet or Infinni-band connections. I built a test cluster using CentOS and the Cloudera manager package to install Hadoop, HBase, Zookeeper, Hue, Oozie and MR and Yarn. I added the ganglia package for monitoring each node and Hadoop internals and Sqoop and Flume for loading hdfs. I am also working with Rexster and Neo4J for graph analysis of social media, and using Spring for a Neo4J front end.

I provide Tier 3 support for VMware Virtualization to Army and Military Health System users worldwide in the AD Support Section/System Operations Group/Sustainment Division of the US Army Medical Information Technology Center (USAMITC) at Ft. Sam Houston, TX. USAMITC provides IT architecture and support for US Medical Information Systems around the world. I am responsible for safely and securely virtualizing Tier-1 Microsoft applications (2008 SP2/R2, AD, SharePoint, Exchange) and multiple security packages (Retina, McAfee, SSL, PK-I) in multiple data centers around the world. I ensure that the fail-over architecture relationships for Primary and DR sites work correctly.Because computers and computing is one of my hobbies (besides modeling airplanes, orchids, bonsai, jazz and classical and blues, movies, novels, and ... and ...) I learn by teaching myself new languages, applications and systems at home in my spare time. Currently I am learning jQuery and Node.js, creating generative art with Processing, relearning Database Admin with a Geolocation Database on Postrgres and PostGIS, and transitioning to PowerShell v. 3 on Windows 8 Server Beta.