System Engineer
Current- Infrastructure and operations support role for Centers for Medicare & Medicaid Services primarily - supporting Cloudera CDH distribution of Hadoop.- Provided hardware, software, backup solutions, monitoring and security, and developer and end user support in an environment with over 2 PB of data in the Hadoop environment and 1 PB in the Teradata environment.- Core software utilized: Red Hat Enterprise Linux, LDAP, Kerberos, Ansible, Hadoop, HDFS, YARN, Spark, Hive, Hue, Impala, Kudu, Oozie, Sentry, Sqoop, Zookeeper, Jira, and Precisely DMX-h.- Provided recommendations for innovation to CMS to achieve the most from their environment, including Apache Kudu, Informatica BDM, and MySQL high availability. - Performed documentation of best practices surrounding Apache Kudu, Informatica BDM, MySQL high availability, GitLab, Red Hat Enterprise Linux 7 upgrade preparation, and CDH 6 upgrade preparation.- Supported the following efforts: expand access to Hue from a forward-facing network layer via a proxy, migration of data and reinstallation of Hadoop software in support of the Red Hat Enterprise Linux 7 upgrade, as well as a hardware refresh.- Created bash scripts for various operational duties such as backing up data for new software, copying data across environments, and creating certificates for configuration of TLS.- Other responsibilities include code promotions, executing ETL scripts in special request forms, and troubleshooting user access issues.- Gained hands on experience using Amazon Web Services for creating test environments as well as utilizing DeepRacer for machine learning exercises.- Hadoop security: LDAP integration with Hue, Cloudera Manager, Hive, and Impala, Apache Sentry, Kerberos authentication, and TLS.