Production Service Engineer (Big Data, Devops)
2 years: 60% grid data ops, 40% grid ops: oncall, onboarding, deployments for large, “bare metal” multi-tenant Hadoop clusters with many proxies and services: Hue, Hive, Hcat, Hbase, Storm, Oozie, Zookeeper, for internal customer base of thousands.Set up several Hue clusters and supported all Hue clusters for about a year. Hue setup components:- Validate hosts, VIPs, Cnames, SAML, provision via Chef; coordinate with Hue database servers.Spearheaded several projects such as BCP, single point of failure, deployment processes. Examples:- Rack tool identified redundancy SPOFs, such as both ANN and SBN confined to a single rack.- Optimize network usage with script to find dataset configs to find polling frequency outliers.