Sr Manager Devops
Philadelphia, Pa, Us
Manage DevOps teams of Software Developers, and System Administrators that created, maintain, and enhance the Datalake which includes AWS and Private Cloud. The dx Datalake (~40PB) is a Big Data multi-system, multi-tenant, on-premise and off-premise ecosystem that supports data warehousing, business intelligence and software applications, through PaaS, DaaS and SaaS services.• Software development platforms: Java and MEAN stack (Mongo, Express, Angular 2, Node), Javascript, Python, MySQL, Oracle, REST Services, Jenkins, GitHub.• Operation support software and tools: Hortonworks/Cloudera full stacks, AWS, Ansible, Docker, Kubernetes, Jira, Slack, GoCD.• Hadoop components: Kafka, Accumulo, Spark, Storm, Sqoop, Hive, MR, Tez, Impala, Hbase, Kudu, Ozone.• AWS components: Kafka and Kinesis, EMR, EC2, Glue, DataBricks, S3, Glacier, Aurora, Redshift, Lambda, CloudWatch• Created PaaS infrastructures that includes security and data governance in a hybrid (on-prem/off-prem) system to allow for seamless integration and ease of use for non-IT customers.• DevOps support for multiple critical applications including applications that earned 100s of millions of dollars by monetizing data.• Responsible for managing and supporting 2000+ physical on-prem servers in multiple data centers across the US.• Transformed a “wild-west” platform into an Enterprise platform with standards, controls and SLAs, increasing availability from 75% to 99.999%.• Developed Open-Source applications for Hadoop systems that provides operational statistics, job and user statistics, as well as application performance management for multi-cluster, multi-tenant ecosystems.• Reduced Mean Time To Repair by 40% using 4DX methodologies