Senior Devops Engineer
CurrentArchitecting, deploying and managing federated Kubernetes clusters for asset wealth investment applications with 60~80 billion dollar worth application analytics data using VPCs, multiple AZs, Public and Private Subnets, Security Groups, ELB, Route 53, WAF Shield.Monitoring and managing data storage within Snowflake, including data loading, transformation, and extraction processes as well as implementing data retention policies and managing data lifecycle within the platform.Designing and implementing scalable ETL pipelines, data workflows and data models to integrate various data sources, using tools such as Apache Airflow, dbt and AWS services with Docker.Maintaining and upgrading Jenkins and Argo workflow pipelines for sustained scalability and robustness, with a marked decrease in failure rates, assisting other data teams with data migration, architecting and deployment for nightly data migration with scaling using Glue, Redshift, BigQuery, Aurora, DBT, CloudWatch, Splunk, EKS.Developing and managing Ansible Playbooks, roles, group variables and inventory files for server configuration.Manage provisioning of AWS infrastructures using Terraform/Ansible. Design infrastructure for high availability and business continuity using self-healing-based auto scaling architectures.Designing and implementing a CI/CD pipeline for a Kubernetes-based microservices architecture, reducing deployment time by 50% and increasing overall system reliability by 30%.Developing microservice on board tools leveraging Python and Jenkins allowing for easy creation and maintenance of build jobs Kubernetes deploy and services.Management and administration of AWS services CLI, EC2, VPC, S3, ELB Glacier, Route 53, Cloudtrail and IAM.