Abin Joseph Email & Phone Number

Kottayam, Kl, In

Chennai, Tamil Nadu, India

Chennai, Tamil Nadu, India

Leading the efforts and the team to implement & enhance MLOps solution on the client environment.Scaled the MLOps platform for 30+ Data scientists/developers, batch inferencing billions of records per day & secured all points enforcing authentication, network security.Implemented end-to-end monitoring & alerting using Grafana Prometheus Loki Jaegar stack.Implemented FinOps practices on AWS and EKS leveraging Kubecost and Vantage which reduced the cost of the platform by 30%.

Chennai, Tamil Nadu, India

Automated ML pipeline for pricing recommendation engine using Metaflow and AWS Batch & EC2 Spot, to reduce the operational cost by 60%. Scaled to solution and reduced the runtime from 100+ hours to 8 hours. Implemented fault tolernece, data security using capabilites from AWS Batch, S3 & IAM roles.Developed proprietery MLOps platform for the inhouse DS team using open source tools and AWS EKS. Leveraged Spark on Kubernetes for data processing, Jupyterhub for IDE, Neptune.AI for model… Show more Automated ML pipeline for pricing recommendation engine using Metaflow and AWS Batch & EC2 Spot, to reduce the operational cost by 60%. Scaled to solution and reduced the runtime from 100+ hours to 8 hours. Implemented fault tolernece, data security using capabilites from AWS Batch, S3 & IAM roles.Developed proprietery MLOps platform for the inhouse DS team using open source tools and AWS EKS. Leveraged Spark on Kubernetes for data processing, Jupyterhub for IDE, Neptune.AI for model registry and experiment tracking, Jenkins for CICD, Airflow for ML pipelines & scheduling, Seldon core for model serving.Implemented custom log aggregation solution using Kinesis and Lambda to resolve the limitations around Metaflow monitoring Show less

Bengaluru Area, India

Designed and developed scalable ETL pipelines in AWS using Python, Docker and S3 following microservices architecture.Developed end to end data pipeline testing framework with Python and pandas for regression & integration testing which reduced the testing effort from 2 weeks to 3 days.Worked on Data warehouse solutions built on Hadoop, PySpark and Redshift.Developed serverless application for flat file ingestion from Sharepoint & MS Teams.Automated infrastructure provisioning… Show more Designed and developed scalable ETL pipelines in AWS using Python, Docker and S3 following microservices architecture.Developed end to end data pipeline testing framework with Python and pandas for regression & integration testing which reduced the testing effort from 2 weeks to 3 days.Worked on Data warehouse solutions built on Hadoop, PySpark and Redshift.Developed serverless application for flat file ingestion from Sharepoint & MS Teams.Automated infrastructure provisioning through IaC tools Terraform and CloudFormation (CDK).Implemented datapipeline monitoring solution using CloudWatch and Simple Notification Service (SNS).Developed automated CI/CD pipelines for enterprise applications using aws-deployment-framework. Show less