Sr Big Data/Machine Learning Architect-Remote
CurrentMLOps Pipeline• Architected and implemented an MLOps framework utilizing AWS Sagemaker for scalable model training, deployment, and monitoring, leveraging Docker for containerized workflows, and enhancing model and data governance practices to significantly optimize the machine learning lifecycle.• Integrated AWS services including Service Catalog, Step Functions, CodeCommit, CodeBuild, Lambda, Amazon ECR, and Bedrock with Guardrails, enforcing governance checks and compliance, and incorporated Whylabs as a model observability platform to create a robust and reliable pipeline.Deployed Applications to AWS• Successfully deployed applications to AWS ECS and Batch Fargate, leveraging Jenkins for continuous integration and continuous deployment (CI/CD)• Designed and implemented a PDF-conversion service to convert various document formats (images, Word) to PDF, integrating AWS Textract and Comprehend for efficient extraction for relevant information• Built a crawler service to extract relevant (as per the regex rule) news articles after crawling through multiple search engines like Bing search, Wikipedia, Glassdoor, Crunchbase, Zoominfo, etc.False Event Prediction: ML Model• Developed a ML algorithm to predict True or False events from a pool of crawled articles• Employed a range of machine learning classifiers such as AdaBoost, Bagging, Gradient Boosting, RandomForest, and SVM, finely tuned with GridSearch, culminating in a robust model with an impressive 98.7% accuracy rate.