Proficient in utilizing Scrapy and Selenium for web scraping, as well as a strong background in data pipeline orchestration using Python Flask. Hands-on experience in designing and implementing scalable data extraction and transformation processes. Skilled in containerization with Docker for efficient deployment and maintenance of data engineering solutions.Proficient in designing/deploying/maintaining Q&A bots with custom RAG(retrieval augmented generation) implementation using open-source embedding models for vector search.Experienced in Microsoft Azure infrastructure deployments.Building expertise in AWS EC2, leveraging cloud infrastructure to optimize data storage and processing.