• Developed a comprehensive web scraping pipeline using Beautiful Soup and Selenium to extract reviews and discussions from medical forums, Reddit, review sites, and news articles, improving data collection efficiencydiscussions from medical forums, Reddit, review sites, and news articles.• Designed and implemented a robust data pipeline in MongoDB for collecting, cleaning, and storing scraped data, ensuring data integrity and accessibility• Utilized LLMs and open-source models for Named Entity Recognition (NER) to identify domain-specific entities, and conducted sentiment analysis at both sentence and aspect levels using Hugging Face, enhancing data analysis accuracy• Created dynamic PowerBI dashboards to transform raw data into actionable business intelligence insights, facilitating data-driven decision-making

- Established a WebSocket connection to receive data, parsed JSON messages, and triggered listeners based on unique identifiers.- Developed a React component to integrate real-time data updates with a WebSocket server, enhancing data visualization for the team