As a data engineer and software developer, I’ve led impactful projects using Python, Selenium, BeautifulSoup, and various APIs. Key projects include:MARA Data Scraper: Automated data collection from the Migration Agents Registration Authority (MARA) website using Python, Selenium, and BeautifulSoup, ensuring accurate and structured data retrieval.CFI Course Downloader: Developed a script with Selenium and PyAutoGUI to automate video downloads from corporatefinanceinstitute.com, integrating IDM for efficient retrieval.Turtle Ontology Syntax Generator: Created a tool to convert large files into smaller ones, integrating OpenAI's GPT-4 API to generate and consolidate Turtle Syntax from user inputs.Alibaba & AliExpress Scraper: Built scrapers to extract product data from Alibaba and AliExpress, enhancing descriptions with the OpenAI API and saving results in CSV files, while utilizing proxies to prevent blocks.Indeed Job Data Pipeline: Designed a pipeline to scrape job postings from Indeed, enrich data with Crunchbase and Google Maps API, and store it in an SQLite database. Integrated with a Flask API for user queries and CSV outputs.Dark Pattern Detection: Developed a tool to identify manipulative design techniques on booking websites using Python, Selenium, BeautifulSoup, and OpenAI. Presented findings through a FastAPI application on Amazon EC2.Movie Quiz System: Transformed a JSON movie quiz file into an SQLite3 database, integrating a CSV of over 10,000 movie records. Developed a Flask API to generate quizzes and retrieve movie data based on genres, subgenres, and plot types, hosted on an Amazon EC2 machine.These projects highlight my expertise in leveraging advanced technologies to streamline data workflows, enhance user experiences, and solve complex problems.

- Google Maps APIs Data scraping- Google Maps Web Scrapper- Auto Contact Form Submitter- Email Scrapper

Data Scraping: Data scraping related to e-commerce, yellow pages, social media, and google maps. Data Processing: APIs, Excel, CSV, XML, JSON, and MYSQL Data Automation using python programming and its libraries. Web Automation: I have done forms automation, social media automation, and product listing automation using python selenium.

Develop multiple automated solutions for server end (Bash Scripting, Python Scripting, Google drive API, smtp, cronjob).Data Automation (MYSQL, Workbench, Pandas).Data Analysis (Pandas, Numpy, Jupyter Notebook).Data Processing (pandas, excel, csv, xml, Json, MYSQL, txt).Business Reporting Automation (SMTP, Pandas, Json, Gmail API, MYSQL, scheduling)API Automation (Requests, HTTP, MYSQL, openpyxl, pandas).Develop multiple browser automation scripts using python selenium framework.

Web Browser Automation (Selenium Webdriver)Data Processing (Pandas, Numpy, Jupyter Notebook, CSV, XML, JSON, EXCEL, TXT, MYSQL)Data Conversion (CSV, XML, JSON, EXCEL, TXT, MYSQL)API Response Processing (Requests, urllib3, JSON, XML, FTP, SFTP)System Automations (Task Automation, Files Automation, Backup Automation)

In my internship period I have done a web crawler using python and requests, openpyxl, mysqlclient, beautifulsoup4. The crawler scrape the book prices from amazon. After scraping function will calculate new prices and post into the database.