• Agile and Scrum methodologies were employed throughout the Software Development Life Cycle (SDLC) to enhance project efficiency and collaboration.• Applied Hadoop, Spark, Sqoop, Hive, and PySpark for large-scale data processing, analysis, and transformation.• Used Python in-built libraries urllib2 and beautiful soup modules for web scraping.• Developed SQL Alchemy queries for seamless interaction with relational databases, including PostgreSQL.• Utilized XML and Beautiful Soup… Show more • Agile and Scrum methodologies were employed throughout the Software Development Life Cycle (SDLC) to enhance project efficiency and collaboration.• Applied Hadoop, Spark, Sqoop, Hive, and PySpark for large-scale data processing, analysis, and transformation.• Used Python in-built libraries urllib2 and beautiful soup modules for web scraping.• Developed SQL Alchemy queries for seamless interaction with relational databases, including PostgreSQL.• Utilized XML and Beautiful Soup for web scraping, extracting valuable data from various online sources.• Implemented AWS Glue for ETL (Extract, Transform, and Load) jobs, facilitating efficient data movement within the AWS ecosystem.• Employed jQuery to simplify DOM manipulation and enhance user interface interactivity.• Managed databases using PostgreSQL and automated deployment tasks with Ansible.• Containerized applications using Docker for consistent and reproducible environments.• Orchestrated AWS CloudFormation templates for infrastructure as code, ensuring scalable and reliable AWS resource provisioning.• Used cURL for web scraping contents that cannot be scraped normally.• Utilized Apache Spark for large-scale data processing and AWS API Gateway for building and managing APIs.• Demonstrated expertise in AWS services such as EC2, S3, Lambda, and Autoscaling for scalable and cost-effective solutions.• Identify target data on websites and write code to extract it efficiently.• Handle potential issues like website structure changes or data inconsistencies.• Ensure adherence to ethical scraping practices and respect robots.txt guidelines.• Clean and transform extracted data into usable formats (CSV, JSON, etc.).• May involve writing unit tests to ensure code quality and functionality.• Integrated AWS SQS and AWS SNS for scalable and reliable messaging solutions.• Deployed applications on AWS Elastic Beanstalk and managed containerized applications using AWS Kubernetes. Show less

• Spearheaded the development of scalable web applications using Python and Django framework, ensuring robust and efficient backend functionality.• Implemented responsive and dynamic user interfaces using front-end technologies such as HTML, CSS, and JavaScript to enhance the overall user experience.• Designed and implemented microservices architecture, enabling modular and independent development of various application components.• Leveraged JSON for data interchange between… Show more • Spearheaded the development of scalable web applications using Python and Django framework, ensuring robust and efficient backend functionality.• Implemented responsive and dynamic user interfaces using front-end technologies such as HTML, CSS, and JavaScript to enhance the overall user experience.• Designed and implemented microservices architecture, enabling modular and independent development of various application components.• Leveraged JSON for data interchange between different microservices, ensuring seamless communication and data consistency.• Managed and configured WebLogic servers to deploy and maintain applications in a production environment.• Utilized AJAX for asynchronous communication, enhancing the real-time responsiveness of web applications.• Applied Agile and Scrum methodologies to streamline development processes, ensuring timely delivery of high-quality software.• Established CI/CD pipelines using Jenkins, automating the build, test, and deployment phases for increased development efficiency.• Implemented JSON Web Tokens (JWT) for secure and efficient authentication and authorization processes.• Monitored and maintained application logs using Cloud Watch, ensuring optimal performance and identifying potential issues proactively.• Deployed applications on OpenShift and managed containerized environments using Kubernetes orchestration for efficient scaling and resource utilization.• Developed dynamic and responsive user interfaces using Angular, Material UI, and Angular CLI, integrating with Node.js for server-side rendering.• Implemented infrastructure as code (IaC) using Terraform, automating the provisioning and configuration of cloud resources.• Utilized various AWS cloud solutions, including EC2, S3, and RDS, for scalable and reliable hosting of applications.• Designed and implemented serverless architecture using AWS Lambda, optimizing resource utilization and reducing operational costs. Show less

• Involved in the requirements-gathering efforts for a web-based application, demonstrating a profound understanding of project needs and ensuring alignment with organizational goals.• Proficient in Python, utilizing Flask and SQLAlchemy to develop robust and scalable web applications.• Extensive experience with SQL Server for efficient database management and optimization of query performance.• Implemented Azure Functions and utilized Azure App Service and AKS for deploying and… Show more • Involved in the requirements-gathering efforts for a web-based application, demonstrating a profound understanding of project needs and ensuring alignment with organizational goals.• Proficient in Python, utilizing Flask and SQLAlchemy to develop robust and scalable web applications.• Extensive experience with SQL Server for efficient database management and optimization of query performance.• Implemented Azure Functions and utilized Azure App Service and AKS for deploying and managing web applications in a cloud environment.• Developed and maintained Azure Logic Apps for seamless integration and automation of workflows.• Leveraged NumPy and SciPy for advanced data analysis, performing various mathematical operations to derive meaningful insights.• Utilized Matplotlib to create visualizations that enhanced data interpretation.• Implemented RESTful Web Services for effective communication between different components of the application.• Integrated RabbitMQ for efficient message queuing and communication between distributed systems.• Proficient in Azure DevOps and Ansible for streamlined deployment, configuration management, and automation.• Actively involved in debugging and troubleshooting, ensuring the smooth functioning of the web application.• Utilized Pandas API for data manipulation and analysis, enhancing the application's data processing capabilities.• Experienced in version control using GIT and webapp2 for web application development.• Familiar with Maven for project management and PySpark for big data processing.• Implemented security measures using Azure Key Vault, Azure AD, and Azure Service Bus for secure and reliable application operation. Show less

• Collaborated with the development team in designing and implementing responsive and user-friendly websites.• Applied frontend technologies such as HTML, CSS, and JavaScript to enhance the user interface and overall user experience.• Contributed to developing backend functionalities using Python and the Django Web Framework.• Worked on database management tasks, including MySQL, and participated in designing and developing data management systems.• Implemented web services… Show more • Collaborated with the development team in designing and implementing responsive and user-friendly websites.• Applied frontend technologies such as HTML, CSS, and JavaScript to enhance the user interface and overall user experience.• Contributed to developing backend functionalities using Python and the Django Web Framework.• Worked on database management tasks, including MySQL, and participated in designing and developing data management systems.• Implemented web services, adhering to REST and SOAP protocols, for efficient communication between different components.• Assisted in creating middle-tier and persistence layer components, focusing on model layer classes and value objects.• Participated in data extraction and loading processes, utilizing Python for merge jobs to enhance data integrity.• Maintained version control using GIT to manage the codebase and streamline collaboration within the development team.• Conducted unit and system testing using PyTest to ensure the reliability and functionality of developed features.• Actively engaged in technical and functional knowledge-sharing sessions to foster a collaborative and learning-oriented environment.• Implemented client-side validation using JavaScript, contributing to enhanced user input validation and overall system security. Show less