I played a crucial role in developing a food data analytics system leveraging advanced technologies. I utilized Apache Spark for scalable data processing, handling large volumes of data efficiently for analytics and machine learning tasks. Spark's distributed computing framework enabled parallel data processing, optimizing performance and ensuring timely insights.Airflow was instrumental in orchestrating and scheduling ETL workflows, automating data pipelines from data extraction to… Show more I played a crucial role in developing a food data analytics system leveraging advanced technologies. I utilized Apache Spark for scalable data processing, handling large volumes of data efficiently for analytics and machine learning tasks. Spark's distributed computing framework enabled parallel data processing, optimizing performance and ensuring timely insights.Airflow was instrumental in orchestrating and scheduling ETL workflows, automating data pipelines from data extraction to transformation and loading (ETL). I designed and implemented complex workflows using Airflow's DAGs (Directed Acyclic Graphs), ensuring reliable and repeatable execution of data jobs.Azure services such as Azure Data Factory were utilized for data integration, orchestrating data movement and transformation across various Azure data sources and services. This cloud-based approach facilitated scalability, flexibility, and integration with other Azure components like Azure Databricks for advanced analytics.My responsibilities also included SQL development for data manipulation, transformation, and querying within Azure SQL Database or other relational databases, ensuring data accuracy and consistency throughout the analytics lifecycle at INVINCIX. Show less

I leveraged advanced automation technologies to ensure the robustness and functionality of the "Learning Portal for Unit Account" project. Using Selenium WebDriver with Java, I created automated test scripts to verify critical functionalities such as user login, course enrollment, content navigation, and progress tracking across different browsers and platforms. I utilized TestNG to manage test suites and execute tests efficiently, integrating them into Jenkins for continuous integration and… Show more I leveraged advanced automation technologies to ensure the robustness and functionality of the "Learning Portal for Unit Account" project. Using Selenium WebDriver with Java, I created automated test scripts to verify critical functionalities such as user login, course enrollment, content navigation, and progress tracking across different browsers and platforms. I utilized TestNG to manage test suites and execute tests efficiently, integrating them into Jenkins for continuous integration and regression testing. API testing was performed using tools like Postman to validate data integrity and interactions between various system components. Additionally, I employed SQL queries to verify database updates and ensure data consistency during test executions. Collaborating closely with developers and business analysts, I participated in agile ceremonies to align testing efforts with sprint goals, ensuring high-quality deliverables and timely issue resolution. This experience enhanced my proficiency in cutting-edge automation tools and methodologies, preparing me for future challenges in software quality assurance. Show less