Design and develop ETL integration patterns using Python on Spark.Develop a framework for converting existing PowerCenter mappings to PySpark(Python and Spark) Jobs.Create a Pyspark script to bring data from MySQL to Amazon S3.Translate business requirements into maintainable software components and understand impact (Technical and Business)Guide the development team working on PySpark as an ETL platformMakes sure that quality standards are defined and met.Optimize the Pyspark jobs to run on Cluster for faster data processingProvide workload estimates to the clientImplement CICD(Continuous Integration and Continuous Development) pipeline for Code DeploymentReviews components developed by the team members

Provides a valuable attendance service for both teachers and students. Reduce manual process errors by providing an automated and reliable attendance system using face recognition technologyIncrease privacy and security so that students cannot present themselves or their friends while they are not present.Produce monthly reports for lecturers automatically with this application.

Design and develop ETL integration patterns using Python on Spark. Develop a framework for converting existing PowerCenter mappings to PySpark(Python and Spark) Jobs. Create a Pyspark script to bring data from MySQL to Amazon S3. Translate business requirements into maintainable software components and understand impact (Technical and Business) Guide the development team working on PySpark as an ETL platform Makes sure that quality standards are defined and met. Optimize the Pyspark jobs to run on Cluster for faster data processing Provide workload estimates to the client Implement CICD(Continuous Integration and Continuous Development) pipeline for Code DeploymentReviews components developed by the team members