Data Engineer
CurrentSuccessfully executed AWS-based projects, contributing to enhanced scalability and improved operational efficiency.Implemented PySpark workflows for complex data processing tasks, resulting in increased efficiency and data-driven insights.Designed and managed MySQL databases, ensuring data integrity and security, and optimizing performance for critical applications.Demonstrated proficiency in Linux system administration, enabling the seamless functioning of applications and services.Contributed to Hadoop-based solutions, enhancing the organization's capability to handle and analyze large datasets effectively.Creating a Streaming Data Pipeline for a Real-Time Dashboard with Dataflow using Google Cloud Platform and perform a query using Big-query console with command shell approach.Managed the migration of legacy data systems to cloud-based platforms, including AWS and Azure, enhancing data accessibility and scalability.Collaborated with cross-functional teams to integrate new data solutions with existing applications, improving overall data utilization.
