As a seasoned Data architect and software developer with over 14 years of experience, I have developed a deep understanding of various technologies and methodologies. My expertise includes 8+ years of experience in Spark, Databricks, Collibra, Qlik Replicate, Snowflake, AWS, and Agile methodologies using the Scrum approach. I am currently working as a Cloud Data Engineering Architect and Data on Cloud Senior Manager at Capgemini India Pvt. Ltd. and am responsible for Qlik Replicate, AWS, HUDI, Spark Python, Event Bridge, and Airflow, Snowflake.Prior to this role, I was working as a Big Data/Cloud Data Engineering Architect at IBM India Pvt. Ltd. and was responsible for Spark, Azure, Databricks, Collibra, and Control M. Before that, I worked as a Technology Architect at Accenture Solutions Pvt. Ltd. for over 6 years and gained expertise in Spark, AWS, Databricks, Collibra, HBase, and Hive. My professional journey began as a Software Engineer at HCL Infosystem Ltd., and I also worked as a Software Developer at Vaishnavi Technology formerly known as Intech Software.As a Cloud Data Engineering Architect, I assess EMR-related knowledge across solutions architecture and business development teams, and develop plans to address gaps. I am constantly evaluating new technologies and executing proof-of-concepts. Additionally, I provide overall architect responsibility, including roadmaps, leadership, planning, technical innovation, security, and IT governance.My technical expertise includes Open Source technologies, Python, Java, strong database knowledge of MySQL, Spark, AWS and fair exposure to Oracle. I also have technical expertise in different services of Amazon Cloud as EC2, S3, IAM, Open VPN, Kinesis, etc. Furthermore, I have designed and coded application components in an agile environment utilizing a test-driven development approach.I have a proven track record of providing technical and process leadership for projects, defining and documenting information integrations between systems, and aligning project goals with reference architecture. I am skilled in producing artifacts in support of reference architecture advocacy and implementation, including authoring documentation, white papers, and presentations/diagrams for dissemination to technical and business audiences.As an architect, I have provided technical leadership and governance of the big data team and the implementation of the solution architecture for AWS Based cloud Data Lake.