Experience in designing, developing, and optimizing data pipelines using SQL, Python, PySpark, and Spark SQL. I have a deep understanding of Spark Architecture, including Spark Core, Spark SQL, Data Frames, and Spark Streaming, which has enabled me to enhance insights and drive actionable results from large datasets. My expertise extends to Big Data Hadoop and Yarn architecture, with hands-on experience in tools like HDFS, MapReduce, Kafka, Hive, Impala, HBase, Sqoop, and more. I specialize in crafting end-to-end data pipelines that extract, cleanse, process, and analyze significant volumes of data. I am proficient in Dimensional Data Modeling using StarSchema and Snowflake schemas within Databricks. My Python skills include using Pandas and boto3 for S3 operations, and I have implemented secure IAM policies and Role-Based Access Control (RBAC) within Databricks.Led the implementation of Alation's Data Catalog to enhance data discovery and accessibility across the organization, ensuring consistent and accurate metadata management for over TB of data across multiple platforms.Guidewire provides integrated solutions through its PolicyCenter, BillingCenter, and ClaimCenter modules, and enables insurers to improve operational efficiency, customer service, and compliance by leveraging cloud capabilities, data access, and digital transformation tools.. Enabled data lineage tracking in Alation to provide visibility into data flows and transformations, ensuring end-to-end traceability of data from ingestion to consumption, supporting compliance, and boosting operational efficiency.Proficient in managing CDP customer profiles, creating segments, and building targeted customer audiences to enhance marketing initiatives and personalized customer experiences. Expertise in monitoring and optimizing CDP infrastructure performance, troubleshooting CDP-related issues, and providing technical support for seamless operations. With extensive experience in cloud platforms such as AWS, Azure, and GCP, I have expertise in tools like AWS Glue, Azure Data Factory, and BigQuery. My data visualization capabilities are strong, particularly in Power BI, Excel, and Tableau, where I create interactive dashboards for actionable insights. I am well-versed in Agile methodologies, CI/CD pipeline automation, and data governance frameworks, with practical experience in Jenkins, UDeploy, and Concourse Pipeline.