Experienced Data Engineer with 8 years of experience in Azure, AWS, PySpark, Scala, Hadoop, and Hive.Extensive expertise in data engineering concepts, including ETL processes, data modeling, data warehousing, and data lakes. Proficient in designing and optimizing large-scale data pipelines, crafting Python and Scala APIs, and deploying solutions within Kubernetes environments. Strong experience in agile, DevOps, and Waterfall methodologies ensuring project success.Skills:Big Data Tools -- Hadoop, Hive, Apache Spark, Apache Kylin, Apache Nifi, PySpark, HBase, Kafka, YARN, Sqoop, Impala, Oozie, Pig, Map Reduce, Zookeeper and Flume.Cloud Services:AWS – EC2, S3, EMR, RDS, Glue, Presto, Lambda, RedShift, SNS, SQS, AWS Neptune, Cloudwatch.Azure- Azure Data Lake, Azure Functions, Data Bricks, Azure Data Factory, Azure Monitoring, Active Directory, Synapse, Key Vault, SQL Azure.Infrastructure as a code: TerraformData Visualizations-- Tableau, and Power BIRelational Databases--Oracle, SQL Server, Teradata, MySQL, PostgreSQL, and NetezzaNo SQL Databases--HBase, Cassandra, MongoDB, Azure Cosmos DB, and DynamoDB.GraphDB: GremlinDBProgramming Languages--Scala, Python , R and Java, GraphQL (query language)