With over 10 years of extensive hands-on experience as a Senior Data Engineer, I bring deep expertise in Data Mapping, Data Validation, and statistical data analysis. I excel in transforming business requirements into analytical models, designing algorithms, machine learning, and crafting strategic solutions that scale across massive volumes of data. I am proficient in a variety of BIGDATA technologies, tools, and databases, including Spark, Hive, Python, SQL, AWS, Azure, Snowflake, Hadoop, Sqoop, CDL (Cassandra), Teradata, Tableau, and Redshift, and I have a deep passion for the world of data. Extensive experience in Hadoop ecosystems, including components like HDFS, MapReduce, Spark, Name Node, Data Node, Job Tracker, Task Tracker, and Secondary Name Node. Strong background in cloud-based platforms, particularly Amazon Web Services AWS (EC2, S3, Glue, Athena, DynamoDB, Redshift, CloudFormation); Azure (Data Lake, Synapse Analytics, Cosmos DB, HD Insight, Data Factory, DevOps), and Google Cloud Platform (Big Query, Dataflow, Dataproc, Pub/Sub, Airflow). Skilled in setting up and managing Hadoop clusters on AWS EMR, and implementing data pipelines and ETL jobs using AWS Glue, Apache Airflow in GCP. Proficient in writing scripts using Python API, Spark API, and hands-on experience with Spark Core, Spark SQL, Spark Streaming, and Data Frames in Spark with Scala. Expertise in data integration using Apache Sqoop to move data between HDFS and RDBMS, and leveraging Alteryx for seamless data blending, cleansing, and transformation. Experienced in designing and implementing end-to-end systems for data analytics and automation using tools such as R Studio, Hadoop, MongoDB, Tableau, Quicksight and Power BI. Strong experience in the Software Development Life Cycle (SDLC) including requirements analysis, design specification, application development, migration, maintenance, and testing in Agile methodologies. Extensive experience in database design, modeling, migration, and development with MySQL, MS SQL Server, DB2, Oracle, and Snowflake. Proficient in ETL processes using Informatica and Talend, and enhancing database performance through indexing, triggers, and constraints. Skilled in developing complex workflows in Alteryx, and publishing and securing Tableau workbooks and PowerBI dashboards for interactive data visualization. Coded extensively in Python, shell scripting, and PL/SQL queries for data analysis and processing. Developed Spark applications using Spark RDD, Spark-SQL, and Data frame APIs, and optimized Spark jobs for performance.