Sunilkumar Reddy Email & Phone Number

With over 13 years of experience in ETL/ELT and Data Engineering for Banking, Finance, and Insurance, I possess excellent knowledge of Data Warehousing Concepts, including SCD Type1/Type2/Type3, CDC, Dimension & Fact tables, and Schemas. Additionally, I have substantial expertise with Snowflake Cloud Data Warehouse and AWS S3.My proficiency extends to utilizing Apache Spark with Python for developing and executing Big Data Analytics and Machine Learning applications. I have successfully executed Machine Learning use cases under Spark ML and Mllib. Furthermore, I have designed and developed applications using Apache Spark, Scala, Python, S3, AWS EMR on AWS cloud to format, cleanse, validate, create schema, and build data stores on S3.My hands-on experience extends to Azure Cloud services, Management tools, Migration, Storage, Network & Content Delivery, Active Directory, Azure Container Service, VPN Gateway, Content Delivery Management, Azure Storage Services, and Azure Database Services. I have built Azure Delta Lake and implemented optimized big data pipelines using Azure Databricks, Azure Logic Apps, Azure Data Factory, Azure Synapse, and Azure DevOps.In addition, I have experience in building datalake using AWS, S3, EMR, EC2, ECR, Lambda, Redshift, and Athena. I possess good experience with Snowflake utility SnowSQL.Having a firm understanding of Hadoop architecture and various components, including HDFS, Yarn, MapReduce, Hive, Pig, HBase, and Kafka, I have employed these technologies in my projects.I am well-versed in using Spark RDD API, Spark DataFrame/Dataset API, Spark-SQL, and Spark ML frameworks to build end-to-end data pipelines. Additionally, I have hands-on experience working with Cloudera, Hortonworks, and AWS big data services.My knowledge in Teradata database layers using utilities such as BTEQ, MULTILOAD, FASTLOAD, TPUMP, and FAST EXPORT, along with Macros, supports the existing legacy Data Warehouse.Moreover, I have experience using AWS CLI, Presto, file shredder, and SFTP configuration setup in AWS. Core Hadoop and Hadoop technology stack, which includes HDFS, Hive, HBase, Impala, and Kafka, are also within my scope of expertise.I possess strong experience in Control M and Tidal Scheduling services for automation and have worked with Terraform for automating VPCs, ELBs, Security groups, SQS queues, S3 buckets, and continuing to replace infrastructure as code from scratch.

• 

  Anna University Chennai

  A