Shiva Reddy Email & Phone Number

With over 10+ Years of experience in Data Engineering, I excel in designing robust data pipelines and developing scalable solutions across cloud platforms such as AWS, Azure, and GCP. My proficiency with AWS services, including Glue, Lambda, Redshift, and Azure services like Data Factory and Databricks, enables me to streamline data processing and integration. I have a solid foundation in SDLC methodologies, particularly Agile and Waterfall frameworks, and actively lead and participate in SCRUM sessions to ensure efficient project management and delivery. My technical expertise spans AWS tools (S3, IAM, EC2, EMR, Kinesis, Redshift, RDS, Lambda, Athena, Glue, DMS), Azure services (EventHub, Data Factory, Databricks, Synapse Analytics, Blob Storage, Power Apps), and big data technologies like Hadoop, Spark, Kafka, and Hive.In addition to optimizing SQL/NoSQL databases (MySQL, SQL Server, PostgreSQL, Oracle, Cosmos DB, MongoDB, Cassandra) for efficient data storage and processing, I am proficient in programming with Python, Spark, Unix Shell scripting, SQL, APIs, and Java. My skills in scripting with Python (PySpark), Scala, and Spark-SQL enable me to aggregate data from various file formats such as XML, JSON, CSV, Avro, Parquet, and ORC. I ensure code quality and effective collaboration using version control systems like GitHub, GitLab, and Bitbucket. Additionally, my data visualization capabilities with Tableau, Power BI, and AWS QuickSight help create insightful dashboards that drive data-driven decision-making. As a dedicated team player with strong problem-solving skills and effective communication abilities, I quickly adapt to new technologies and environments, ensuring successful project outcomes and business growth.

• 

  Jntuh College Of Engineering Hyderabad

  Computer Science