Naveen Pasupuleti Email & Phone Number

Gerlingen-Schillerhöhe, Baden-Wuerttemberg, De

Braunschweig, Niedersachsen, De

Berlin, Berlin, De

Köln, Nordrhein-Westfalen, De

Big Data | AWS | Architecture | Design• Design and development of data pipelines using AWS EMR, Step functions, Lambdas, and Data Streams.• Expertise in working on Hadoop components: HDFS, Sqoop, Flume, Pig, Hive, MapReduce, HBase Spark components: Spark Core, Spark SQL, and Spark Streaming Clusters: AWS EMR, YARN, and Spark Cluster Scheduler: Oozie and Hue for pipeline creation• Developing Lambdas using python and Node.JS

Dubai, Ae

• Design and develop the data pipelines using Big Data batch and streaming use cases using Hadoop, Spark and Kafka.• Expertise in working on Hadoop components: HDFS, Sqoop, Flume, Pig, Hive, MapReduce, HBase Spark components: Spark Core, Spark SQL and Spark Streaming Clusters: YARN and Spark Cluster Scheduler: Oozie and Hue for pipeline creation• Collection and process of structured, semi-structured and unstructured data from different sources and Sqoop/EL into Hadoop Data Lake as Raw, Decomposed and the Model layer• Draw insights based on ingested data by using Spark, Scala processing and Sqoop out to Oracle DB or Oracle Exadata from HDFS • Tuning Spark jobs with proper resource allocation• Extensively coded Spark Dataframe’s, Spark SQL, Spark Streaming for relational processing• Creating Hive tables on processed data then applied Hive-QL on those tables for data summarization, validation.• Implemented the hive partitions, bucketing, hive joins.• Executing the Hive QL on Apache Spark for increasing performance.• Implemented Queries in Pig Scripts for analyzing the large datasets.• Created Oozie workflows with different actions for jobs scheduling as part of batch processing• Implemented Control checks and handshakes between the source and target systems using shell scripts.• Automated the data copying between different environments like development and production using shell scripts• As a member of the Scrum Development Team, I am responsible to deliver the story with TDD, Code Development/Construction, Unit Testing, and Peer Review• Designing and developing the product from the scratch level based on client Requirements. • Estimation of effort for development, assigning and follow-up with team members.• Involved in requirements gathering, analysis, design, writing Dlite SOW and development activities.• Helping the team members in understanding the technology and have guided them to learn to troubleshoot.

• Designing and developing the product from the scratch based on client Requirements. • Estimation of effort for development, assigning and follow-up with team members.• Involved in requirements gathering, analysis, design, writing Dlite SOW and development activities.• Worked on numerous changes which include GUI, Business logic and Performance upgrades.• Involved in writing new SQL, PL/SQL scripts for enhancements and debugging of existing scripts.• Involved in making the application cross-browser compatible.• Participated in migration from Java and Oracle migration.• Proposed performance tuning measures and implemented them successfully.• Supporting users during UAT and support activities.• Involved in writing new SQL, PL/SQL scripts for enhancements and have good knowledge about database structure and data tuning.• Proposing performance tuning measures and implemented them successfully.• Helping the team members in understanding the technology and have guided them to learn to troubleshoot.

• Involved in requirements gathering, analysis, design and development of enhancements.• Worked on numerous changes which include GUI, Business logic and Performance upgrades.• Involved in writing new SQL, PL/SQL scripts for enhancements and debugging of existing scripts.• Involved in making the application cross-browser compatible.• Participated in migration from Java and Oracle migration.• Proposed performance tuning measures and implemented them successfully.

M.Tech, Computer Science

B.Tech, Computer Science