• Responsible to create and maintain optimal data pipeline architecture.• Experienced in working with PySpark, Data Frames, RDD, Python, Hive, Hbase and Spark for business requirements.• Assemble large, complex data sets that meet functional / non-functional business requirements.• Experience in building infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using ‘Big Data’ technologies.• Responsible for implementing analytics tool that utilize the data pipeline to provide actionable insights into customer experience, operational efficiency and other key business performance metrics.• Work with stakeholders including the Data Scientist, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.• Work with data and analytics experts to strive for greater functionality in our data systems.

• Responsible for requirement gathering Analysis, Design, Development and Implementation of new Functionalities for the software products in time bound manner.• Worked as Onsite Engineer in Malaysia for Fraud Management and Revenue Assurance products handling customer change requests from data gathering to delivery.• Providing suggestion/solutions to clients directed toward product and helping them in utilizing the product through the best and improve their business. • Handling client queries, providing them feasible solutions and building healthy relationships thereby achieving high customer satisfaction.• Working with different teams by sharing business knowledge and providing suggestions for the enhancements. • Troubleshooting system critical issues and driving resolution of issues with a focus on minimizing impact to our customers, improving the processes and design enhancements to automation to continuously improve the production environment. • Identify reoccurring issues and work with IT & Business partners to re-mediate using the problem management process.• Involved in writing Technical Specification Documentation.• Having experience in writing hive queries for business reports/fetch data as per business logic by importing data from Oracle Database using Sqoop.• Extensive knowledge of creating manage tables and external tables in Hive Eco system including ORC tables.• Implementation and Configuration of Reconciliation between different Data sources using Hive queries.• Identification of bug and providing fixes in Hive and Pig Reports.• Implementing Spark SQL programs for analysis purposes.

• Responsible for addressing client requests in a time bound manner and ensuring 100% up time of critical business application.• Worked with multiple clients globally providing robust solutions within time.• Automation of mundane tasks using Unix shell scripting and PL/SQL.• Involved in identification of bug and workaround. Response to functional queries.• Experience in configuration and release management.