Amit Kumar Soni Email & Phone Number

Bengaluru, Karnataka, India

Bengaluru, Karnataka

Involving in architecture design and development on Azure Platform and OnPrem for various data pipelines in the existing product. Working on Spark with Scala and Java on OnPrem and Azure HDI and DataBricks integrated with Eventhubs as streaming layer to transform and process different types of collection data generated from different software.Closely working with business stakeholders to establishing the parameters for configurations, development, testing and deployment of the applications. Managing technical team of 3 people.

Bengaluru, Karnataka, India

As a Senior Data Engineer to analyze business requirement document and working with various business teams to full fill gaps to meet business requirements. Migrating data from various data sources to HAAS and configuration changes required for Big Data solution implementation for various portfolios. Involving in architecture design and automating of current dataflow. Developing the reporting system to meet the business requirements. Writing hive queries for report development and data points, writing shell script and python script to automate the data flow through Control-M.Working on Spark framework with Scala and pyspark to develop the flow and to automate the existing data flows.

Bengaluru, Karnataka, India

Involved in development of new APIs and features for existing products.Customization and integration of product for various customers using product APIs.Developing Java APIs and responsible for UI development and customization.Developing Hive Queries, SQL and PL/SQL for loading and customizing data from Oracle database.Working with professional services group which is more customer facing.

Bangalore

Involved in development of various components of application for analytics.Understood business knowledge to resolve critical issuesAnalyzing the Users CDRs (Call Data Records), Sales Records and log files as per the requirements.Created Pig Script to load and process a large sets of structured, semi-structured and unstructured data coming from variety of portfolios.Collaborated with the infrastructure, network, database, application and BI teams to ensure data quality and availability.Analysis and solutions for Adhoc requests from clients. Loading the data in HDFS from other system-using sqoop. Implementing ETL process through SQL Server and Teradata.Writing the Map Reduce jobs for processing and cleaning the data.Writing Custom UDFs for data processing and cleaning in Hive and Pig.Involved in creating Hive tables, loading with data and writing hive queries.Using Oozie to run workflows.Automated the report creation-using bash.

India

Design the User Interface with HTML, CSS, JSP, validation using Java Script, Dojo and JQuery.Understanding the rules and business specification for implementation of the project.Diagnose and solve technical problems related to commerce implementation Used JAX-B for XML generation. Prepared SQL for data Manipulation in application.Create standalone JAVA application to provide Lenovo the functionality to transform their source XML files which contains the video link information to RSS file format. Created LLD for the complete header design and implemented end to end with minimal bugs.Provide inputs to team for application design and implementation. Extended existing controller commands and implemented business logic. Followed the Commerce best Practices in customizing the JSP.Involved in creation of a tool, which loads the data for IBM products. Analyze and fix errors/bugs for the CCE sites reported by clients.Responsible for the implementation, unit testing.Tracking and maintaining updates for the fixes/requirements using Rational Team Concert.