Arkaprova Saha Email & Phone Number

Bengaluru, Ka, In

Kolkata Area, India

As Senior Data Engineer, managing all the data related activities as well as guide the team members in architectural perspective including hands on end to end coding in the product based application named HealthEIndia. This application has been developed to improvement for the health care system in our country. It will help us integrate all the doctors, patients and medical facilities in our country under one platform. This is a cloud based application / mobile app to help our users to manage all the health related activities. In this application, providing architectural solutions along with hands on coding including organise and analyse row data, build data pipelines, prepare data for dashboard and report, data collection from different sources, converting raw data into usable information for analytics including data governance. • Gathering requirements and hands-on coding in all parts of the application used by 300000+ patients. • Design and implement Data Lake solutions on AWS S3 using AWS Glue and AWS Athena to Extract, Load and Transform (ELT) large volume of data from AWS Oracle RDS. • Schedule data pipeline job using AWS Step Functions and AWS Glue Workflows. • Design and implementation of securely storing 4M prescriptions in Amazon S3 using Java REST API • Optimize SQL query to improve overall application performance by 30%. • Build data pipeline to upload data from on-premise Oracle to Google Cloud Storage (GCS) using NiFi. • Manage, configure and optimize Apache NiFi cluster in Google Compute Engine (GCE). • Processed data from GCS bucket to BigQuery using Apache Beam (Java SDK) in Google Cloud Dataflow. • Developed web based report solution using Jasper Report which serves 700+ reports daily basis. • Implement of interactive dashboards displaying key business metrics using Metabase. • Perform code reviews and helping developers for optimization and troubleshooting.

Working in Cognizant Product Engineering Group (PEG), in this Bigframe program we ware developing a Big Data product for huge data offloading from any RDBMS to Hadoop on-premise as well as cloud platform. For on-premise platform we used Hortonworks and Cloudera. For cloud base solution it has been developed for Amazon Web Services (AWS) and Microsoft Azure HDInsight. This is basically a web based application where we can choose source/destination and corresponding mapping between them. This web based application will connect to Hadoop cluster and transfer the data according to the mapping between source and destination. We also support data reconciliation which is developed using Spark dataframe. • Worked as a key member of Cognizant Product Engineering Group (PEG) for development of BigFrame. • Design and implementation of end to end flows using Sqoop, • Developed user defined functions to provide custom Hive capabilities. • Build libraries and frameworks around Hadoop. • Development for Hortonworks, Cloudera, AWS, Azure platform(HDInsight). • Developed Java module for HDFS to HBase data offload. • Implement Hadoop security using Kerberos. • Implementation data reconciliation mechanism using Spark Dataframe(Using Scala). • Build real time data offload in Amazon S3 and EMR HDFS using Kafka. • Developed Message Bus using Mule ESB for JP Morgan Chase.

Haldia Dock Complex (HDC) is an organization of Kolkata Port Trust under Ministry of Ports Shipping and Waterways, Govt. of India, deals with the Import, Export and related operations of Container and Cargo. This project is intended to help the client to perform the operations for verious departments using the help of Computer System. The project provides efficient flow of information among the various divisions with integrated and centralized database. The system includes EDI Module which has been implemented to exchange import/export related data electronically between Haldia Dock Complex and Customs. EDI System accepts the incoming messages from Customs and posts its contents to the database and on the flip side generate the outgoing messages from the database for Customs. • Developed Java Server side components, which includes Servlets and EJB. • Responsible for unit testing and bug fixing of the work done. • Developed Stateless Session Beans in EJB. • Responsible for Integration of modules and Report Development using Crystal Report and Crystal Clear.