Data Engineer
CurrentI am currently working as a Data Engineer in Banking ,Financial Servicesand Insurance (BFSI) unit , I am working with PNC bank on HadoopFramework and leveraging technologies like Python , PySpark , SQL , Hive ,Shell Scripting , Sqoop for compiling , cleaning and manipulating data forproper handling.1) Transforming the raw data into meaningful information to support businessdecisions. Designing data models for complex analysis needs.2) Collaborating on ETL (Extract… Show more I am currently working as a Data Engineer in Banking ,Financial Servicesand Insurance (BFSI) unit , I am working with PNC bank on HadoopFramework and leveraging technologies like Python , PySpark , SQL , Hive ,Shell Scripting , Sqoop for compiling , cleaning and manipulating data forproper handling.1) Transforming the raw data into meaningful information to support businessdecisions. Designing data models for complex analysis needs.2) Collaborating on ETL (Extract, Transform, Load) tasks, maintaining dataintegrity and verifying pipeline stability.3) Using Sqoop extensively to import data from RDMS sources into HDFS.4) Using Shell scripting to design ETL workflows.5)Contributing to internal activities for overall process improvements,efficiencies and innovation.6) Implementing data pipeline jobs creation and monitoring with CA 7 Workload Automation. Show less