Java Developer
CurrentRequirement Analysis and Documentation as per SDLC methodologies. • Automated the Data Ingestion process using Shell scripts, Java Spark Library, Event Engine Console. • Worked on creating a data ingestion pipeline to cleanse, transform and filter data before creating ingestion files in parquet, CSV, text formats. Utilized SFTP to send these files for ingestion into hive tables. • Utilized a central batch streamer to transform Data into API requests in JSON & processed the response back to the required data format. • Utilized the Java 11 String library for the use for repeat, strip functions in data transforming and cleaning. Also used read/write String methods of Files library. • Utilized Microservices architecture for implementing business capabilities and CICD of the application. • Designed an approach for data movement from different sources to HDFS via Apache/Confluent Kafka.• Skilled in utilizing AngularJS with RESTful APIs to fetch and display data.• Worked on creation, optimization, updating HQL (Hive query Language) scripts. • Transformed existing hive scripts to Java SPARK for efficient performance and faster runtime. • Utilized Scala Spark to run monitoring scripts, post implementation validations, data sanity checks etc. • Proficient in integrating AngularJS with other front-end technologies such as HTML, CSS, and JavaScript.• Developed a UI using HTML, CSS, JavaScript, and backend functionality in JAVA for internal teams to add accounts to the daily matching process. • Worked on AWS cloud services i.e. EC2, S3, RDS, ELB and EBS for installing, configuring & auto scaling.