Sr Java Etl Developer
CurrentDesigned and developed of ETL processes and data integration solutions using Java, Spring Batch, and Apache Camel frameworks. Develop and maintain ETL jobs for data extraction, transformation, and loading from various source systems to target databases using tools such as Informatica, Talend, and Apache NiFi. Optimize ETL workflows and performance by tuning SQL queries, implementing parallel processing, and optimizing data transformation logic. Designed and implemented data quality checks and error handling mechanisms to ensure the accuracy and reliability of ETL processes. Work closely with database administrators and infrastructure teams to troubleshoot performance issues and optimize database configurations for ETL processing. Implement best practices for version control, code management, and deployment automation using tools such as Git, Jenkins, and Docker. Collaborate with business stakeholders and data analysts to understand data requirements and design efficient data integration processes. Develop custom ETL scripts and programs using Java, SQL, and scripting languages to extract, transform, and load data from various source systems into data warehouses and data lakes. Optimize ETL workflows and processes to improve performance, scalability, and reliability of data integration jobs. Designed and developed ETL workflows and data pipelines using Java, Spring Batch, and Apache Camel to integrate data from disparate sources into a centralized data warehouse. Knowledge of Java, JavaScript, or Python can be beneficial, especially for complex transformations or integrating Pentaho with other systems. Implemented RESTful Web services in Service Oriented Architecture (SOA) to retrieve data from client side and made REST API calls from AngularJS and parsed the data to client and handled the security and Authorization using Spring Security and OAuth2authentication protocol respectively.