Biswanath Banerjee Email and Phone Number

• Design and implement ETL pipelines in spark.• Responsible for developing NIFI flows and creating schedules for data extraction and running pipelines by identifying the dependencies.• Involved in processing data from AWS S3 buckets and loaded into EDW tables.• Designed and Developed Real time Stream processing Application using Spark, Kafka, Scala and Hive to perform Streaming ETL and apply Machine Learning.• Worked on various machine-learning models and applied on data to find correlation between different entities.• Unified data lake architecture integrating various data sources on Hadoop architecture.• Involved in loading data into HBase using HBase Shell, HBase Client API.• Responsible for developing data pipeline using flume and Kafka to extract the data and store in HDFS.• Used Maven extensively for building jar files of Java MapReduce programs and deployed to Cluster.• Created Multimode projects using SBT, developed the build script, and used various sbt plugins to manage the build dependencies.• Created HBase tables to load large sets of structured, semi-structured and unstructured data coming from UNIX, Mongo DB, NoSQL and a variety of portfolios.

•Provide an overall architect responsibilities including roadmaps, leadership, planning, technical innovation, security, IT governance, etc•Present and persuade the design architecture to the various stakeholders (Customer, Server, Network, Security and other teams )•Produce artifacts in support of reference architecture advocacy and implementation, including authoring documentation, white papers, and presentations/diagrams for dissemination to technical and business audiences•Acting as a senior architect, provide technical and process leadership for projects, defining and documenting information integrations between systems and aligning project goals with reference architecture•Lead end-to-end Hadoop implementation at large enterprise environment integrating with multiple legacy applications in heterogeneous technologies (Microsoft, Java, PowerBuilder, Oracle, SQL Server, Mainframe, GIS (Point Cloud), Sensors etc)•Provide technical leadership and governance of the big data team and the implementation of the solution architecture in Hadoop ecosystem.•Manage Data Ingestion and Data Quality solutions for various Structured and Unstructured data (including logs, images, voice, video, etc.) on Cloudera Hadoop platform•Deliver analytical solutions and visual dashboards on big data platforms

•Developed, implemented, and maintained web-service standards based software products and related systems based on J2EE architectural designs, standards and best practices to meet future business needs•Analyzed user requirements and proposed design patterns as well as created, compiled, tested, debugged Java, HTML, SQL, C++ or JavaScript programs to support application development projects•Conducted and participated in J2EE application architecture, code or design reviews and performed troubleshooting functions as well as recommended and implemented new features as per clients' change requests or project requirements•Supported continuous improvement with creative and efficient technical solutions and software engineering practices as well as worked with other application architects in designing and executing various J2EE application components to meet new business requirements•Providing technical leadership and support to junior team members regarding application design and development projects as well as updated and maintained continuous integration and deployment scripts to improve software development practices•Documented and communicated designs, estimates, and implementation plans to project leads and management teams as well as provided technical assistance and training materials for end-users regarding application usage, troubleshooting and maintenance

Leading a product development team

Leading a product development team

• Use Java technologies to build web applications for client-server environments.• Use expertise in Software Development Life Cycle (SDLC) and core Java technologies to create desktop applications that meet client requirements.• Develop customized, interactive user interfaces using JavaScript, HTML and CSS. • Supervise a team of Java Developers, motivate them to meet team goals, collaborate to improve user experiences and provide training to new employees and interns.• Merge Java-based code with applications written in C++ and HTML5.• Use debugging skills to improve the quality of code and improve application performance.• Built, integrated and modified web applications according to client specifications.• Used JavaScript to develop interactive user interfaces (UIs) that provided user experiences that exceeded client expectations and met key performance indicators (KPIs).• Used Enterprise JavaBeans (EJB) to create large applications for key company clients. I received several commendations from the management for my web applications.• Worked in a team of web developers, designers and other IT personnel to meet team goals and improve business outcomes.• Assisted in the on-boarding of new web developers, Java Developer interns