Sushant Kumar Gupta Email & Phone Number

Norwich, Gb

Pune, Maharashtra, India

• Team Leadership: Manage and mentor a team of data engineers, providing guidance, support, and fostering a collaborative and innovative work environment. Set clear goals and objectives for the team.• Mentorship: Coached team members and provided mentorship for issues and aspirations through regular check-ins and career development conversations.• Delivery Management: Estimated and planned program deliveries by collaborating with cross-functional teams such as product management, business analysts, data scientists, QA etc. Managed end to end delivery. Involved in complete SDLC.• Data Integration and ETL: Oversee the development and maintenance of Extract, Transform, Load (ETL) processes to ingest and integrate data from various sources, including databases, APIs, and third-party systems.• Performance Optimization: Continuously monitor and optimize data pipelines and processes for performance and efficiency. Identify bottlenecks and implement improvements to enhance data processing speed and reduce latency.• Data Infrastructure Design: Collaborate with stakeholders, data scientists, and other teams to design scalable and efficient data infrastructure and architecture. Ensure that data pipelines, ETL processes, and data storage systems are robust, reliable, and meet business needs.• Data Quality and Governance: Implement and enforce data quality standards and data governance policies to ensure the accuracy, consistency, and security of data. Establish processes for data validation, data cleansing, and data lineage tracking.

Norwich, England, United Kingdom

• Team Leadership: Manage and mentor a team of data engineers, providing guidance, support, and fostering a collaborative and innovative work environment. Set clear goals and objectives for the team.• Mentorship: Coached team members and provided mentorship for issues and aspirations through regular check-ins and career development conversations.• Delivery Management: Estimated and planned program deliveries by collaborating with cross-functional teams such as product management, business analysts, data scientists, QA etc. Managed end to end delivery. Involved in complete SDLC.• Data Integration and ETL: Oversee the development and maintenance of Extract, Transform, Load (ETL) processes to ingest and integrate data from various sources, including databases, APIs, and third-party systems.• Performance Optimization: Continuously monitor and optimize data pipelines and processes for performance and efficiency. Identify bottlenecks and implement improvements to enhance data processing speed and reduce latency.• Data Infrastructure Design: Collaborate with stakeholders, data scientists, and other teams to design scalable and efficient data infrastructure and architecture. Ensure that data pipelines, ETL processes, and data storage systems are robust, reliable, and meet business needs.• Data Quality and Governance: Implement and enforce data quality standards and data governance policies to ensure the accuracy, consistency, and security of data. Establish processes for data validation, data cleansing, and data lineage tracking.

Norwich, England, United Kingdom

• Data Architecture and Design: Collaborated with cross-functional teams, including data scientists, business analysts, and data engineers, to design and implement data architectures that cater to the diverse data needs of the organization. This includes designing data pipelines and ETL processes.• Data migration: Developed a road map to migrate data pipelines from Cloudera to AWS EMR. Led the migration team for a year moving legacy system to AWS cloud.• Automation and Tooling: Drive the development of automation scripts, tools, and frameworks to streamline data engineering processes, improve efficiency, and reduce manual intervention.• Big data technologies: Developed streaming data pipeline processing data at the rate of 300 messages per second using AWS SQS, AWS lambda and DynamoDB to detect fraudulent quotes.• Cross-team Collaboration: Work closely with various teams such as data science, business analysts, and software development teams, to understand their data needs and provide them with the necessary data solutions.• Troubleshooting and Issue Resolution: Act as a technical lead and subject matter expert in diagnosing and resolving complex data engineering issues, ensuring smooth and uninterrupted data operations.• Test automation: Introduced TDD approach for building data pipelines which resulted in increased quality and efficiency. Created automated unit tests and integrated test pipelines which reduced the number of production bugs.• Software Engineering: Successfully designed CICD practices for the data team which saved more than 1000 person days over 2 years.• Training and Development: Developed training modules for new joiners/leavers which resulted in a more cohesive team. Coached team in agile practices and scrum way of working which improved the efficiency of the team.

Pune, Maharashtra, India

• Requirement Analysis and Stakeholder Engagement: Conducted joint requirements development sessions to thoroughly analyze project requirements with stakeholders.• Requirement Understanding and Validation: Ensured a comprehensive understanding of both functional and non-functional requirements to validate their alignment with desired business outcomes.• Data Processing Pipeline Development: Constructed a data processing pipeline utilizing Hadoop MapReduce technology, handling terabytes of retail data and integrating with data science tools to share processed output.• Web Application Design and Development: Designed and developed a web application using Java and the Spring framework, providing a robust and scalable solution for business needs. Contributed to the entire software development lifecycle, from concept to deployment.• Performance Optimization: Optimize application performance and performed troubleshooting on technical issues as needed.

Nagpur Area, India

• Data Source Integration: Developed code modules to connect to various data sources, including SOAP API endpoints, REST API endpoints, and database endpoints. Retrieved JSON, XML, List, and DBMS data, handled data streams, pagination, and inferred data schema.• ETL Solution Development: Developed Extract, Transform, Load (ETL) solutions to connect to over 50 data sources. Extracted, parsed, cleansed, and inferred data schema to facilitate effective data processing. Extensively worked on processing JSON, XML, and CSV data formats to extract meaningful insights and support business requirements.• Standard Practice Implementation: Introduced standard practices for code review, code coverage analysis, code quality analysis, and bug reporting to maintain high standards of software development and ensure deliverables meet quality expectations.• TDD and Code Reusability: Introduced Test-Driven Development (TDD) practices and promoted code reusability to enhance software quality and development efficiency.

Bhilai Area, India

• Web Crawling and Data Parsing: Developed web crawlers in Java to extract data from various review websites, utilizing regular expressions (regex) for data parsing. Saved the extracted data to a MySQL database using Hibernate for efficient storage.• Spring-Hibernate Web Application Development: Created a Spring-Hibernate web application that allows users to visualize the output of the data crawling process. Implemented jQuery charts and graphs to present the data effectively to the users.• Database Schema Design and Implementation: Designed the database schema, including creating tables, views, and triggers to support the application's data storage and manipulation requirements.• AWS Cloud Management: Managed AWS cloud services to ensure the scalability, reliability, and security of the application's infrastructure hosted on the cloud platform.• Version Control and Deployment Management: Maintained Git repository for version control, conducted code reviews, documented features, and managed the deployment process to the cloud environment.• Selenium Testing: Conducted Selenium testing to automate web browser interactions and ensure the functionality and performance of the web application across different browsers.

Mumbai Area, India

• Web Application Development: Developed a Struts-Hibernate web application, utilizing Oracle as the underlying database.• Testing and Debugging: Wrote unit tests using JUnit to ensure code quality and reliability. • Knowledge Sharing: Actively shared expertise and knowledge with team members, conducted code reviews, pair programming, and knowledge-sharing sessions to support skill development and collaboration within the team.