Jerry Wei Email & Phone Number

Bentonville, Arkansas, Us

Project OverviewSearch BigData system consist of various features including indexing pipeline, ETL process, signalpipeline and analytics pipeline. This system manages all data for Merch Modules, Lefthandnavigation, Polaris cloud query creation, Spellcheck, Highlight, and various other search businesslogic.Role and Responsibilities• Implement ETL job using Python to process user behavior data including clicking, check-out and query on Walmart site and load those data into HIVE tables after doing respectiveaggregation.• Implement NRT processor with Spark to generate index document.• Implement python job to generate different signal and persist the results into K-V store.• Migrate job to Airflow for dynamic pipeline generation and higher scalability and bettermonitoring as well.• Come up with Dashboard on Graphana for the purpose of monitoring the status of pipelines.• Implement python job to trigger Spark batch job to download product information from Cassandra DB.• Implement processor to consume the frequently updated product/item event from Kafka topicand update the index accordingly and persist it into Cassandra database.• Persist the Kafka event log into ElasticSearch and generate dashboard on Kibana for monitoring and analytics.

Bentonville, Arkansas, Us

The ODS is a cumulative data repository that associates and stores customer order fulfillment operational events and their associated data. This provides a common platform that represents a single source of truth derived from the various authoritative product-based data stores, and serves to alleviate load on production-level data stores, enable direct access to multiple sources of data, facilitate real-time analytics and business intelligence. Individual events are captured from the CP Event Bus and combined/denormalized and recorded in manner that supports efficient querying for ad hoc analyses and to drive dashboards and other reporting mechanisms.Role and Responsibilities• Develop the Spouts and Bolts within Storm to consume the order events and purchase order events from Kafka topic.• Update/Insert aggregated record data into ElasticSearch after processing some filtering, combination and aggregation.• Develop a event watcher to notified the Kafka producer to send a new message to event store Kafka Topic.• Redefine the DB table structure and persist the record sourced from Kafka event store Topic into oracle database for better visualization and query functionality.• Commit the changes into remote Git repository after building successfully with Maven and performing UT, then processing deployment in lower environment via OneOps.• Come up with Dashboard on Kibana for the purpose of monitoring the status of orders/POs and alarm the issue in advance.

Bentonville, Arkansas, Us

• Involved in Requirements gathering, analysis and design and documentation as the application exposed many new feature. • Analyze, design, development of software systems to form a basis for the solution of information processing problems. • Responsible for analysis of current programs including performance, diagnosis and troubleshooting of programs presenting challenges and design solutions to overcome such. • Designed and developed Web Services (Restful) .Created and compiled XML Schema to generate Java Bean classes using Jersey and Jackson.• Develop core Java programs for all business rules and workflows using spring framework• Re-factor existing code structure to separate core business logic and Data Access Objects (DAOs). • Extensively used Oracle SQL Developer graphical tool for the enhancement and simplification of Database Development task. • Developed Exception handling code to recover from DB specific, Application specific, Business and Non-business logic specific exceptions.• Involved in creating test cases using Junit for Java classes and Abstract spring dependency Injection test for spring beans. • Performed a thorough unit testing and resolved several data related issues before migration to production.

Responsibilities• Provide effort estimation according to business requirement & function requirement to Onsite.• Involve in gathering, analyzing and documenting business requirements, functional requirements and data Specifications for application development. • Summarize the requirement as one diagram with business flow information and distribute these knowledge to team• Involve in design, configuration, development and bug-fixes. • Provide recommendations to management concerning issues of programmer productivity and software development management. • Provide technical solution for implementing Webservice and IBM MQ and write down all detail information in the Technical Design document.• Provide technical solution for some Web attack issue(XSS, Information leakage, etc.) found out with tool veracode • Review the Technical Design document for other requirements prepared by other team member• Develop/program new functionality and features in line with functional specifications and business requirements.• Develop core Java programs for all business rules and workflows using spring framework.• Exported web services using soap Spring support. Extensive experience in production support. • Extensively used "IBatis" in data access layer to access and update information in the database • Conducted code reviews against coding standards and made sure the best practices are maintained in development process.• Check in all updated codes into starTeam (Version control tool)• Responsible for mq configuration on dev server• Build codes and deploy the updated Disability application on dev server• Review test case and track the testing progress• Lead team to provide high quality deliverable and provide support for qa, uat testing• Provide knowledge transition to new member and other team

Responsibilities• Design the functionality with sequence diagram and class diagram by using tool Rational Rose.• Developed the UI Screens using JSP, JavaScript and HTML and did the client side validation with the JavaScript.• Involve in design, configuration, development and bug-fixes. • Extensively used Hibernate in data access layer to access and update information in the database.• Used Spring IOC (Inversion of Control) to remove the object dependencies across the application.• Involved in writing PL/SQL stored procedures using PL/SQL Developer.• Tested, debugged and implemented the application using JUnit for unit testing.• Used log4j for tracking errors and debugging the code.