Data Architect & Manager
Irvine, Ca, Us
Project Highlights:AI Match in the Cloud: Transform on-premise AI Match to server-less architecture in Google Cloud Platform. - Technology: Tensorflow Keras, AI Platform, BigQuery, PubSub, CloudFunction, Dataflow, Python, ReactJS, Apache Beam.AI Match on-premise: Work with data scientist build full ML based process to identify candidate to job ad match with fully functional front-end app for beta testers to use. Utilizing Apache Kafka to stream the performance on each stages of the pipeline to analyze bottleneck. - Technology: Tensorflow Keras, Redis, Python, Docker, Scala, ReactJS, Apache KafkaDockerized ETL microservices: extract data from SQL Server and OrientDB and transform the result for ease of reporting. - Technology: Node.js, Docker, OrientDB, MSSQLSpam Resume Classifier: Worked with data scientist to build prediction service that will identify when a consulting company applies to our jobs. - Technology: Apache Spark, Scala, Random ForestResume Classifier: POC project to clustering resume skill terms and feed the cluster labels back to supervised ML. - Technology: Apache Spark, Scala, Random Forest, Gradient Boosted Tree, Latent Semantic Analysis, Word2VecRestful API to to search against jobAd and text based resume in Solr Clusters. - Technology: Scala, Spray FrameworkResume Content Extractor: parallel data pipeline to extract text content from various document type of resume and feed into solr cloud search cluster. - Technology: Python, MSSQL, Apache Tika, SolrCloudResponsibilities:-Take charge of R&D development with data scientist on various data driven machine learning projects.-Managed Solr's master/slave cluster to power the cybercoders.com's search functionality.-Taking full ownership over the mission critical MSSQL database servers for the company.-Managing the SQL engineers and provide support over data questions.