Senior Data Mining Engineer
Current• Worked with senior clients to identify their business problems and developed AI based solutions.• Developed machine learning models and algorithms with Python, R and Spark MLlib for a variety of business scenarios like User Profiles, Smart Home, 5G, Risk Management and Social Network Analysis over three hundred million customers. • Identified the data source requirement for modelling and coordinated data engineers to prepare the data set for training and testing. • Processed large-scale data up to PBs with HIVE and SparkSQL for filtering, anomaly detection and transformation. Proficient in SQL optimization.• Deployed and integrated models into offline production environments on a large-scale cluster. Built machine learning pipelines. • Used spider tools to crawl website information and stored them properly in relational database. • Frequently communicated and presented data insights and model key metrics to clients to improve their business.• Responsible for construction of department's data mining team. Mentored junior data mining engineers. Tracked and researched cutting-edge artificial intelligence technology.
