Software Engineer（Data Development And Scoring）
Current- Design, develop and maintain ETL pipelines to gather data from more than 50 data sources to our huge data warehouse.- Manage ETL workflows to ensure the proper data is flowing through to the daily/weekly build. Modify and enhance the existing data loading and mapping logic to meet the raw data content changes.- Migrate data between production databases and development databases or for production-level services, both as batch operations or real-time streaming.- Improve data quality generated automatic internal alerts and reports to monitor data quality and statistics.- Perform and document all phases of the file analysis for data related projects including general data profiling, content quality testing, referential integrity verification.
