Lead Data Warehouse/Bi Engineer
- Providing SQL BI/data warehouse consulting service to multiple clients for their marketing campaign solutions.• Design from scratches, maintain, and add new features to existing DW/BI systems for multiple clients. Communicate with clients collecting new requirements, translate into technical design, document data modeling and dictionary, and build relational diagram. Coordinate with team members in agile project development to identify daily development obstacles, and define the short term work load.• Write complex store procedures and functions, work on performance tunings, review index usage, and work on large table partitioning (sliding windows scenarios). Stay tuned in new database technologies.• Create SSIS to load multiple source data (flat, xml, excel files) to staging tables, and process them into data warehouse. Worked on loading decrypted data between different database platforms (SQL Server and Netezza) in a secure channel. Provide transparent data layer to data analyst. Created ETL monitoring tools to identify deadlock queries, long running queries, erroneous data rows, as well as guarantee data flow in a quick and accurate way.