Bi Developer
Istanbul, Turkey
- Lead BI Developer, Scrum Team Member.- End to end design and implementation of DWH,ETL and OLAP.Main responsibilities:- Created databases and schema objects including tables, indexes, stored procedures and functions as a part of DWH development.- Built SSIS packages and scheduled jobs to migrate data from disparate sources into SQL server and vice versa- Performed root cause analysis on failures. Resolve performance tuning related issues and queries- SQL tuning, ETL tuning, OLAP Memory & CPU Optimization.- Wrote SQL queries to aggregate data such as profit margin, cost per sales, revenue per Sales.- Creation of analytic reports based on the design in SSRS and Power BI.- POC studies for system updates.- Worked on Microsoft Team Foundation Server (TFS) and Git.-Transfer of data from OLTP to Big Data Cluster with ETL operations (sqoop). Processing of raw data from OLTP and preparing datamart tables (spark, impala, hive). Integration of these data into DWH systems (sqoop, airflow).Information about analitic systems used:DWH- SQL Server 2017- AlwaysOn(2 node)- 40+TB data size.- 400+ table.- 75,000+ transactions per second during peak period.- 700+ unique users.- 2 Billion + row data manipulation every day.- Table partitioning- Columnstore Index- Kimball ModelBigData Cluster-Cloudera cdh6.3.0-1 Edge, 3 Master, 11 Data Node-5760G Ram-984 Core-1,6 PB DiskMultidimensional OLAP Cube- SQL Server 2012- High Availability & Scalability (2 node)- 10+TB data size.- 1000+ unique users.- 1.2 seconds average response rate.Tabular OLAP Cube- SQL Server 2016- 80+ tabular project.- Separate servers for process and presentation.- Custom framework for Schedule, Process and Sync.