The Legg Mason Enterprise Data Warehouse is data warehouse used by client to generate different types of reports for analysis their investment and risk. We are using AWS services and infrastructure to migrate the data from multiple sources like Salesforce, Wiser, Lipper, Informatica, Adobe and TAOS. To ingest the data into S3(staging) from different sources we using SQOOP and flume as an ingestion tool. Before implementing our business logic on the data, we used to perform some quality checks. After completion of quality checks, we implement our business logic using Spark Scala framework and dump the final data into the data warehouse layer in S3.

The Accounting Subledger system is the core banking solution in Deutsche bank to account for transactions, valuations, settlements, adjustments coming from various upstream (GMI Sun guard, Bloomberg, CB Imagine, Imagine GED, BRDS) for which the postings are generated to be accounted for while calculating the balances. The data from different upstream sources are imported to HDFS (Staging area) using flume and SQOOP. To generate the posting, the data needs to go through complex business logic written in Pig and Hive. After performing the business logic, the processed data is stored at the Data store layer from where we generate the reports using hive for the end user.