Backend Software Engineer, Risk Technology
Current• Designed and developed a Spark Aggregator tool using Scala, Hadoop, Spark, Servlet and store data on Snowflake datatalake, Hive using databricks tools and SQL, code analyzed on SonarQube and built by TeamCity, deployed by chef and nolio, calculated data consumed by Market Risk Analysts and Front office Margin Traders• Designed and developed VaR Systems and transmit (ETL) risk data feed using Solace for both regulators and front office in a finance setting using React Webapp, Tableau and Power BI, perform data analysis to generate business insights. Conducting PySpark, AWS EMR, BigQuery and Akka to orchestrate the ETL process and cost benefit analysis, Implemented and utilized C++ Historical Simulation algorithms library• Support critical data processes running in production, Architect, implement and deploy new data models and data processes in production, which leads to an 80% decrease in the cost of Cloudera.• Build data expertise and own data quality for allocated areas of ownership and Manage data warehouse plans for a product or a group of products using metadata and Data Catalog