Research on Distributed Reinforcement Learning (MARL) for scalable control of Networked systems, with Professor Na Li.Paper accepted to American Control Conference (ACC) 2024.

Part of the Diagnostics and Data Management team, projects included• Automatic outlier detection in time series data.• Building ETL analysis-pipelines including SQL querying, unit tests with mocking and feature engineering as well as writing documentation.• Holding Machine Learning workshops on optimization, clustering, Neural networks and more.• Working with SQL (clickhouse, psql), Tensorflow, docker, pandas, rest apis.

• Deployment and evaluation of a code search and code intelligence tool.• Working in Linux with Docker, Ansible and Artifactory.• Writing custom helper services in Python including logging, tests and documentation.• Git version control and code review with Gerrit.