Our team was responsible for ingesting data into an event-based data warehouse. We were working at terabyte scale, tens of data sources, thousands of Kafka’s topics. The key technologies were Kafka, Azure, Kubernetes, Java. My responsibilities included conducting recruitments, interfacing project’s status to middle management, maintaining backlog, setting product’s priorities for the next 3-6 months, maintaining kafka and kubernetes clusters, setting up monitoring and logging, fixing bugs in Java applications.

My key responsibility was cost reduction of big scale Azure cloud in-frastructure. The work involved introducing spot/reserved instances onproduction and optimization of scaling time, CPU utilization, resourceusage and backend algorithm which was written in Java. Additionally,I was responsible for providing a complex, maintainable, reliable CI/CDpipeline which was implemented in Jenkins/Groovy.

I was responsible for implementation, testing and CI/CD of cloudsystems for IoT devices. We used Java/Spring on the backend andDocker/Kubernetes to manage containers which were deployed on AWSand Azure.

I worked on Traffic Stats which provides insights into the traffic situation onthe road network throughout the day. We used Java/Spring on the backendand AWS for the infrastructure.