- Created and maintained Spark (Scala, Hadoop) data reconciliation pipeline that ensured data integrity post-migration across diverse enrollment and billing systems. Utilized YARN for Spark job submissions and HDFS (Cloudera Data Platform) for storage. Optimized performance by over 50% through efficient design, spark tuning, and SQL tuning. Engineered and refined custom ingestion procedures for JDBC sources, MongoDB, and various file formats to automate workloads. Orchestrated CI/CD processes with sbt, Jenkins, and Artifactory. Collaborated closely with cross-functional teams to deliver and bussiness solutions, contributing significantly to product success. - Implemented automated reporting and alerting on Spark job end (Scala, REST), which submitted tickets to designated teams to ensure timely identification and resolution of issues. - Designed and implemented services to automate migration of complex data source configurations between environments, accelerating deployment cycles and testing procedures (Java, Go).

Developed Scala Akka backend for no-code interface for users to profile and Spark transformations on healthcare data stored in a data lake. (Scala, Apache Spark).Built Scala Akka Microservices to run and manage ETL workflows.Transformed NPI data into SQL tables to be easily used by healthcare workers. Used Spark and Scala.Created Nodejs backend for a React web app that allows authenticated users to configure (a) data from database and (b) corresponding Spark transformations to run on said data. (GraphQL, Apollo Server, Postgres).

For an Honors Capstone project under the direction of professor Luís Pina, developed a prototype for a webapp that allows UIC students to automatically add courses to digital calendars.

Tutored and assisted graduates and undergraduates in systems design concepts in C. Topics included symbols, dynamic and static libraries, virtual addresses, processes, I/O multiplexing, and concurrency. Projects included a custom shell, a custom garbage collector in C for C, a web server, and a web-based HTTP chat server.