Worked on spark migration and optimisation for 30+ jobs . Currently building scalable aws architecture for data integration

CarelonRx Data & Analytics * Implemented Scala ,AWS, Spark based applications to process data generated by elevance health members and claim processing data in monthly kill and fill batch processing.* Built scalable applications with distributed architecture using big data tech stack like Spark, Elasticsearch and Amazon S3, EMR to process the data in Tera bytes and load the data into elastic search which is the upstream for Rxguide dashboard.* Worked with Spark SQL to debug the production bugs and correcting the dashboard logic as per the mapping from Product Owner.* Responsible for migration of spark 2 to spark 3 jobs in aws data lake environment.* Implemented data archival of monthly refresh jobs.* Implemented the spark sql for writing the transformation logic between source to target for different portlets as per the mapping provided by product owner of Rxguide dashboard for example High cost claimants(HCC) portlet ,to process the data in emr and load it in elastic search monthly index.* worked closely with Architect and engineering managers of Rx Guide in performance optimisation of time taking spark jobs.

Healthcare Domain Analytics