Back End Engineer scaling data processing systems.

Scaling up data processing pipelines by tuning database queries and building a Data Lake. Production scaled to successfully process daily volume in millions of records, without outages and delays because of the data lake migration. Working on re-architecting storage and retrieval of big data.

Lead transition of cloudknox product into Microsoft CIEM in the 2021 to June 2022 timeframe. Built on cross cloud knowledge to solidify my Azure, GCP and AWS Expertise. Currently SME for core data processing platform and reporting platform too - scaling them for the largest clients in the world with 100X growth in data. Mentoring junior engineers to make them productive. OnCall and bug fixes for critical issues. Contributing to API access to this gold mine of cloud security data. Helping with transitioning technologies (e.g. Postgres to NoSql and JVM based to C#/ DotNet). Implement domain specific analytics and for CIEM e.g. inactive identities , unused roles.

Scaled the data engineering infrastructure at CloudKnox with its growing data volume and changing business needs. Prototyped multiple ideas. Lead the development of the reporting engine, including the most popular report (Privilege Analytics Report). Developed a flexible yet powerful framework to build out report data for this report. Supported and mentored junior engineers, growing the team's capabilities as the startup grew.

Lead the platform team and worked with execs to support new initiatives while delivering results on current work. Recognized the weaknesses of the system (many ad hoc data transfers) and over time lead the development a data bus of sorts that spanned many services (and front end) - decreasing the development time of new features by 50%.

Technical leadership of local and remote teams - architect , design and build out new systems while maintaining and extending current ones. Break monolith into micro services. Build out a data bus.

Interface between development and customer facing (professional services) people, guiding the business growth of the new system. Used my knowledge of the systems, understanding customer needs and figure out how to better meet them.

Lead small teams to build out the prototype into Pilots in critical areas, convert these into production ready systems. Lead the message parsing library development and a few other critical components

R & D into existing Java / Enterprise Service Bus based portal - to study ways to make onboarding new deals faster. After much study, recommended that it be replaced in parts (no big bang) rather than updating it. Was part of the team that studied and researched various technologies before settling on Scala / Akka.

Developed / maintained parts of the Earth Science Data system for NASA. * Large data volume - 1 petabyte in 2008 * Diverse mix of technologies - C/C++, Java, J2EE, XML, Tomcat and other java based components (like JSF), Python, Sybase * Worked in all areas of the SDLC - Development, Architecture, Testing (was the integration lead for critical projects), even Systems Engineering.