Rishi Deshpande Email & Phone Number

Herndon, Va, Us

Mclean, Va, Us

Mclean, Va, Us

• Owned an end-to-end data pipeline to validate financial ledger data for downstream processing using PySpark, Cassandra, AWS (Step-Functions, Lambda, EMR, SQS, Cloudwatch, SNS).• Developed and deployed near real-time data pipelines to detect and alert on unauthorized AWS production changes using Spark, Kafka, SQS, Postgres.• Developed and deployed near real-time data pipelines to correlate AWS API calls + enterprise incidents using Spark, Kafka, internal ML APIs, Postgres.• Developed and deployed numerous AWS Lambdas for data ingest, data producing, orchestration, and alerting work-flow capabilities.• Saved $15,000 per month on cloud operations costs for the team by replacing AWS services with internal APIs and right-sizing instances.• Upgraded Spark 2.4.8 codebases to Spark 3.3.0 which resulted in boosted performance; reduced data lag by 83%.• Implemented Flyway schema migration for Postgres RDS database; resulted in consistent schemas across environments and proper testing capabilities.• Lead the team through numerous successful enterprise disaster recovery exercise events.• Responsible for speaking with stakeholders on product requirements and being heavily involved in entire end-to-end development process.• Collaborated with other teams to architect data driven solutions for various use-cases, leading to higher organizational visibility.• Mentored junior developers, resulting in increased collaboration between peers; initiated conversations to improve existing technology.

Vienna, Virginia, Us

• Lead a team of 3 senior software engineers to maintain and optimize over 250+ near real-time data ingestion processes and pipelines.• Lead initiatives to refactor code to improve data ingest efficiency; fully integrated Kafka with pipelines, reduced latency by 80%.• Collaborated with other leads to architect data driven solutions for features and alleviate existing inconsistencies/manual processes.• Responsible for people management, technical development, task delegation/tracking, which resulted in strong team cohesiveness.• Guided team to meet shifting requirements and rigid deadlines through efficient prioritization and planning.• Regularly interfaced with executives by reporting and fixing ad-hoc data quality/integrity issues for their clients and real estate agents.

Vienna, Virginia, Us

• Built data pipelines that ingested and transformed large volumes of unstructured/semi-structured data to JSON for further processing.• Transformed and normalized data from numerous data APIs using a combination of TypeScript, Python, SQL functions, Shell scripts.• Implemented Postgres table partitioning, table index creations, schema migrations, routine analyzes to optimize querying downstream.• Deployed, maintained, and monitored Kafka producers, Kafka consumers, AWS SQS Producers on Kubernetes clusters.• Wrote Airflow/Cron jobs to dump data from Postgres to Snowflake, and copy down to lower environments for data consistency.• Built alerting to efficiently detect pipeline anomalies using Datadog, enabling issue response within minutes, considerably reducing emergency bug fixes.

Wellington, Fl, Us

• Implemented stored procedures and queries in SQL Server to transform and load structured data into different databases.• Ingested practitioner data from multiple websites with daily data scraping methods using C#, HTML5.• Gathered requirements and stayed in constant contact with clients and offered solutions on optimal data storage.

San Diego, California, Us

• Worked together with the marketing team to better understand what would improve the company’s website• Updated company records regarding old and new contracts with other business and government entities• Worked with the senior software engineer in implementing prototypes of new website designs, HTML validation, creating reports with the usage of SQL, and understanding how Git software would benefit the company in regards to workflow

• Worked with the marketing campaign for George Mason University.• Was part of the core team responsible for collecting funds for George Mason University regarding current and future developments to the university• Learned how to speak in a persuasive cohesive, and efficient manner to different clients

Bachelor'S Degree, Computer Science

Education record