Varun Rao Email & Phone Number

New York, Ny, Us

Lake Success, Ny, Us

Leading all things Google Cloud

• Founded a consulting agency specializing in advisory based services and hands-on implementation work in the areas of Data and Generative AI• Specialized in building end-to-end data platforms (Data Lakes, Data Warehouses, and Data Lakehouses) and all areas of the data lifecycle (data ingestion, data transformation, data governance, data quality and data observability). • Expert in building data platforms on Google Cloud. However we have experience doing work across all cloud providers (AWS, Azure and Databricks)• Led all areas of the Professional Services lifecycle starting from marketing, sales, scoping of work, pricing of deals, building data pipelines, project planning and support• Extensive experience partnering with large consulting firms • Scaled the business to 6 engineers and led a team of Data Engineers to build data platforms and Generative AI efforts for over 20 clients ranging from small business to Fortune 50 corporations• Oversaw engineering teams (nearshore and U.S.-based), recruitment, payroll, deal pricingFew Clients We Have Worked With: Hewlett Packard Enterprise, World Wide Technologies, Experian, General Motors Financial, Centene, Univision, Samsara

New York, Ny, Us

Building out data engineering pipelines and backend services for the Pricing Team as part of the Per Security Business Unit

New York, New York, Us

• Creating Python applications to process data from APIs / databases. (Python 3.8, Linux, Pandas)• Designing of database schemas, S3 file structures in a data warehouse (AWS Athena, Hive)• Tuning and writing PySpark code which ingests up to 20 GB of data. Reduced run time of jobs from several hours to less than 15 minutes.• Reading data from RDBMs’ into HDFS using Sqoop and processing data using PySpark• Created and architected internal library used by developers to reduce complexity of creating Spark jobs. (Pyspark, AWS EMR, Python 3.8)• Designed solutions for archiving data in S3 for cost saving (AWS S3)• Built applications ground-up to be scheduled on Airflow / migrated existing applications to Airflow • Wrote AWS CloudFormation Scripts which create different flavors of EC2 instances, set up auditing capabilities on CloudWatch for each EC2 instances

Santa Clara, California, Us

Clients Include: GlaxoSmithKline, Pratt and Whitney, Synchrony Bank, Bank of America, JP Morgan Chase• Built DevOps system which automates setting configs for services on Cloudera Manager using Cloudera Manager API / Python 3.6 / Bash. Currently this system is used to enable LDAP, SSL and to set other Hadoop related configs on Cloudera Manager UI • Upgraded HDP using a lift and shift strategy. Setup meetings with team leads to give advice on code changes, to understand SLAs of their applications and to assess amount of data that needs to be migrated. Came up with a plan on how to migrate their data to their newly upgraded clusters• Migrated Microsoft SQL Server to Apache Hive• Built POCs to analyze database transactions in order to provide an audit trail about missing data

Santa Clara, California, Us

• Built a web application for my cultural organization that currently handles over 100 + users. Built using HTML, CSS, Javascript, Jquery, Flask, Uwsgi, MySQL. • Administrator of Ubuntu Server.• Wrote blog posts• Raised 1600 dollars for flood relief in India

Chicago, Il, Us

• Built python app that sends messages on Slack when repository hygiene wasn’t met using Slack API• Built a web application using Python, Flask that automates the configuration of repositories on GitLab using GitLab API. This would trigger pipelines and create AWS resources. This system is currently still in use• Open Source Contributor to Foremast: added feature which enables Chaos Monkey on Spinnaker using Python• Exposed to the Continuous Integration life cycle, Jira, Agile Methodologies, sat in on Code Reviews, participated in stand ups and worked with Git in a team environment