Please complete the CAPTCHA to continue
@slack.com
✓
2 phones found area 217
✓
LinkedIn matched
A concise factual answer block for searchers comparing this professional profile.
Ashwin Shankar is listed as Senior Staff Software Engineer at Apple, based in San Francisco Bay Area, United States. AeroLeads shows a work email signal at slack.com, phone signal with area code 217, and a matched LinkedIn profile for Ashwin Shankar.
Ashwin Shankar previously worked as Staff Software Engineer at Slack and Senior Software Engineer at Netflix. Ashwin Shankar holds Master'S Degree, Computer Science from University Of Illinois Urbana-Champaign.
This section adds company-level context without repeating Ashwin Shankar's masked contact details.
AeroLeads found 1 current-domain work email signal for Ashwin Shankar. Compare company email patterns before reaching out.
With over 14 years of hands-on experience in software engineering, I bring expertise in big data infrastructure and distributed systems. Having worked with industry giants like Netflix, Slack and now Apple, I've spearheaded initiatives in managing and optimizing large-scale compute clusters, leveraging technologies such as Hadoop, Spark, Airflow, and AWS. I've orchestrated zero-downtime migrations, deployed cutting-edge technologies like Apache Iceberg, and led teams towards successful outcomes through technical leadership, fostering collaboration, and innovation. My academic background includes a Master's degree in Computer Science from the University of Illinois at Urbana-Champaign, where I honed my skills in Distributed Systems, Artificial Intelligence, and Cloud Computing.
Listed skills include Java, Hadoop, Cloud Computing, Distributed Computing, and 13 others.
Company context helps verify the profile and gives searchers a useful next step.
A career timeline built from the work history available for this profile.
Cupertino, California, Us
AI/ML Infrastructure - Building control plane for Apple Data Platform that supports Data and GPU workloads from Siri, Maps, Search etc. Technologies : Kubernetes, Crossplane, Flux, Go
San Francisco, California, Us
I had the opportunity to work on Slack's extensive data infrastructure, managing data in the warehouse (~200PB) and developing a platform enabling analytics, business metrics, offline search indexing, and fair billing pipelines as part of the Data Infrastructure team.1. Led AWS EMR, Hive Metastore, Spark and Iceberg at Slack: Managed and optimized 50+ federated EMR clusters at Slack, leading successful migrations from EMR v5 to v6, Spark from v2 to v3, and Hive Metastore from v2 to v3, resulting in a 40% cost reduction and performance enhancements of up to 80%. Additionally, spearheaded the deployment of Apache Iceberg, significantly bolstering query performance.2. Managed Apache Airflow Infrastructure: Scaled airflow infrastructure from a single node to a cluster, enabling the handling of 1,000+ DAGs and 150k tasks daily. Led multiple Airflow version upgrades, including Python migration from 2 to 3 with zero downtime and minimal disruption. Deployed Airflow on GovCloud for US government customers. Published tech blogs about it(links attached).3. Implemented S3 cost optimization at Slack by creating an automated tool. The tool detects and removes unused Hive tables, sending alerts and saving millions of dollars. It also cleans up orphaned datasets on S3 without associated tables.4. Held key roles in incident management at Slack, serving as an incident responder, commander, and post-mortem facilitator. Responded to incidents promptly, conducted blameless post-incident reviews, and drove architectural improvements.
Los Gatos, Ca, Us
Big Data Infrastructure: Played a pivotal role in shaping and evolving Netflix's data platform from its early stages to the industry-leading data platform it is today and scaled it to handle 150 million subscribers. Led the development, testing, and management of large hadoop clusters(4k nodes) on AWS. The cluster was responsible for running Spark and MapReduce workloads on YARN, storing and processing Netflix's extensive data (~100 Petabytes) used for movie recommendations, the Netflix UI, and driving business decisions.1. Fair Scheduler Dynamic Hierarchical Queues: Implemented automatic creation of nested user queues through code contribution to YARN-1864. This enabled fair resource sharing among users ensuring cluster resources were allocated fairly.2. Queryservice-lite(fast computation for interactive queries): Designed and implemented a session-based approach for spark queries per user to optimize resource usage, improve computation speed through caching, and prevent starvation of short running queries. Developed a long-running multi-threaded process with a GRPC interface for incoming requests.3. Node labels(fair scheduler): Implemented node labels for cluster shaping, allowing the scheduling of containers with specific requirements on appropriate node types.4. Spark on containers: Developed a new scheduler for Spark to run on Netflix's internal docker container runtime platform, Titus. This implementation enabled batch workloads, streaming, running custom images (for custom Python environments), and notebooks.5. Migration, testing(correctness/performance/stress): Migrated from Hadoop-1 to YARN.Transitioned from Amazon EMR to an in-house Hadoop cluster deployment. Orchestrated instance type migrations from smaller servers (m1.xl) to more powerful machines (d2.8xl). Responsible for testing correctness, performance, and stress of the migration processes.Conference talks(links attached): presented at Spark Summit, Hadoop Summit, Apache Bigdata
Sunnyvale, Ca, Us
Hadoop YARN development - part of hadoop-core-dev team at Yahoo, I contributed thousands of lines of code to hadoop-2.0. I developed the admin interface for Job history server which includes CLI, RPC layer (Protocol buffers), Proxies, protocol messages, security features.
San Jose, Ca, Us
I played two roles - I lead 3 three teams and wrote code. I joined Cisco as a fresh undergraduate.I started off my career building a product from scratch called 'Cisco MediaSense'. After spending a complete SDLC in this product, I moved into another product called 'Cisco Customer Voice Portal'. When I was 1.5 years old in the industry, I started leading three teams. Overall, my work here ranged from building Open Web 2.0 Apis, cool Web-apps using Spring MVC to Automation Infrastructure integration, writing Automation suites and leadership.
Quick answers generated from the profile data available on this page.
Ashwin Shankar works for Apple.
Ashwin Shankar is listed as Senior Staff Software Engineer at Apple.
AeroLeads has found 1 work email signal at @slack.com for Ashwin Shankar at Apple.
AeroLeads has found 2 phone signal(s) with area code 217 for Ashwin Shankar at Apple.
Ashwin Shankar is based in San Francisco Bay Area, United States while working with Apple.
Ashwin Shankar has worked for Apple, Slack, Netflix, Yahoo, and Cisco Systems.
You can use AeroLeads to view verified contact signals for Ashwin Shankar at Apple, including work email, phone, and LinkedIn data when available.
Ashwin Shankar holds Master'S Degree, Computer Science from University Of Illinois Urbana-Champaign.
Ashwin Shankar is listed with skills including Java, Hadoop, Cloud Computing, Distributed Computing, Virtualization, Big Data, Software Development, and Agile Project Management.
Search by job title, company, industry, location, and seniority. Export verified B2B contact data when you need it.
Start free trial Search contacts