March 2, 2022
Distributed Systems System Design Interview
University Courses / Lectures
- Princeton COS418 Distributed Systems Lectures
- Stanford CS244b Distributed Systems Lectures
- Illinois CS425 Distributed Systems Lectures
- University of Washington CSE452 Distributed Systems Lectures
- University of Washington CSEP552 PMP Distributed Systems Lectures
Online Courses
Research Papers
- The Google File System
- Large-scale cluster management at Google with Borg
- The Google File System
- Spanner: Google’s Globally Distributed Database
- Spanner: Becoming a SQL System
- Spanner, TrueTime and the CAP Theorem
- Bigtable: A Distributed Storage System for Structured Data
- MapReduce: Simplified Data Processing on Large Clusters
- MapReduce/Bigtable for Distributed Optimization
- The Chubby lock service for loosely-coupled distributed systems
- Web Search for a Planet: The Google Cluster Architecture
- Raft: In Search of an Understandable Consensus Algorithm
- Raft: In Search of an Understandable Consensus Algorithm (Extended Version)
- Cassandra – A Decentralized Structured Storage System
- Kafka: a Distributed Messaging System for Log Processing
- Dynamo: Amazon’s Highly Available Key-value Store
- Practical Byzantine Fault Tolerance
- ZooKeeper: Wait-free coordination for Internet-scale systems
- Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing
- No compromises: distributed transactions with consistency, availability, and performance
- Scaling Memcache at Facebook
- Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications
- Frangipani: A Scalable Distributed File System
- The design of a practical system for fault-tolerant virtual machines
- Object Storage on CRAQ
- Amazon Aurora: Design Considerations for High Throughput Cloud-Native Relational Databases
- Don’t Settle for Eventual: Scalable Causal Consistency for Wide-Area Storage with COPS
- Bitcoin: A Peer-to-Peer Electronic Cash System
- Blockstack: A New Internet for Decentralized Applications
- Experiences with a Distributed, Scalable, Methodological File System: AnalogicFS
- Storm @Twitter
- The Hadoop Distributed File System
- Dapper, a Large-Scale Distributed Systems Tracing Infrastructure
- Thrift: Scalable Cross-Language Services Implementation
- Impossibility of Distributed Consensus with One Faulty Process
- Paxos Made Live – An Engineering Perspective (2006 Invited Talk)
- Photon: Fault-tolerant and Scalable Joining of Continuous Data Streams
- Maglev: A Fast and Reliable Software Network Load Balancer
- Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google’s Datacenter Network
- BwE: Flexible, Hierarchical Bandwidth Allocation for WAN Distributed Computing
- A Fast, Minimal Memory, Consistent Hash Algorithm
- Semantics of Caching with SPOCA: A Stateless, Proportional, Optimally-Consistent Addressing Algorithm
Books
- The Datacenter as a Computer
- Building Secure & Reliable Systems
- The Site Reliability Workbook
- Site Reliability Engineering
YouTube Videos / Playlists
- MIT 6.824 Distributed Systems Lectures
- CSE138 Distributed Systems Lectures
- Distributed Systems Course from Chris Colohan
- System Design Interview from Mikhail Smarshchok
- System Design from Gaurav Sen
- Distributed Systems in One Lesson by Tim Berglund
- Mastering Chaos – A Netflix Guide to Microservices
- ETL Is Dead, Long Live Streams: real-time streams w/ Apache Kafka
- Scaling Instagram Infrastructure
- Building Software Systems At Google and Lessons Learned – VIDEO
- Zoom System Design
Other Resources
- System Design for Tech Interviews
- NGINX Glossary
- Non-Abstract Large-Scale Design Workbook
- Latency Numbers Everyone Should Know
- Google SRE Classroom: Distributed PubSub Handout
- Google SRE Classroom: Distributed PubSub Slides
- Certificate Transparency
- Transparent Logs for Skeptical Clients
- The Go Memory Model
- Ephemeral Volatile Caching in the cloud
- The Netflix Tech Blog
- How Complex Systems Fail
- Building Software Systems at Google and Lessons Learned – DOCUMENT
- Scalable Web Architecture and Distributed Systems
- Crack the System Design Interview
- System Design Cheatsheet
- System Design Preparation
- System Design Interview
- Distributed Log-Processing Design Workshop
- Distributed Systems Reasoning
- SRE Classroom
- Zoom System Design
- System Design Template
- System Design
- System Design Primer
- Introduction to architecting systems for scale
- The Hidden Dividends of Microservices
- Cap’n Proto
- JSON-RPC
- Distributing Software in a Massively Parallel Environment
- Linearizability versus Serializability
- Consistency Models
- How to beat the CAP theorem
- Questioning the Lambda Architecture
- A database clustering system for horizontal scaling of MySQL
- Massively Scaling MySQL Using Vitess
- Vitess: Scaling MySQL at YouTube Using Go
