Distributed Systems Foundations
Replication, Partitioning, and State Placement
Core mental models for coordination, failure, time, load, contracts, and operational trade-offs in distributed systems.
CURRICULUM
16 classifications / 191 tracks / 12 roadmaps
Replication, Partitioning, and State Placement
Core mental models for coordination, failure, time, load, contracts, and operational trade-offs in distributed systems.
CLASSIFICATIONS
[15 TRACKS]
[14 TRACKS]
[20 TRACKS]
[15 TRACKS]
[7 TRACKS]
[14 TRACKS]
[10 TRACKS]
[13 TRACKS]
[11 TRACKS]
[12 TRACKS]
[10 TRACKS]
[11 TRACKS]
[16 TRACKS]
[5 TRACKS]
[8 TRACKS]
[10 TRACKS]
TRACKS
Designing coherent cloud service platforms through deliberate boundaries, traffic policy, workload placement, shared control surfaces, and progressive delivery.
Frame system designs from product promises, constraints, coordination scope, and failure behavior, then turn the reasoning into reviewable architecture decisions.
Outside-in backend design: API contracts, trust, layered request flow, persistence and data-shape boundaries, failure semantics, schema governance, and compatibility gates.
Socio-technical design for software delivery: team boundaries, ownership, flow, platform interfaces, delivery metrics, governance, and operating cadences.
Long-running workflows, compensation, scheduling, visibility, and the engines used to coordinate business processes across services.
Domain modeling, bounded contexts, service boundaries, and the trade-offs behind carving systems around capabilities rather than endpoints.
Isolation models, noisy-neighbor control, tenant routing, billing boundaries, and the platform trade-offs behind multi-tenant systems.
Internal platform adoption, paved roads, platform economics, and product thinking for developer-facing infrastructure teams.
Practical backend engineering foundations: internet requests, language/runtime choices, databases, testing, deployment, and operational basics.
Container runtime mechanics, image delivery, Kubernetes workload primitives, networking, storage, autoscaling, PDBs, service mesh sidecars, security profiles, and platform operations for backend services.
Problem selection, user discovery, product wedges, MVPs, pricing, distribution, metrics, and small-team execution discipline.
Practical judgment for builders: simplicity, leverage, maintainability, debugging, naming, review, and the craft of choosing what not to build.
Hack useful ideas together quickly without losing the engineering thread: CLIs, scripts, APIs, local tools, iteration loops, and prototype discipline.
Advanced API protocol mechanics for backend systems: HTTP/2, HTTP/3, TLS 1.3, gRPC streams, GraphQL execution, gateway policy, binary encodings, and contract evolution.
Terraform-style infrastructure workflows: desired state, state files, modules, drift, policy gates, CI/CD, GitOps, cost controls, and rebuildable cloud environments.
Complexity Dynamics And Control
Foundational systems-thinking lenses for reasoning about interaction, feedback, emergence, adaptation, boundaries, and bounded prediction before deeper modeling, control, and simulation tracks.
Complexity Dynamics And Control
Rule-based simulations, emergence from local behavior, and agent-scale experimentation.
Complexity Dynamics And Control
Cellular automata, network dynamics, cascading behavior, and emergence in structured systems.
Complexity Dynamics And Control
Stocks, flows, calibration, validation, and causal reasoning for system-level decision support.
Complexity Dynamics And Control
State-space thinking, bifurcations, attractors, oscillation, tipping points, and the dynamics behind sensitive system behavior.
Complexity Dynamics And Control
Selection, adaptation, evolutionary game dynamics, genetic search, and the mechanisms that change strategy populations over time.
Complexity Dynamics And Control
Entropy, mutual information, transfer, encoding, and complexity measures for understanding how structure and uncertainty evolve in systems.
Complexity Dynamics And Control
Local rules, emergent structure, spatial computation, and the simple update systems that generate surprisingly rich patterns.
Complexity Dynamics And Control
Controllers, stability, delay, observability, and feedback design for complex technical and socio-technical systems.
Complexity Dynamics And Control
Critical points, scale changes, self-organization, and the regime shifts that explain why systems can transform abruptly.
Complexity Dynamics And Control
Centrality, diffusion, contagion, percolation, and the structure of networks as systems that transmit influence and failure.
Complexity Dynamics And Control
Strategic interaction, equilibrium concepts, incentives, and the feedback between competing agents in adaptive systems.
Complexity Dynamics And Control
Control, communication, observers, self-maintaining systems, viable organization, and the strange discipline of studying systems that include the observer.
Complexity Dynamics And Control
Synthetic life, digital evolution, self-replication, artificial chemistries, open-ended novelty, and models that ask what life could be.
Complexity Dynamics And Control
Scale invariance, fractal geometry, heavy tails, allometry, renormalization intuition, and the warning signs of systems without a typical size.
Complexity Dynamics And Control
A practical modeling track for turning complex-system questions into toy models, simulations, sensitivity analysis, validation, and reproducible reports.
Complexity Dynamics And Control
How systems tolerate shocks, degrade gracefully, reorganize after disturbance, and balance efficiency against survival.
Complexity Dynamics And Control
Markets as interacting adaptive systems: heavy tails, volatility clustering, herding, order books, agent-based markets, and systemic risk.
Complexity Dynamics And Control
Prebiotic chemistry, autocatalytic sets, hypercycles, compartments, information, metabolism, and the transition from chemistry to evolving organization.
Complexity Dynamics And Control
Kolmogorov intuition, compression, randomness, logical depth, causal states, epsilon machines, and formal ways to detect structure in processes.
Design usable product interfaces by tracing user pressure, system state, navigation, feedback, hierarchy, product promise, and reusable interaction patterns.
Composition, light, movement, editing rhythm, color, atmosphere, and visual storytelling for people who think in systems and scenes.
Read and write compressed language: image, rhythm, line, metaphor, voice, translation, ambiguity, and aesthetic judgment.
Physical product thinking: affordances, ergonomics, materials, manufacturing, repair, durability, packaging, and the feel of useful objects.
Build coherent visual communication systems by using type, grids, hierarchy, rhythm, composition, and diagrams to guide attention without distorting meaning.
Build nonfiction craft through observation, scene, specificity, voice, anecdote, warmth, and revision as discovery.
Learn to look before labeling and build evidence-grounded visual arguments by connecting composition, medium, patronage, symbolism, abstraction, display, and reproduction.
Design believable invented worlds through constraints, ecology, institutions, technology, culture, narrative pressure, and symbolic coherence.
Implementation-focused deep dive into the single-node database engine substrate: workload shape, page and record layout, buffer pools, B-tree and LSM access paths, WAL, checkpoints, crash recovery, and the transaction boundary that builds on durable storage.
Architecture-level design of data platforms: source-of-truth boundaries, derived-data contracts, regional placement, serving planes, reliability controls, governance handoffs, and platform operating models.
Columnar storage, execution engines, warehouse architecture, vectorization, and the internals of large-scale analytical query systems.
Change capture, ingestion contracts, backfills, schema drift, and the operational trade-offs of moving data through modern pipelines.
Data models, storage trade-offs, batch versus streaming, analytical versus transactional systems, and the basic mental models for modern data stacks.
Draft track for columnar formats, table metadata layers, schema evolution, compaction, and lakehouse architecture.
Schemas, ownership, lineage graphs, discovery surfaces, and the metadata infrastructure that makes data platforms governable.
Streaming ingestion, stateful processors, watermarks, checkpoints, exactly-once claims, backpressure, replay, and the platform patterns behind low-latency data movement.
In-memory system design through Redis as the concrete case study: event loops, data structures, persistence, replication, clustering, caching, queues, locks, and operations.
Key-value, document, wide-column, graph, and search-oriented data stores with partitioning, replication, consistency, compaction, indexing, and operations.
Operational database depth for backend engineers: connection pools, isolation, query planning, index health, sharding, replicas, failover, and split-brain prevention.
PostgreSQL-specific depth for production systems: MVCC, WAL, locks, planner evidence, indexes, vacuum, replication, pooling, migrations, security, and operational debugging.
Single-node transaction-manager implementation: transaction state, isolation anomalies, lock managers, MVCC, optimistic validation, serializable snapshot isolation, undo, WAL integration, recovery, index consistency, testing, and observability.
Core mental models for coordination, failure, time, load, contracts, and operational trade-offs in distributed systems.
Application-level event-driven design: event boundaries, broker models, delivery semantics, contracts, idempotency, replay, backpressure, and operational review. This track is the bridge into deeper messaging internals, stream processing, CDC, and distributed workflow tracks.
Network layers, protocol boundaries, retries, and the failure models they create.
Probabilistic dissemination, failure evidence, membership lifecycles, resilient overlays, epidemic repair, and production design for large changing clusters.
Consensus safety and liveness, Paxos, Raft, ZAB, quorum and commit evidence, replicated state machines, safe reads, reconfiguration, coordination APIs, operations, and failure verification.
Client-visible consistency contracts, replication topologies, quorum and repair mechanisms, sharding authority, safe reads, recovery, and production verification.
Atomicity boundaries, sagas, idempotency, outbox patterns, and the trade-offs between coordination and compensation in distributed workflows.
Reconcilers, leases, scheduling, placement, autoscaling, and control-plane design patterns.
Mergeable data types, invariant design, monotonicity, and the techniques that reduce coordination in replicated systems.
Regional topology, failover control, latency trade-offs, disaster tolerance, and the architecture of systems stretched across failure domains.
Log brokers, consumer coordination, delivery semantics, retention, and the internals of queue and streaming substrates.
Fault injection, schedule control, simulation harnesses, trace replay, and the testing strategies used to make distributed bugs reproducible.
Internet protocol mechanics from link layer and IP through TCP congestion algorithms, routing, middleboxes, measurement, secure channels, SDN, and datacenter fabrics.
HTTP semantics, representation contracts, browser credential boundaries, caching, HTTPS delivery, proxies, DNS, CDNs, long-lived connections, and observability for backend-facing web delivery.
Implementation-centered distributed systems practice: RPC, MapReduce, clocks, snapshots, DHTs, replication, Raft, Spanner-style transactions, and key-value services.
Engine loop patterns, runtime composition, resource ownership, and gameplay control structures.
Engine core systems, editor/runtime tooling boundaries, profiling discipline, job systems, replay, validation, and performance workflow for real-time interactive engines.
Frame production, GPU pipeline architecture, shader and material systems, lighting, visibility, temporal techniques, and rendering evidence for real-time engines.
Networking, authority, transport, live operations, and shipping readiness for multiplayer games.
Animation graphs, character controllers, state machines, and the runtime systems that make interactive characters feel alive.
Navigation meshes, planners, behavior trees, and the decision systems that drive responsive interactive agents.
Transforms, projection, shading intuition, and the mathematical foundations that make graphics systems intelligible.
Collision, integration, constraints, and the numerical trade-offs behind stable simulation in interactive systems.
Noise, rule-based generation, world simulation, and the systemic design patterns used to produce rich worlds from compact rules.
Audio engines, mixing graphs, spatial sound, adaptive music, voice, asset pipelines, performance budgets, and accessibility for interactive worlds.
A compact entry point for turning scattered technical, scientific, artistic, and philosophical interests into disciplined questions, bounded analogies, and small synthesis artifacts.
Compare existentialist freedom, absurdist revolt, Nietzschean value critique, Stoic judgment, and finitude, then turn their differences into bounded reflection practices and a revisable personal philosophy.
A practical foundation for moving from plot summary and personal reaction to evidence-grounded interpretations of character pressure, narration, structure, genre, symbols, and narrative worlds.
Turn technical knowledge into reader-centered explanations and durable documentation by choosing the right document shape, revealing mechanisms through concrete examples, writing for decisions and operations, and revising a maintained service docs pack.
Turn disagreement into joint inquiry by asking generative questions, listening for the real claim, reconstructing arguments fairly, mapping reasons, noticing identity pressure, and designing conversations that produce clearer beliefs or next steps.
Compare how Tolstoy, Dostoevsky, Kafka, Camus, Nabokov, Orwell, and Borges use narrative form to pressure agency, guilt, meaning, language, and moral judgment.
Use English verb tenses to describe current state, ongoing work, past incidents, evidence, plans, rollouts, and technical timelines.
Use modal and auxiliary verbs to express ability, uncertainty, obligation, recommendation, permission, risk, inference, and retrospective judgment in technical work.
Use gerunds and infinitives to talk about goals, plans, avoidance, preference, purpose, repeated work, and technical trade-offs.
Use nouns, articles, plurals, uncountable technical words, quantifiers, and ownership language to make engineering sentences precise.
Use pronouns, possessives, demonstratives, substitutes, and distributive determiners to keep technical references clear across sentences, groups, and alternatives.
Add identifying detail, qualification, and comparison to technical sentences without hiding the component, evidence, constraint, or trade-off being described.
Choose prepositions that make system location, request paths, timelines, methods, dependencies, and operational boundaries precise.
Connect evidence, constraints, actions, and consequences in short engineering communication, then use common operational phrasal verbs with clear agency and natural object placement.
Audit claims by separating belief from knowledge, testing evidence and defeaters, evaluating testimony and disagreement, and tracing how institutions create or distort trust.
Historical tracing practice for explaining how media, instruments, institutions, infrastructure, conflict, and imagined futures reshape ideas and technologies over time.
Transformer-era language modeling concepts, architectures, and capability framing.
Training data, distributed pretraining, post-training, alignment loops, inference optimization, and production serving for large language models.
Evidence-grounded LLM product architecture: RAG pipelines, agent-facing context, evaluation slices, observability, cost, safety boundaries, and production release judgment.
Synthetic data, verifiers, process supervision, reasoning traces, and frontier post-training loops.
Tool schemas, planners, sandboxes, browser agents, orchestration loops, and runtime failure handling.
Design memory, context assembly, and planning state for long-lived LLM agents that must preserve evidence, recover work, and act under operational constraints.
Guardrails, policy enforcement, action filtering, runtime controls, and the trust boundaries needed around agentic systems.
Offline evals, task suites, judge systems, reliability trade-offs, and the measurement discipline required to compare LLM behavior honestly.
Coordination protocols, role assignment, negotiation, and the design patterns for systems composed of multiple autonomous agents.
Tool selection, environment feedback, learned interaction policies, and the mechanisms that let agents improve through action.
Design reliable work with AI assistants and agents: delegation, context, review, tool boundaries, memory, failure recovery, and human judgment.
A decision-centered introduction to supervised learning: frame prediction problems, trace how models learn, compare model biases, evaluate generalization honestly, and diagnose what to improve next.
How neural networks build representations, receive credit through gradients, train reliably, encode architectural bias, transfer knowledge, and cross the boundary into inference systems.
Multimodal encoders, contrastive learning, grounding, and vision-language model design.
Latent dynamics, predictive state, imagination-based planning, and model-based agent architectures.
Diffusion models, latent media generation, controllability, and evaluation across image, audio, and video systems.
Interventions, counterfactual thinking, uplift, and the use of causal structure to support better decisions than prediction alone.
Bias-variance trade-offs, sample complexity, optimization behavior, and the theory that explains why learning succeeds or fails.
Draft track for GPU execution models, accelerator runtime behavior, and heterogeneous systems design.
Draft track for feature platforms, training pipelines, experiment systems, model deployment, and inference operations.
Latent-variable models, priors, posterior reasoning, and the probabilistic view of learning under uncertainty.
Value functions, policy learning, exploration, planning, and the algorithms for acting under delayed feedback.
Embeddings, contrastive objectives, pretext tasks, and the training recipes that build reusable latent structure from raw data.
Operational discipline for machine learning: datasets, training pipelines, evaluation, deployment, monitoring, drift, lineage, and rollback.
Read AI research with discipline: claims, baselines, ablations, datasets, benchmarks, limitations, replication, and implementation judgment.
Mathematics And Formal Foundations
Algorithm design, hardness, approximation, and the computational trade-offs that bound what systems can do efficiently.
Mathematics And Formal Foundations
Draft track for specification, model checking, proof techniques, and systems verification workflows.
Mathematics And Formal Foundations
Entropy, channel capacity, coding, compression, and the formal limits of representation and communication.
Mathematics And Formal Foundations
Vector spaces, matrix decompositions, geometry, and spectral reasoning used across graphics, learning, and systems analysis.
Mathematics And Formal Foundations
Formal languages, automata, decidability, and the logical machinery that underpins compilers, verification, and computation theory.
Mathematics And Formal Foundations
Objective landscapes, convexity, constrained optimization, and the numerical methods that make large-scale learning and control practical.
Mathematics And Formal Foundations
Build a practical probability model of uncertain events, samples, measurements, and processes, then test what its summaries can and cannot justify.
Mathematics And Formal Foundations
Groups, rings, fields, homomorphisms, invariants, and algebraic structure as reusable ways to see symmetry and constraint.
Mathematics And Formal Foundations
A beginner orientation to computer science that traces how exact procedures, representations, algorithms, abstractions, languages, networks, and system layers turn intent into working software.
Mathematics And Formal Foundations
Develop mathematical maturity through definitions, examples, proof strategies, counterexamples, invariants, induction, contradiction, and problem taste.
Mathematics And Formal Foundations
A gentle bridge into objects, morphisms, functors, natural transformations, adjunctions, diagrams, and compositional design intuition.
Perception, attention, emotion, memory, habit, bias, and social cognition for technical learners who want a better model of minds.
Design a tool-neutral knowledge loop that turns sources and experience into durable claims, purposeful links, retrieval cues, project decisions, and synthesis without letting capture or maintenance become the work.
Brains as adaptive systems: plasticity, attention, sleep, creativity, predictive processing, consciousness debates, and careful limits on explanation.
Build usable models of reality: assumptions, boundaries, variables, feedback, uncertainty, evidence, and model failure.
Turn incomplete evidence into inspectable choices using options, calibrated probabilities, values, trade-offs, reversibility, failure tests, and feedback.
Application performance under repeated work and bursts: cache authority and freshness, worker scheduling and failure control, load distribution, scaling, and evidence-driven diagnosis across the request path.
Load envelopes, queuing trade-offs, forecasting, and the methods used to plan system growth before painful saturation.
Incident response as an operational learning system: paging signals, roles, triage, communication, runbooks, mitigation, postmortems, corrective actions, on-call training, and durable organizational memory.
Canaries, feature gates, rollback design, change safety, and the release controls that reduce production risk.
SLIs, SLOs, failure budgets, operational trade-offs, and the core mental models behind production reliability work.
Failure injection, resilience drills, blast-radius control, and experiment design for hardening systems before real incidents.
Production observability depth for backend systems: OpenTelemetry propagation, Prometheus cardinality, logs, sampling, traces, profiling, service maps, and incident evidence.
Sensors, actuators, frames, control loops, perception, planning, safety, and simulation-to-reality gaps in embodied systems.
Physical reasoning across scales: forces, energy, fields, entropy, astronomy, quantum states, and careful bridges to computation.
Forecasting, human enhancement, longevity, quantified self, brain-computer interfaces, AI futures, and responsible speculation.
Incentives, markets, game theory, institutions, supply chains, energy, geopolitical risk, and strategic decision-making.
Qubits, gates, measurement, entanglement, quantum circuits, algorithms, error correction, and realistic claims about quantum advantage.
A bridge from night-sky wonder to physical inference: telescopes, stars, galaxies, cosmology, spacecraft, orbits, and space engineering constraints.
Bounded rationality, incentives, nudges, prediction markets, risk, uncertainty, narratives, and the gap between ideal agents and real people.
How compute, semiconductors, energy, standards, platforms, data centers, cables, export controls, and cloud infrastructure shape power.
Evaluate scientific claims by tracing hypotheses, experiments, measurement, causality, replication, theory pressure, and the limits of what the evidence can justify.
Review technological systems by tracing coupled behavior, stakeholders, power, encoded values, incentives, feedback, governance, and repair.
Search Ranking And Recommendation
Index construction, lexical retrieval models, postings mechanics, ranking baselines, and the retrieval-system boundary before serving, vector search, and evaluation tracks.
Search Ranking And Recommendation
Learning to rank, experimentation, evaluation pipelines, and search quality governance.
Search Ranking And Recommendation
Crawler frontiers, politeness, canonicalization, parsing, duplicate control, freshness, corpus governance, and the handoff from web acquisition into search indexing.
Search Ranking And Recommendation
Entity linking, graph modeling, canonicalization, and the data structures used to connect knowledge across noisy sources.
Search Ranking And Recommendation
Approximation, sketching, distributed analytics, graph mining, clustering, and operational judgment for massive datasets without mixing in personalization product loops.
Search Ranking And Recommendation
Auction design, bidding signals, marketplace objectives, and the ranking trade-offs unique to monetized retrieval systems.
Search Ranking And Recommendation
Intent parsing, reformulation, semantic matching, and the retrieval improvements that start from better representations of user needs.
Search Ranking And Recommendation
Interleaving, A/B testing, bandits, feedback loops, and the online methods used to improve ranking systems safely.
Search Ranking And Recommendation
Candidate generation, multi-stage ranking, feedback loops, experimentation, fairness, and serving architecture for personalization systems.
Search Ranking And Recommendation
Indexing basics, ranking intuition, query-document matching, and the introductory mental models behind search and recommendation quality.
Search Ranking And Recommendation
Draft track for embeddings, ANN indexes, hybrid retrieval, vector databases, and retrieval serving trade-offs.
Search Ranking And Recommendation
Production search serving: schemas, analyzers, shards, query execution, aggregations, relevance tuning, hybrid search, indexing pipelines, cluster operations, and incidents.
Architecture and operating judgment for building a verifiable platform trust chain from source artifact to workload identity, policy enforcement, runtime isolation, tenant boundaries, audit evidence, and trust-degradation response.
Input validation, auth flaws, data exposure, secure defaults, and the design patterns that reduce common application risks.
Image provenance, runtime isolation, dependency trust, and the controls used to secure modern cloud software supply chains.
Cryptographic primitives, secret rotation, key hierarchy, and the operational discipline needed to use cryptography safely.
Identity boundaries, token flows, authorization models, policy engines, and the auditability of trust decisions in software systems.
Draft track for lineage, retention, deletion workflows, policy enforcement, auditability, and privacy-aware data operations.
A practical foundation for turning system diagrams, assets, trust boundaries, adversary assumptions, and abuse paths into prioritized security requirements, verifiable controls, and living threat models.
Security telemetry, investigation workflows, triage, containment, and the evidence-handling needed after active compromise.
Understand software from the outside inward: binaries, protocols, traces, decompilers, symbols, patching, and ethical analysis.
A compact, defense-oriented practice for challenging assumptions, tracing realistic attack chains across technical and human workflows, mapping attacker behavior to controls and signals, and reporting findings responsibly.
A compact foundation for tracing how operating systems isolate work, cross kernel boundaries, schedule execution, manage memory pressure, coordinate concurrency, and expose evidence for host-level diagnosis.
A compact bridge from operating-system foundations to storage design: choose a storage contract, separate metadata from data paths, trace caching and durability boundaries, follow an I/O request, and read operational pressure before entering implementation deep dives.
A project-oriented bridge that turns operating-system mental models into traceable implementation decisions for a small kernel, from boot and privilege transitions through memory, scheduling, syscalls, I/O, isolation, and debugging.
Caches, pipelines, memory hierarchies, branch behavior, and the hardware performance models that shape software design decisions.
Memory ordering, atomicity, lock-free design, wait-freedom, and the concurrency models behind scalable shared-memory systems.
Interrupts, DMA, drivers, block and network I/O paths, and the kernel-to-device mechanics that shape latency and throughput.
Draft track for kernel datapaths, packet processing, observability, and programmable networking hooks.
Compiler and runtime systems from lexing, parsing, IR, dataflow, optimization, register allocation, and code generation through bytecode VMs, JIT tiering, deoptimization, GC interfaces, and runtime observability.
Memory behavior from virtual memory, page faults, cache locality, and NUMA through arena, stack, pool, free-list, buddy, slab, and general-purpose allocator design.
Journaling, copy-on-write trees, allocators, recovery, metadata engines, and the implementation trade-offs inside storage stacks.
Virtual machines, hypervisors, device emulation, paravirtualization, and the isolation mechanisms underneath cloud compute.
Build a Linux workstation you can inspect, repair, and reproduce by tracing shell, filesystem, package, and service behavior before comparing Arch-style ownership with NixOS-style declaration.
A comparative path through language trade-offs, memory, types, performance, ergonomics, bindings, and API design across Rust, C++, and Python.
Runtime and kernel-level performance for backend services: event loops, syscalls, zero-copy I/O, memory mapping, GC tuning, virtual threads, actors, memory barriers, and lock-free design.
ROADMAPS
[19 TRACKS]
[15 TRACKS]
[20 TRACKS]
[10 TRACKS]
[17 TRACKS]
[25 TRACKS]
[25 TRACKS]
[10 TRACKS]
[12 TRACKS]
[22 TRACKS]
[8 TRACKS]
[8 TRACKS]