Online Workshop Every Week
Join our free weekly interactive learning sessions.
Master AI/ML with instant feedback and personalized learning
"Cogito, ergo sum" (I think, therefore I am)
— René Descartes
Free Problems
View All Free ProblemsChapter 9: Production LLM Serving Stack
This problem set covers the core concepts from Chapter 9: Production LLM Serving Stack. It explores the anatomy of a production serving system, traffic management, canary deployments, observability, reliability, Kubernetes deployment, and the llm-d framework. Complete the questions in order to build from foundational knowledge to advanced deployment reasoning.
27 pts
Medium
72
llm-serving
api-gateway
architecture
+7
Chapter 7: Cross-Request Optimization with SGLang
This problem set tests your understanding of SGLang's cross-request optimization techniques: RadixAttention, zero-overhead scheduling, XGrammar structured output, router-based scaling, session affinity, prefill/decode disaggregation, and advanced MoE optimizations. The questions progress from basic conceptual checks to advanced analytical and coding exercises.
24 pts
Medium
72
sglang
vllm
cross-request-optimization
+7
Chapter 11: The Evolving Landscape of Distributed AI
This problem set explores the key concepts from O'Reilly's *Distributed AI Systems*, Chapter 11: The Evolving Landscape of Distributed AI. You will reason about inference economics, on-device AI, MoE routing, edge-cloud coordination, fault tolerance, federated learning, and communication compression.
18 pts
Medium
77
inference-economics
distributed-ai
infrastructure
+7
Chapter 10: Distributed Benchmarking and Performance Optimization
This problem set contains eight questions that span the key concepts from the O'Reilly chapter on distributed benchmarking and performance optimization. The questions progress from foundational benchmarking methodology to advanced analysis of multi-node training clusters and inference latency. You will interpret metrics, calculate scaling efficiency, apply Amdahl's Law, and design a diagnostic benchmark plan.
24 pts
Easy
72
benchmarking-methodology
warmup
distributed-systems
+7
Chapter 8: Running Distributed Training with SLURM
This problem set tests your understanding of running distributed AI training workloads on SLURM clusters. You will work with SLURM architecture, environment variables, job submission, framework launchers, advanced features, checkpointing, and troubleshooting.
27 pts
Easy
75
slurm-architecture
daemons
hpc
+7
Chapter 6: Distributed Inference and vLLM
This problem set tests your understanding of distributed inference and vLLM, covering KV cache and PagedAttention, prefill and decode, tensor/data/pipeline parallelism, expert parallelism, and real-world deployment tradeoffs from Chapter 6.
26 pts
Easy
70
kv-cache
inference
autoregressive-generation
+7
Premium Problems
View All Premium ProblemsKnowledge Graphs
USA AI Olympiad
Explore competitive programming and AI contest preparation concepts
Grade 5 Math
Discover elementary mathematics concepts and learning paths
Featured Docs
View All PDFsSystem Design Interview: An Insider's Guide Volume 2
116 questions
348 pts
System Design Interview: An Insider's Guide
108 questions
317 pts
UNICALLI: A UNIFIED DIFFUSION FRAMEWORK FOR COLUMN-LEVEL GENERATION AND RECOGNITION OF CHINESE CALLIGRAPHY
10 questions
38 pts
The Principles of Deep Learning Theory
107 questions
418 pts
Featured Books
View All BooksAcing the System Design Interview
153 questions
456 pts
Numerical Python: Scientific Computing and Data Science Applications with Numpy, SciPy and Matplotlib
240 questions
684 pts
Hands-On Machine Learning with Scikit-Learn and PyTorch
200 questions
554 pts
Deep Reinforcement Learning Hands-On - Third Edition
222 questions
720 pts
Featured Videos
View All VideosFlow-Matching vs Diffusion Models explained side by side
10 questions
29 pts
Attention in transformers, step-by-step | Deep Learning Chapter 6
10 questions
30 pts
Knowledge Distillation: How LLMs train each other
10 questions
27 pts
Diffusion Model
10 questions
32 pts
Popular Topics
beginner
459
easy
217
fundamental-concepts
112
optimization
100
performance
87
distributed-systems
85
medium
85
machine-learning
84
fundamentals
83
basic-concepts
80
linear-algebra
78
architecture
77
classification
73
data-structures
73
system-design
66
time-complexity
66
scalability
65
calculation
63
neural-networks
62
machine learning
61
Click on any tag to filter problems by that topic