Online Workshop Every Week
Join our free weekly interactive learning sessions.
Master AI/ML with instant feedback and personalized learning
"Cogito, ergo sum" (I think, therefore I am)
— René Descartes
Free Problems
View All Free ProblemsUnderstanding Reasoning vs Generic LLMs
This problem set explores the key differences between reasoning and generic large language models (LLMs) based on the video "What is the difference between Reasoning and Generic LLMs?". The problems cover fundamental concepts, practical applications, and analytical comparisons between these two types of AI models.
12 pts
Easy
104
reasoning-questions
llm-types
basic-concepts
+7
Chain of Thought Reasoning Fundamentals
This problem set covers the key concepts from Lecture 2 on Chain of Thought Reasoning, including inference time compute scaling, few-shot prompting, zero-shot reasoning, and the emergent reasoning abilities in large language models. The problems progress from basic concepts to advanced analytical questions based on the video content.
34 pts
Medium
101
inference-time-compute
reasoning-llms
computational-resources
+7
Megatron-LM Model Parallelism Concepts
This problem set covers key concepts from the ML Performance Reading Group Session 8 on Megatron-LM, focusing on tensor parallelism, communication patterns, and memory optimization strategies for training large language models. The problems progress from fundamental concepts to advanced implementation details discussed in the video.
44 pts
Medium
94
tensor-parallelism
pipeline-parallelism
model-partitioning
+7
Hands-on 13: Building Federated Learning with FedAvg, FedProx, FedDANE & FedSGD
This problem set covers the core concepts of federated learning as implemented in the tutorial video. You'll explore different federated learning algorithms (FedAvg, FedProx, FedDANE, FedSGD), understand their mathematical foundations, and analyze their trade-offs in terms of computation, communication, and handling of non-IID data. The problems progress from basic concepts to advanced implementation details.
21 pts
Medium
98
federated-learning
privacy-preserving
distributed-computing
+7
Scalable and Distributed Deep Neural Networks Practice
This problem set covers key concepts from the tutorial "Principles and Practice of Scalable and Distributed Deep Neural Networks". The problems test understanding of distributed training, parallelism strategies, communication patterns, and inference optimization techniques discussed in the video.
27 pts
Medium
95
dnn-training
forward-pass
backward-pass
+7
Inference Workflows and AI Service Architecture
This problem set covers key concepts from the "Inference Workflows" video, focusing on ALCF's inference service architecture, model deployment strategies, authentication methods, and agentic AI workflows. The problems test understanding of how scientific communities can leverage large language models through various interfaces and workflows.
34 pts
Medium
101
inference-service
architecture
scientific-computing
+7
Premium Problems
View All Premium ProblemsKnowledge Graphs
USA AI Olympiad
Explore competitive programming and AI contest preparation concepts
Grade 5 Math
Discover elementary mathematics concepts and learning paths
Featured Docs
View All PDFsSystem Design Interview: An Insider's Guide Volume 2
116 questions
348 pts
System Design Interview: An Insider's Guide
108 questions
317 pts
UNICALLI: A UNIFIED DIFFUSION FRAMEWORK FOR COLUMN-LEVEL GENERATION AND RECOGNITION OF CHINESE CALLIGRAPHY
10 questions
38 pts
The Principles of Deep Learning Theory
107 questions
418 pts
Featured Books
View All BooksAcing the System Design Interview
153 questions
456 pts
Numerical Python: Scientific Computing and Data Science Applications with Numpy, SciPy and Matplotlib
240 questions
684 pts
Hands-On Machine Learning with Scikit-Learn and PyTorch
200 questions
554 pts
Deep Reinforcement Learning Hands-On - Third Edition
222 questions
720 pts
Featured Videos
View All VideosFlow-Matching vs Diffusion Models explained side by side
10 questions
29 pts
Attention in transformers, step-by-step | Deep Learning Chapter 6
10 questions
30 pts
Knowledge Distillation: How LLMs train each other
10 questions
27 pts
Diffusion Model
10 questions
32 pts
Popular Topics
beginner
459
easy
217
fundamental-concepts
112
optimization
98
performance
87
medium
85
machine-learning
84
fundamentals
83
distributed-systems
83
basic-concepts
80
linear-algebra
78
architecture
76
classification
73
data-structures
73
time-complexity
66
system-design
66
scalability
65
calculation
63
neural-networks
62
machine learning
61
Click on any tag to filter problems by that topic