डेटाबेस अनुभाग · 23 records
सॉफ़्टवेयर
The stack that turns silicon into intelligence: kernels and compilers, training frameworks, inference engines, orchestration and the agent layer.
फील्ड नोट्स
हार्डवेयर सुर्खियाँ बटोरता है, लेकिन lock-in सॉफ़्टवेयर में रहता है। यहाँ एक platform वोट देने लायक उम्र का है और अभी भी तय करता है कि लोग कौन से chip खरीदते हैं; सबसे नई एंट्री मुश्किल से दो साल पुरानी हैं और पहले से ही agent युग के लिए load-bearing हैं।
इन तीन से शुरू करें
CU
CUDA
libraries के दो दशक — technology की सबसे गहरी खाई।
VL
vLLM
वह open engine जो दुनिया के बड़े हिस्से के token सर्व करता है।
MC
Model Context Protocol (MCP)
Agent युग का सार्वभौमिक पोर्ट, एक साल के भीतर पूरे उद्योग ने अपनाया।
Compute platforms & kernels
5
CU
CUDA
NVIDIA's programming platform — the deepest moat in the industry.
NC
NCCL
The collective-communications library every distributed training run calls.
RO
ROCm
AMD's open-source answer to CUDA — the gap that narrowed at last.
T(
Triton (OpenAI)
Python-level GPU kernels — the community's crowbar under the CUDA moat.
X/
XLA / OpenXLA
The compiler that makes TPUs programmable — now an open project.
प्रशिक्षण frameworks
5
PY
PyTorch
The framework nearly every modern model is written in.
DE
DeepSpeed
Microsoft's scaling toolkit — ZeRO sharding made huge models trainable.
JAX
Composable function transforms — the framework Gemini is built with.
MC
Megatron-Core
NVIDIA's reference recipe for trillion-parameter training.
TensorFlow
The 2015 giant that industrialized deep learning — now in JAX's shadow.
JAX
Composable function transforms — the framework Gemini is built with.
MC
Megatron-Core
NVIDIA's reference recipe for trillion-parameter training.
TensorFlow
The 2015 giant that industrialized deep learning — now in JAX's shadow.
Inference & serving
6
VL
vLLM
The open-source serving engine that made GPU inference efficient.
OR
ONNX Runtime
The portable format for shipping models across hardware.
OL
Ollama
One command to run an open model locally.
SG
SGLang
The high-performance serving runtime born from RadixAttention research.
TL
TensorRT-LLM & Dynamo
NVIDIA's tuned inference stack — peak tokens from its own silicon.
LL
llama.cpp
The C++ project that put LLMs on laptops — and invented GGUF.
Orchestration & cluster management
3
Kubernetes
The cloud's operating system, retrofitted for GPUs.
RA
Ray
Distributed Python for the whole ML pipeline — Anyscale's engine.
SL
Slurm
The HPC batch scheduler most big training runs still queue through.
Libraries, tooling & the agent layer
4
MC
Model Context Protocol (MCP)
The open standard connecting AI models to tools and data — USB-C for agents.
HF
Hugging Face Transformers
The library that standardized how models are shared and loaded.
L&
LangChain & LangGraph
The scaffolding layer of the agent era.
W&
Weights & Biases
Experiment tracking for the training runs on this site — now CoreWeave-owned.