Tutorials
A tutorial is a lesson. You follow its steps in order, and each step shows the output to expect, so you can check your work as you go. Each lesson links to the guide that explains a step in full.
Start with the Quickstart, which sends your first Completion. Your first steered Completion starts with no access at all, and ends with a steered residual stream. Sample many rollouts needs an API key with tokens.
You need curl, and Python with the openai SDK. Some steps use jq or NumPy, and each lesson says which ones. Each output is one sample that meta-llama/Llama-3.1-8B wrote, so your outputs differ. A step at temperature 0 gives the likeliest tokens, and vLLM's batching can still change a token now and then.
Quickstart
Send a prompt, read the Completion and its log probabilities, and stream the tokens.
Your first steered Completion
Get access, make an API key, run a Completion, read its Activations, and steer the residual stream.
Sample many rollouts
Sample two prompts in one request, then in many requests at once, then in a Job.