Audrey M. Roy Greenfeld

Quietly building the future.

Python LLM Package Cheatsheet



pipx install llm

CLI Basics

llm -m <model_name> -d <data_path> -o <output_path>
llm -m orca-mini-3b-gguf2-q4_0 '3 names for a pet pineapple'
1. Spiky Sammy
2. Fruitlet Foster
3. Sweetie Pie

Using GPT4All Models

llm install llm-gpt4all
llm -m orca-2-7b '3 names for a pet pineapple'
1. Pini
2. Pinny
3. Ananas

Using Claude Models

llm install llm-claude-3
llm keys set claude
llm -m claude-3-haiku '3 names for a pet pineapple'
1. Piney
2. Prickles
3. Spiky

Ustng OpenAI Models

# No `llm install` needed for OpenAI models, it's pre-installed
llm keys set openai
llm -m 4o '3 names for a pet pineapple'

OpenAI Chat: 3.5, 3.5-16k, 4, 4-32k, gpt-4-1106-preview, gpt-4-0125-preview, gpt-4-turbo-2024-04-09, 4-turbo, 4o

OpenAI Completion: 3.5-instruct

Working With SQLite Chat Logs

llm logs path
datasette "$(llm logs path)"