Quickstart

Get BOSS Offline AI running locally in a few minutes — no account, no API key, no network.

What you need

pip install boss-offline-ai

Or, with Docker:

docker run --rm -it ghcr.io/vectorlogic/boss-offline-ai:latest

boss ask "explain a closure in plain words"

The first run downloads the model weights to a local cache. After that, the model works with the network switched off.

from boss import Boss

model = Boss.load("v1.3")
print(model.ask("summarise this paragraph in one sentence"))

Version	Best for	Caveat
v1.1	General knowledge questions	Older instruction-following
v1.3	Instruction following, structured output	Weaker general knowledge than v1.1

The v1.3 general-knowledge regression is real and documented on the Benchmarks page. Read it before deciding.

pip install boss-offline-ai

Or, with Docker:

docker run --rm -it ghcr.io/vectorlogic/boss-offline-ai:latest

boss ask "explain a closure in plain words"

The first run downloads the model weights to a local cache. After that, the model works with the network switched off.

from boss import Boss

model = Boss.load("v1.3")
print(model.ask("summarise this paragraph in one sentence"))

Version	Best for	Caveat
v1.1	General knowledge questions	Older instruction-following
v1.3	Instruction following, structured output	Weaker general knowledge than v1.1

The v1.3 general-knowledge regression is real and documented on the Benchmarks page. Read it before deciding.