🦙

uv + llm + ollama でローカルLLM環境を構築する

に公開

Install uv

https://github.com/astral-sh/uv?tab=readme-ov-file#installation

Install llm

https://github.com/simonw/llm?tab=readme-ov-file#quick-start

Install llm-ollama

https://github.com/taketwo/llm-ollama?tab=readme-ov-file#installation

OLLAMA_HOST

export OLLAMA_HOST=http://<your-ollama-server-ip>:11434

llm

List available models

llm models
...
Ollama: gemma3:27b
Ollama: gpt-oss:20b
Default: gpt-oss:20b

Set default model

llm models default gpt-oss:20b

Run

llm 'hello'
GitHubで編集を提案

Discussion