← All apps

Ollama (CUDA)

Ollama

Run local language models with NVIDIA CUDA acceleration

First time? Set up FlatPark →
AICLIMITv0.40.173new installs in 30 days187,868GitHub stars

About

A community package of the unmodified official Ollama Linux amd64 build, including its bundled CUDA backends and CPU fallback. Run language models locally through the command line or connect clients to the HTTP API. Model downloads have their own licenses.

The desktop entry and flatpak run com.ollama.Ollama start the server in a terminal at http://127.0.0.1:11434. Keep it running and use another terminal for commands, for example: flatpak run com.ollama.Ollama run smollm2:135m. Stop the server with Ctrl+C. An existing server on that port must be stopped first, or choose another port with OLLAMA_HOST.

Models, keys and CLI history are stored privately in this app's persistent .ollama directory, separate from a native Ollama installation. A host CUDA toolkit is not needed. GPU acceleration requires a compatible NVIDIA GPU and host driver, plus the matching Flatpak NVIDIA driver extension. CUDA needs NVIDIA device nodes, so this package grants access to all devices.

This package provides the Linux CLI and API server, without a graphical chat window or a background system service. Commands that install or launch host coding tools are not supported inside the sandbox. Connect separately installed clients to the local API instead.

To import models from a host directory, grant only that directory: flatpak override --user --filesystem=/path/to/models:ro com.ollama.Ollama. To undo overrides: flatpak override --user --reset com.ollama.Ollama.

Details

Developer
Ollama
License
MIT
Runtime
Freedesktop 26.08
Architectures
x86_64
Version
0.40.17 · 2026-11-10
Website
Homepage

Permissions

2 to review
  • All devices (incl. cameras, USB)

  • Network access

    Can reach the internet and local network

  • Persistent storage: .ollama

Packaging

Unmodified

Runs the vendor's build as shipped — nothing added or changed.

What the levels mean →