← 全部应用

llama.cpp (Intel)

ggml-org

Run local language models on Intel hardware

第一次使用?配置 FlatPark →
AIWeb UIMITvb123591近 30 天新装136,100GitHub Star
The built-in llama.cpp browser chat interface (upstream screenshot)
The built-in llama.cpp browser chat interface (upstream screenshot)

关于

A community package of the unmodified official llama.cpp OpenVINO build for local language model inference, an HTTP API and a browser chat interface. Model downloads have their own licenses.

The desktop entry starts llama-server in a terminal. Open http://127.0.0.1:8084 in your browser. Models downloaded by llama.cpp stay in this app's private persistent cache. With no model argument, the server starts in router mode for cached models. Download a model first using the CLI, for example: flatpak run --command=llama-cli io.github.ggml_org.LlamaCpp.OPENVINO -hf bartowski/Qwen_Qwen3-0.6B-GGUF:Q4_K_M -c 512

Command line tools are available with flatpak run --command=llama-cli io.github.ggml_org.LlamaCpp.OPENVINO, and similarly llama, llama-bench and llama-quantize. Include -fa 1 when using llama-bench with the OpenVINO backend. Pass server model and port options after flatpak run io.github.ggml_org.LlamaCpp.OPENVINO. The Intel edition uses its own default port (8084) and private cache.

Host model directories are optional. Grant only a directory you need: flatpak override --user --filesystem=/path/to/models:ro io.github.ggml_org.LlamaCpp.OPENVINO. Then pass -m /path/to/models/model.gguf. To remove overrides: flatpak override --user --reset io.github.ggml_org.LlamaCpp.OPENVINO.

Python model conversion and workflows requiring a host toolchain are not included.

OpenVINO selects the Intel CPU by default. List devices with flatpak run --command=llama-cli io.github.ggml_org.LlamaCpp.OPENVINO --list-devices. Model and operation support depends on the upstream OpenVINO backend; start with a small context such as -c 512.

Intel GPU and NPU inference require compatible drivers and separate hardware testing. GPU access is optional: flatpak override --user --device=dri io.github.ggml_org.LlamaCpp.OPENVINO. Select it with flatpak run --env=GGML_OPENVINO_DEVICE=GPU io.github.ggml_org.LlamaCpp.OPENVINO. NPU access additionally requires flatpak override --user --device=all io.github.ggml_org.LlamaCpp.OPENVINO, which exposes all host devices; select it with flatpak run --env=GGML_OPENVINO_DEVICE=NPU io.github.ggml_org.LlamaCpp.OPENVINO. These accelerators have not been validated in this package. Reset grants with flatpak override --user --reset io.github.ggml_org.LlamaCpp.OPENVINO.

详情

开发者
ggml-org
许可证
MIT
运行时
Freedesktop 26.08
架构
x86_64
版本
b12359 · 2026-11-13
网站
主页

权限

1 项需确认
  • 网络访问

    可访问互联网和本地网络

打包方式

原样

按厂商发布的原样运行,没有添加或修改任何东西。

这些级别是什么意思 →