Getting Started

Your SystemUnknown OS • GPU not detected

Thumper-Run Documentation

Thumper-Run is a local-first platform for running AI apps on your own hardware. Install apps from the catalog, manage AI models, and opt into network features when needed. Private end-to-end encryption remains planned.

Design Goals

  • Local-first — everything runs on your hardware, no cloud required
  • Zero config — GPU detection, model discovery, and dependency management are automatic
  • Local control — local workflows do not require an account; sync, cloud, and telemetry are separate opt-in features
  • One-click install — from catalog to running app in a single click

How It Works

Catalog Install Launch Use
┌────────┐ ┌──────────┐ ┌─────────┐ ┌────────┐
│ Browse │ ─→ │ Clone + │ ─→ │ Start + │ ─→ │ WebView│
│ apps │ │ pip/conda│ │ health │ │ or │
│ │ │ + models │ │ check │ │ browser│
└────────┘ └──────────┘ └─────────┘ └────────┘

What Makes It Different

FeatureThumper-RunManual InstallCloud API
GPU auto-detection✓✗N/A
One-click install✓✗✓
Runs offline✓✓✗
Private E2EE sync (planned)✓✗✗
Model management✓✗N/A
Free / open source✓✓✗ (per-use pricing)

Quickstart

User Quickstart

  1. Download — grab the installer from the download page
  2. Install an app — open the catalog, pick ComfyUI, click Install
  3. Generate — click Launch, load the default workflow, hit Queue Prompt

Developer Quickstart

Create a minimal manifest, test it locally, and submit to the catalog:

  1. Copy the minimal manifest below into my-app.thumper.yaml
  2. Edit the 5 required fields (id, name, version, runtime.type, runtime.entry)
  3. Run thumper install ./my-app.thumper.yaml to test locally
yaml
thumper: "1.0"
id: my-app
name: My App
version: "0.1.0"
runtime:
type: python
entry: main.py

Installation

Download the desktop app from the download page. No account required — just install and run.

Per-Platform Instructions

bash
# AppImage — download and run directly
chmod +x thumper-run.AppImage
./thumper-run.AppImage
# Debian / Ubuntu
sudo dpkg -i thumper-run.deb
thumper-run

Requires: glibc 2.31+, WebKitGTK 4.1+ (installed automatically on most distros)

System Requirements

MinimumRecommended
RAM8 GB16 GB
Disk10 GB50 GB+ (for models)
GPUNone (CPU mode)8 GB+ VRAM
OSLinux x86_64, macOS (Intel/Apple Silicon), Windows x86_64—

GPU Auto-Detection

On first launch, the platform detects your GPU and configures the environment:

GPUBackendPyTorch IndexNotes
NVIDIACUDAcu121 / cu124Auto-matched to driver version
AMD (discrete)ROCmrocm6.2Requires ROCm-capable GPU (gfx900+)
AMD APU (iGPU)ROCmTheRock nightlyBF16 only; FP16 causes NaN on gfx1150
Intel ArconeAPIxpuLevel Zero required
Apple SiliconMPScpu (MPS via PyTorch)Shared memory; never use --lowvram
None / CPU onlyCPUcpuWorks for LLMs (GGUF), slower for image gen
AMD APU (gfx1150): FP16 causes NaN in DiT attention. Always use BF16. See Troubleshooting for details.
Apple Silicon: Shared memory — never use --lowvram. It causes 5% GPU utilization by shuffling data through the same physical RAM.

GPU Compatibility Matrix

GPUStatusBackendNotes
NVIDIA RTX 30xx/40xxFully supportedCUDA 12.1+Best compatibility and performance
NVIDIA RTX 20xxFully supportedCUDA 12.1+Turing architecture, good performance
NVIDIA GTX 10xxLimitedCUDA 12.1+Works but low VRAM (6–8 GB max)
AMD RX 7000Fully supportedROCm 6.2RDNA 3, excellent ROCm support
AMD RX 6000LimitedROCm 6.2RDNA 2, some models may need workarounds
AMD Ryzen AI (gfx1150)LimitedTheRock nightlyBF16 only, shared memory, MIOpen warmup
Intel Arc A770/A750LimitedoneAPI / XPULevel Zero required, some models unsupported
Apple M1/M2/M3/M4Fully supportedMPSShared memory, never use --lowvram
CPU onlyFully supportedCPUBest for GGUF LLMs, slow for image gen
Older NVIDIA (pre-Pascal)Unsupported—Use CPU mode instead

First Launch

The first time you open Thumper-Run you'll see the app catalog. No login is needed — everything works anonymously by default. You can optionally:

  • Add a recovery phrase — enables multi-device sync and data recovery if you lose your device
  • Sign in with Google/GitHub — links to your identity for easier recovery, optional
  • Skip both — use fully anonymously, device-local only