> ## Documentation Index
> Fetch the complete documentation index at: https://docs.fish.audio/llms.txt
> Use this file to discover all available pages before exploring further.

# All-in-One container

> The single-container appliance: what it is, what it cannot do, and what running it involves

The All-in-One image packages the whole speech stack (edge API, model API layer,
inference router and worker, vocoder, text normalizer, and Redis) into one container,
with every model weight baked in. It runs as a turnkey single-node appliance, no Kubernetes.

The two forms, **Offline All-in-One** and **Online All-in-One**, differ only in how
usage is accounted for. The offline form records usage to a local
ledger and needs no network once the image is on the host. The online form authorises
each request against Fish Audio and charges the key that made it, so it needs outbound
access and a key with credit. The accounting is compiled in, so an image is one or the
other; the container logs which at startup.

<Note>
  This page covers what the appliance is and what to plan for. The commands, tuning
  options, and troubleshooting are in the **All-in-One guide**, which ships in the
  documentation bundle for the image version you run. See
  [Releases](/developer-guide/self-hosting/enterprise-releases).
</Note>

## What it cannot do

The appliance runs one inference worker and one vocoder, a GPU each. It does not
autoscale, does not shard across more GPUs or nodes, and does not ship the forced
aligner, so it returns no word or segment timings. For elastic or higher-throughput
deployments, use the [Kubernetes chart](/developer-guide/self-hosting/kubernetes), which
scales replicas across all GPUs and nodes.

## What running it involves

One `docker run` on a host that meets the
[All-in-One host requirements](/developer-guide/self-hosting/requirements#all-in-one-container-host).
It needs:

* **Two GPUs.** The first runs the inference worker, the second the vocoder.
* **One exposed port** for the API.
* **One persistent volume.** Compile caches, the vocoder's built engine, reference
  voice archives, and — on the offline form — the usage ledger all live there. Model
  weights are in the image, not on the volume.
* **The license bundle.** A host directory holding the certificate and key pair from
  **Developer → Self Host**, mounted read-only. Without it the API never comes up; once
  the certificate expires the container starts but refuses requests. Renewing is
  replacing those files in place; only a bundle that carries a new key needs the
  container restarted.

Everything inside the container runs as a non-root user, so a reused volume or a host
bind mount has to be writable by it.

**Plan for a slow first start.** The worker compiles its inference graphs and the
vocoder builds its engine before either serves, and the health endpoint verifies the
speech backend end to end rather than reporting immediate liveness. Both artifacts are
cached on the volume, so later starts take minutes. The vocoder engine is specific to
the GPU model, so moving to different cards rebuilds it once.

## Usage accounting and tenancy

The form determines how usage is accounted for and what the bearer token has to be.

**Offline.** Usage goes to a local, signed, append-only ledger on the volume. Two
consequences worth designing around:

* **Any non-empty bearer token is accepted**; a missing or empty one is rejected. The
  appliance has nothing to validate a token against.
* **The token is recorded verbatim as the billing identity.** Use a stable, distinct
  token per tenant. Two tenants sharing a token are indistinguishable in the ledger.

Backups and reconciliation: [Offline usage accounting](/developer-guide/self-hosting/air-gapped#offline-usage-accounting).

**Online.** Each request is authorised against Fish Audio and charged to the key that
made it. The token must be a [Fish Audio API key](/developer-guide/getting-started/api-key)
with credit — not the deploy token used to pull the image — and anything else is
rejected. No ledger is written; usage appears in your Fish Audio account instead.

Authorisation happens on every request, not only at startup, and the appliance has no
local fallback. Treat outbound reachability as a production dependency.

## Capacity

The single worker admits a bounded number of in-flight requests; beyond that, requests
queue and time-to-first-audio climbs. The ceiling is set by the worker's key-value
cache VRAM, so larger cards support a higher cap. It is adjustable at launch without
rebuilding the image. Validate latency and error rate at any new value before
committing to it.

Reference-id requests resolve only from local archives placed on the volume, one zip
per voice.

## Next steps

* [Requirements](/developer-guide/self-hosting/requirements#all-in-one-container-host): host baseline
* [Registry access](/developer-guide/self-hosting/registry-access): how your team gets the image
* [Air-gapped deployments](/developer-guide/self-hosting/air-gapped): moving the image to a disconnected host