dorfteich/docs/architecture
Claude Fable 5 5cef359b8f
All checks were successful
CI / Lint, typecheck, test (push) Successful in 3m45s
CD / Build and push images (push) Successful in 3m49s
CI / Build container images (push) Has been skipped
CD / Deploy to Test (push) Successful in 9s
CD / Smoke tests against Test (push) Successful in 1m18s
CD / Promote to Int (push) Successful in 11s
CI / Auth e2e pack (push) Successful in 5m35s
CI / Import/export fidelity gate (push) Successful in 47s
Nextcloud backup target: admin-configured, manual + scheduled uploads, in-app restore (#103)
Off-host backups for every self-hoster, configured entirely in the admin
UI — supersedes the host-specific mirror plan behind #84.

shared:
- webdav.ts (new package entry like token-crypto): minimal WebDAV client
  with basic auth — PROPFIND (tolerant multistatus parser), MKCOL, PUT
  (streamed), GET, DELETE; Nextcloud DAV path derived from the plain
  server URL, explicit DAV bases pass through
- backup-status.ts: additive remote-upload status in status.json, the
  restore-status.json contract (running/succeeded/failed + staleness
  bound), the backup_command/backup_maintenance NOTIFY channels, and the
  one-bundle-per-set naming (dorfteich-backup-<id>.tar.gz)
- backup-set.ts moved here from apps/backup (api lists local sets)

backup sidecar:
- reads the backup.* instance settings directly from the database (admin
  changes apply next run; local retention row overrides the env) and the
  app password from the secret store
- after each successful set: bundle dump + files archive + manifest into
  ONE self-contained tar.gz, upload via WebDAV per schedule
  (off/daily/weekly; manual runs always upload), prune remote bundles —
  never the newest — and record the outcome in status.json; upload
  failures alert via a new backupUploadFailed mail (de+en)
- command listener on backup_command (run / restore) with a serial queue
  against the nightly timer
- restore orchestrator: restore-status.json → maintenance NOTIFY →
  grace → (remote: download + manifest-verify bundle) → terminate other
  DB connections → shared perform-restore path (same code as restore.sh)
  → final status + maintenance exit

api:
- MaintenanceGuard (global, registered before the setup gate): 503
  maintenance_mode while restore-status says running; health endpoints
  and the new public GET /backup/restore-status stay exempt; a stale
  running state (crashed sidecar) unblocks after 30 min
- MaintenanceStateService watches the file and restarts the api after a
  successful restore (fresh caches, migrate-on-start for older dumps);
  main.ts refuses to touch the database while a restore runs — a
  container restarting mid-restore must not race pg_restore with
  migrate deploy
- worker sweeps (conversion, mail outbox, scheduler) catch transient
  database failures instead of dying on an unhandled rejection — the
  restore's connection termination crashed the api in verification
- backup admin endpoints under /admin/system/backup: settings (live
  connection test before save, password write-only into the secret
  store), nextcloud/test, sets (local via the ro backups mount + remote
  via WebDAV), run + restore (type-to-confirm backstop, source
  validation) — commands travel as NOTIFY payloads; audit actions
  backup.settings_changed/run_triggered/restore_requested
- readyz: new warning-level backup_remote check while a target is
  configured (26 h daily / 170 h weekly bound)

collab:
- maintenance listener: on enter, persist + close every live session and
  refuse new connections until exit (failsafe timeout 30 min) — no
  in-memory document may write pre-restore content back afterwards

web:
- Admin → System backup section: status card with remote facts and a
  "Back up now" button, the Nextcloud settings form with test button,
  and the restore picker (local + remote sets, type-to-confirm)
- global maintenance screen: any 503 maintenance_mode flips the SPA to a
  status page polling the exempt endpoint, reloading when the instance
  returns

Verified end-to-end against a live stack (fresh DB, native api + sidecar,
fake WebDAV server): configure → test → manual backup → bundle upload →
readyz/sets/status surfaces → remote restore with maintenance gate,
marker rollback and api restart; suites: shared 21, backup 9, collab 11,
api 58 files green, lint + i18n:check + typecheck clean.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01EwZ4jR4KFAPvpjWevfUGX1
2026-07-12 10:39:18 +02:00
..
adr Move stages, runner and deploy target to dedicated host ONE 2026-07-11 08:05:36 +02:00
data-model.md Add plugin storage, install API, and directory watcher (#71) 2026-07-10 16:55:26 +02:00
deployment.md Run operations QA on every release candidate before the prod gate (#90) 2026-07-12 00:29:53 +02:00
operations.md Nextcloud backup target: admin-configured, manual + scheduled uploads, in-app restore (#103) 2026-07-12 10:39:18 +02:00
permissions.md Scaffold pnpm monorepo with lint, format, and test tooling 2026-07-04 19:06:27 +02:00
plugin-architecture.md Add pageTool plugins with toc and page-index references (#77) 2026-07-11 13:27:30 +02:00
README.md Enforce permissions in API guards and retire interim access (#52) 2026-07-09 16:31:41 +02:00
realtime-collaboration.md Scaffold pnpm monorepo with lint, format, and test tooling 2026-07-04 19:06:27 +02:00
roadmap.md Move stages, runner and deploy target to dedicated host ONE 2026-07-11 08:05:36 +02:00
security.md Scaffold pnpm monorepo with lint, format, and test tooling 2026-07-04 19:06:27 +02:00

Dorfteich — Architecture Overview

This directory is the authoritative architecture documentation. Every implementation story references the documents here; when a story and this documentation disagree, clarify before coding.

System context

Dorfteich is shipped as a set of Docker containers behind a reverse proxy. One deployment = one instance (e.g. dorfteich.online, or a self-hosted installation).

flowchart LR
    subgraph clients [Clients]
        B[Browser SPA<br/>React + TipTap + Yjs]
    end
    subgraph instance [Dorfteich instance - Docker Compose]
        RP[Reverse proxy]
        WEB[web<br/>static SPA assets]
        API[api<br/>NestJS REST]
        COLLAB[collab<br/>Hocuspocus WebSocket]
        PG[(PostgreSQL)]
        PAN[pandoc-server<br/>doc conversion]
        GOT[Gotenberg<br/>HTML to PDF]
        VOL[/uploads + plugins volume/]
    end
    B -- HTTPS --> RP
    RP --> WEB
    RP -- /api --> API
    RP -- /collab WebSocket --> COLLAB
    API --> PG
    COLLAB --> PG
    API --> PAN
    API --> GOT
    API --> VOL
    COLLAB -. permission checks .-> API
  • web serves the single-page application (static assets).
  • api owns all business logic: auth, ponds, pages, labels, permissions, quotas, import/export, plugin management, admin functions.
  • collab synchronizes CRDT documents (page content) and awareness (cursors) over WebSocket and persists document state to PostgreSQL. It authenticates clients with short-lived tokens issued by api.
  • pandoc-server and Gotenberg are internal-only conversion sidecars (Word/OpenOffice import/export, PDF export).
  • All page content lives in PostgreSQL; binary uploads (images, attachments) and installed plugins live on a Docker volume.

Documents

Architecture Decision Records (adr/)

ADR Decision
0001 TypeScript everywhere, pnpm monorepo
0002 PostgreSQL as the only database
0003 Yjs CRDT + Hocuspocus for real-time and offline collaboration
0004 TipTap (ProseMirror) as the WYSIWYG editor
0005 React + Vite single-page application
0006 NestJS + Prisma for the API server
0007 Cookie sessions, Argon2id, OIDC-ready identity model
0008 Sandboxed iframe plugins with a message-based API
0009 Pandoc + Gotenberg sidecars for import/export
0010 PostgreSQL full-text search behind a search interface
0011 Filesystem volume for uploads, DB-tracked quotas
0012 i18next with German and English from the start
0013 Page version history via Yjs snapshots, soft-delete trash
0014 CI/CD with Gitea Actions, staged promotion
0015 Nightly pg_dump + uploads sync, 30-day retention, off-host mirror
0016 Self-hosted Google Fonts, per-pond font configuration

Concept documents

Document Contents
data-model.md Entities and relations: users, ponds, pages, labels, grants, quotas, plugins
permissions.md Role model and the "most specific setting wins" resolution algorithm
realtime-collaboration.md CRDT document lifecycle, cursor sync, offline behavior, versioning hooks
plugin-architecture.md Plugin manifest, packaging, sandbox runtime, extension points, admin flows
deployment.md Compose stacks for Dev/Test/Int/Prod, environments, promotion pipeline
operations.md Monitoring, logging, backup/restore, update strategy for self-hosters
security.md Threat-driven security concept: authn/authz, sandboxing, uploads, secrets
roadmap.md Epics and milestones; the order stories are implemented in

Terminology

German (product vision) English (code, docs, issues)
Teich pond
Seite page
Teich-Admin Pond Admin
Bearbeitende Editor
Lesende Reader
Öffentlichkeit Public

Conventions for implementers

  • Language: English for code, comments, commit messages, and issues.
  • Write clear, human-readable code; document the "why", not the "what".
  • UI strings never appear hard-coded — always through i18n resources (see ADR 0012), with German and English translations added in the same change.
  • Every story lists the ADRs it depends on; read them before starting.
  • Every API route declares its access rule explicitly (a permission decorator, @Public(), or the Site-Admin guard — issue #52); permission checks run only through the shared resolution (permissions.md), never ad hoc. 404/403 policy: a denied read answers 404 so the existence of ponds and pages is not revealed; a denied write on something the user may read answers 403. Trash views require write capability and answer 404 on denial (ADR 0013).