feat: found copies foundation (contracts, migration 0012, store, wire, trash and job hooks, keys)

Owner review 6 asks Chronos to recognise the same time-lapse held under different ids on the
server and on this PC, compare the copies, and keep them apart or integrate and sync them. This
lays the shared foundation the later parcels build on, without any UI or detection yet.

- Migration 0012 adds found_copies (local-server and local-local pairs with evidence, scores,
  answer, policy and the 404 record) and copy_probes; every existing link with a local sequence
  becomes a Linked pair, so a server deletion and the per-link policy have a place.
- FoundCopyStore keeps the pairs: upserts that never touch the answer, a compare-and-set of the
  state with an Integrating backstop (a failed or cancelled job reads as the previous state),
  link promotion and demotion, the once-per-refresh 404 count, the merge's links stage
  (session keys, links reset, pairs moved, refused when both are linked on one server), the
  local overlap queries and the probes. SyncLinkStore.RekeyAsync moves pairs and probes with
  the links in the same transaction.
- Contracts for detection, review, plans, the Integrate and MergeSequences jobs (kinds 25/26,
  High level, new detail steps) and the Upload all rule that keeps suspected, kept-apart,
  deleted, busy and server-born sequences here.
- Wire: POST photos/lookup, uploads into a target (IntoTarget/Copied, trailing and optional),
  frames/delete on the client, capabilities photo-lookup and upload-into, cached per remote.
- The trash plans and deletes accept the job that holds the sequence (its own hold is not
  Busy) and a frames version checked under the lease; a Background job never interrupts a
  running one.
- Settings for linking, the photo policy and projects; the en and it keys of design section 9.

Refs #73

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Alby96andClaude Opus 5.5 committed 2026-11-16 19:39:04 +01:00
1 parent 43719bb5c5
commit 283d04d9cd
57 files changed
+3302 -26

No files matched your search

@@ -0,0 +1,74 @@
-- Found copies (owner review 6, #73): two copies of one time-lapse whose ids differ, a local sequence and a sequence of a
-- server (kind 0) or two local sequences of this index (kind 1), with the evidence, the scores of the last comparison, the
-- user's answer and, once integrated, the pair's policy. A pair is never two links: sync_links stays the 1:1 per server
-- record a sync compares; every link has a row here too (evidence 0, state 2), so a server deletion and the per-link policy
-- have a place. Scores are counts and per-mille ratios of the last exact comparison, at the frames versions it read. The
-- answered_* columns keep what a "Keep apart" was given, so only a large later change asks again. remote_gone_* record a
-- server's 404 for the remote side (two answers on two refreshes before the pair reads "deleted on server"). Local columns
-- cascade: a sequence deleted into the trash (or removed by Rebuild, Orphans or Reidentify) takes its pairs along; the
-- next detection finds such a pair again as a candidate (DECISIONS). Mirrors postgres/0012_found_copies.sql.
CREATE TABLE found_copies (
id TEXT NOT NULL PRIMARY KEY,
kind INTEGER NOT NULL,
local_id TEXT NOT NULL REFERENCES sequences (id) ON DELETE CASCADE,
server TEXT,
remote_id TEXT,
other_id TEXT REFERENCES sequences (id) ON DELETE CASCADE,
evidence INTEGER NOT NULL,
state INTEGER NOT NULL DEFAULT 0,
shared INTEGER NOT NULL DEFAULT 0,
shared_unhashed INTEGER NOT NULL DEFAULT 0,
shared_removed INTEGER NOT NULL DEFAULT 0,
only_here INTEGER NOT NULL DEFAULT 0,
only_there INTEGER NOT NULL DEFAULT 0,
differs INTEGER NOT NULL DEFAULT 0,
deleted_here INTEGER NOT NULL DEFAULT 0,
deleted_there INTEGER NOT NULL DEFAULT 0,
versions INTEGER NOT NULL DEFAULT 0,
local_photos INTEGER NOT NULL DEFAULT 0,
other_photos INTEGER NOT NULL DEFAULT 0,
containment INTEGER NOT NULL DEFAULT 0,
overlap INTEGER NOT NULL DEFAULT 0,
hints INTEGER NOT NULL DEFAULT 0,
local_frames_version INTEGER NOT NULL DEFAULT 0,
other_frames_version INTEGER NOT NULL DEFAULT 0,
fingerprint TEXT NOT NULL,
answered_fingerprint TEXT,
answered_shared INTEGER,
auto_photos INTEGER NOT NULL DEFAULT 0,
job_id TEXT,
previous_state INTEGER,
remote_gone_at TEXT,
remote_gone_hits INTEGER NOT NULL DEFAULT 0,
found_at TEXT NOT NULL,
updated_at TEXT NOT NULL,
answered_at TEXT,
CHECK ((kind = 0 AND server IS NOT NULL AND remote_id IS NOT NULL AND other_id IS NULL)
OR (kind = 1 AND server IS NULL AND remote_id IS NULL AND other_id IS NOT NULL AND other_id <> local_id))
);
CREATE UNIQUE INDEX ux_found_copies_remote ON found_copies (local_id, server, remote_id) WHERE kind = 0;
CREATE UNIQUE INDEX ux_found_copies_local ON found_copies (local_id, other_id) WHERE kind = 1;
CREATE INDEX ix_found_copies_server ON found_copies (server, remote_id);
CREATE INDEX ix_found_copies_other ON found_copies (other_id);
CREATE INDEX ix_found_copies_state ON found_copies (state);
-- What detection last sent or compared of each local sequence, per scope (a server key, or '' for this PC's archives):
-- a sequence whose frames version and hashed count are unchanged is not probed again.
CREATE TABLE copy_probes (
sequence_id TEXT NOT NULL REFERENCES sequences (id) ON DELETE CASCADE,
scope TEXT NOT NULL,
frames_version INTEGER NOT NULL,
hashed INTEGER NOT NULL,
probed_at TEXT NOT NULL,
PRIMARY KEY (sequence_id, scope)
);
-- Every existing link is a linked pair (no score yet: the next comparison fills it). Ids are random v4 UUIDs.
INSERT INTO found_copies (id, kind, local_id, server, remote_id, evidence, state, fingerprint, found_at, updated_at)
SELECT lower(substr(h, 1, 8) || '-' || substr(h, 9, 4) || '-4' || substr(h, 14, 3) || '-'
|| substr('89ab', 1 + (abs(random()) % 4), 1) || substr(h, 18, 3) || '-' || substr(h, 21, 12)),
0, local_id, server, remote_id, 0, 2, 'link', ts, ts
FROM (SELECT hex(randomblob(16)) AS h, local_id, server, remote_id,
strftime('%Y-%m-%dT%H:%M:%f', 'now') || '000Z' AS ts
FROM sync_links WHERE local_id IS NOT NULL);