Skip to content

πŸ” MVP-0: absorption-first word graph, walking skeleton (WordNet Β· Wiktionary Β· Wikidata Β· Wikipedia Β· Bierce, Animals scope) β€” decisions, schema, pipeline, scorecardΒ #69

Closed

Description

@holden

Status: decided 2026-09-05. This body is the MVP-0 implementation spec (v13). v1, the directional draft (source research, probe log, wireframes, deferred layers), is the first comment below. Amendment history: v3 backbone rules and media; v4 tracker #70; v6 S0b findings; v7 A5; v10 S2 (batched clients, record keying, corroboration, the L1/L3/A10/L4/A7 populations); v11 S3 (Bierce 997, A8 metric, L1 denominator computed, A1 pins, M2 from runs); v12 S4 audit (A5 v2, the mount rule); v13 S5 audit (A7 v2: graded on asserted concepts; E1–E3 measured). The living record of vision, decisions and roadmap is the repo README.

Decisions (made with Holden, 2026-09-05)

# Decision Choice
1 App identity Internal name stays devils_dictionary. Working product title Wordhoard, provisional (README β†’ Naming). Core contexts are named neutrally: Absorb, Lexicon, Encyclopedia.
2 One app or two One Phoenix app, one Postgres database. The contexts are the seam if it ever splits.
3 How much lexicon Full index: every English Wiktionary headword becomes a bare lexemes row from day one. Enrichment (senses, entries, links) is scoped.
4 Sense alignment None. Each source keeps its own senses. Sources join only through concepts.
5 Commercial Non-commercial. MVP-0 uses only open sources. Urban Dictionary, Merriam-Webster and Datamuse come later under their non-commercial terms, on demand, never bulk-stored or exported.
6 Page identity The word. /define/:slug shows every part of speech and every source. Concept pages later.
7 Tier A theme, not the core. tier is a column on sources; the UI inherits it.
8 Freshness Pinned snapshots recorded on the source row. Re-absorb by hand. No daily sync in MVP-0.
9 Environment Reset in place (#70), done as 58fdb81: Phoenix 1.8.13 / LiveView 1.2.11, Elixir 1.19 / OTP 28 pinned in .tool-versions; stay on the current Phoenix release. Local Postgres for dev; Kamal later (Β§9).
10 Existing issues Leave open. This issue references what it uses (Β§11).
11 Links, not content Living sources store a short gloss/summary and a link back; full text is imported only from public-domain dictionaries; raw records are trimmed to the fields we use.
12 Humans and bots are sources Community and bot contributions get sources rows (kind crowd / bot) plus a submitter column. Examples and media are edges from words to things/URLs with provenance and votes.
13 Product shape Backend first, then a JSON API over the same contexts, then a progressive web app, then iOS. The LiveView site is one client, not the product.
β€” Test scope Animals. Only a filter. Nothing in the schema or pipeline is animal-specific.

History: tags ruby-rails-archive (the old Rails app, 36d3b153) and phoenix-skeleton (2ea8124); main starts from the reset 58fdb81.


0. What the backbone must support (the long-term product, in one place)

Not being built now. Written down so every MVP-0 table is checked against it.

  • Aggregator, not author. Every word from every open source; for each source a short definition and a link to where it came from. We never write definitions.
  • Complete lexicon, living. New words arrive from any source, including crowd sources that define words no institution has. Re-absorbing a source surfaces new and changed words as feeds.
  • Words ↔ things. Monkey the word links to monkey the thing (Wikidata), which links to its taxonomy, its Wikipedia summary, its image.
  • Examples from the culture. People and bots attach examples to a word: nepotism β†’ a public figure (a thing we already have), a news story (a URL), a sentence. Votes rank them.
  • Any media on top. TikToks, YouTube, posts, songs, GIFs, photos, movie scenes attach to words and things as links plus metadata and thumbnails, never as files.
  • Feeds and an app. New words, changed senses, top examples, word of the day. Backend β†’ API β†’ PWA β†’ iOS.

Backbone rules derived from that (each one is enforced by a column or a table in Β§4):

  1. Every content row points at its source_record, which carries the canonical URL at the source. Sources also carry a URL template, so a link out always exists.
  2. Short by default. Living sources materialize a gloss or summary + URL. Raw records are trimmed to the fields we use (for Wiktionary: no translations, descendants or templates). Only public-domain dictionaries are imported in full.
  3. Any source may introduce a word. Identity is (lang, lemma, pos); pos defaults to "unknown" for crowd sources. The lexeme records which source introduced it and which sources attest it.
  4. Provenance accepts humans and bots. They are sources rows; community tables add submitted_by.
  5. Everything that connects a word to a thing, a URL or a piece of media is an edge with a method or role, a confidence or score, a status and provenance. concept_links is the first such edge; examples, attachments and votes follow the same shape and add tables, not columns.
  6. Media is links + metadata + thumbnails. A provider is a sources row; an unfurl or a provider API call is an enrich/2; the payload is a source_record.
  7. Feeds are queries. Every row is timestamped; records carry a content hash and a changed_at.
  8. Variants resolve. Inflected forms live on the lexeme; spelling variants point at a canonical lexeme; a word with many things has candidate links from its disambiguation page.

1. What MVP-0 is

A walking skeleton of the absorption-first word graph: every mechanism the final system needs, exercised once, on real data, deliberately plain to look at. It must be functionally complete, not pretty. When it is done, adding a new source is one row, one module and one task run, and adding a new scope is one task run.

Mechanism Proven by
Bulk dump absorb, streamed, scoped Wiktionary (2.6 GB gz)
Full-corpus absorb Open English WordNet, Bierce
On-demand API absorb, rate-limited, with "source had nothing" markers Wikidata, Wikipedia
Raw record β†’ idempotent materialization β†’ parity check all five
Lexical relations with unresolved targets, resolved later Wiktionary, WordNet
Word ↔ thing linking with method + confidence, including disambiguation candidates Wiktionary sense QIDs, Wikidata, Wikipedia
Encyclopedic relations (taxonomy) and images Wikidata, Wikipedia
Multi-source disagreement shown, not smoothed Wiktionary vs WordNet senses
A dead author as a layer Bierce
Scope as data Animals (+ one toy scope to prove generality)

What MVP-0 is not: no auth, no votes, no examples, no media, no design pass, no Johnson/Webster/EB1911 (one is added after acceptance as the extensibility proof), no Urban Dictionary or Merriam-Webster, no Wikidata lexeme dump, no daily sync, no API, no deploy.


2. Sources to start with (five)

Source Role Exact input (pinned in sources.config) Coverage in MVP-0 License
Open English WordNet 2025, plus edition the canonical lexical graph: synsets, glosses, hypernym and meronym edges (the hyponym/holonym inverses are derived once at absorb), similar, ILI ids, and a Wikidata QID on 22,036 synsets english-wordnet-2025-plus-json.zip (11 MB) from the 2025-edition GitHub release. The base english-wordnet-2025-json.zip holds only 107,519 synsets and fails A2 full (measured: 120,564 synsets, 161,814 lexemes) CC BY 4.0
Wiktionary via Kaikki headwords, senses (glosses/tags/topics/examples), IPA, etymology, inflected forms, derived/related/synonym/hypernym/hyponym linkages, sense-level Wikidata QIDs, topical categories raw-wiktextract-data.jsonl.gz (2.6 GB gz, all languages), filtered to lang_code == "en"; dump and extraction dates recorded; raw trimmed (drop translations, descendants, *_templates) index full (every English entry β†’ bare lexeme with forms and its en: topical categories in metadata), records scoped (Animals) CC BY-SA 4.0
Wikidata items concepts keyed by QID; description; sitelinks; image (P18); taxonomy (P171, P105, P225, P1843); P31/P279; the P13176 bridge from an everyday concept to its taxon item wbgetentities, 50 QIDs per request, languages=en|mul, sitefilter=enwiki, trimmed to 15 properties (S2); parents walked to closure over P171 and P13176 only; the per-item Special:EntityData URL stays as each record's link back scoped CC0
Wikipedia the encyclopedia layer: extract, short description, thumbnail, wikibase_item, disambiguation flag and candidates the Action API (20 titles per request, redirects resolved server-side; S2) in two passes: every scope lemma as a title probe, then every concept with an enwiki sitelink (--concepts, which is what makes A7 100 %); disambiguation pages read once for up to 100 candidate links scoped CC BY-SA 4.0
Bierce, The Devil's Dictionary (1911) the layer proof; the brand Gutenberg #972 HTML edition, checked in at priv/sources/bierce/972-h.htm; absorb/2 segments the document, materialize/1 parses each entry's own markup full (measured: 997 entries, 996 headwords, 247 verse blocks; 64 in Animals) public domain

Zero API keys, zero accounts. Every input is a file we pin or a public endpoint hit politely (identifying User-Agent, ≀ 5 req/s, cached in source_records).

Deferred, in order: Wikidata lexemes dump (P5137 bridge, 614 MB) Β· Johnson 1755 (LEME TEI-XML, CC BY 4.0) Β· Webster 1913 (GCIDE 0.54) Β· EB1911 (Britannica11 corpus, CC BY-SA) Β· Merriam-Webster (1k/day, non-commercial) Β· Urban Dictionary (on demand, attributed, never stored in bulk) Β· Datamuse Β· Voltaire Β· Guardian (#63) Β· media providers (Β§5, "Media"). Details and probe results are in the v1 comment.


3. Scope: Animals

A lexeme is in animals if any rule matches. Each match is recorded in scope_lexemes.reasons.

Rule Reason tag Expected size
lemma of any synset in the OEWN hyponym closure of animal.n.01 (oewn-00015568-n), run as a recursive CTE over the stored hyponym edges wordnet_closure predicted 7,681 lemmas; measured 7,692 lexemes (5,665 only by this rule)
Wiktionary entry carries one of the 231 categories of the en:Animals tree. The dump only has flat category strings, so the tree is walked once to depth 4 over the Wiktionary API by mix dd.scope.categories (12 subtrees denylisted: body parts, animal products, equestrian gear and sport, veterinary medicine, a toy franchise, the thesaurus mirror) and pinned in scopes.rules, so scope building stays offline wiktionary_category measured 15,612 (13,585 only by this rule)
English P1843 common name of a Wikidata taxon whose P171 chain reaches Animalia (Q729) and that has an enwiki sitelink wikidata_taxon measured in S2

Membership is by lemma: if dog is in scope, its noun, verb and adjective entries are all absorbed. Measured total: 21,277 lexemes (5,665 by WordNet only, 13,585 by category only, 2,027 by both; the Wikidata rule lands in S2 and only adds reasons). The estimate was 8k–12k; the category tree's long tail (breeds, livestock, fossil groups, species names) is the difference. Decision 2026-09-05: keep the whole scope. Enrich in reason order (WordNet closure first, category-only tail second) so the flagship numbers arrive early, and budget on-demand fetch time separately from dump absorbs (O2).

Full index, scoped enrichment. Every English Wiktionary headword exists as a lexeme row (β‰ˆ1.4M, including form-of entries such as plurals). WordNet is absorbed in full. Only Wiktionary records, Wikidata concepts and Wikipedia entries are limited to the scope. A word outside the scope still has a page; it is just sparse.


4. Schema

Conventions. Bigint identity ids. timestamps(type: :utc_datetime_usec). Enum-like columns are strings with Ecto.Enum, never Postgres enum types. Lemmas are case-sensitive text with a lower(lemma) index (so Turkey and turkey never merge); slugs are lowercase. Raw payloads are JSONB with load_in_query: false. One baseline migration create_lexicon_schema; pg_trgm enabled in it.

erDiagram
  SOURCES ||--o{ SOURCE_RECORDS : "absorbs into"
  SOURCES ||--o{ SENSES : asserts
  SOURCES ||--o{ ENTRIES : publishes
  SOURCES ||--o{ LEXICAL_RELATIONS : asserts
  SOURCES ||--o{ CONCEPT_RELATIONS : asserts
  SOURCES ||--o{ CONCEPT_LINKS : asserts
  SOURCES ||--o{ IMPORT_RUNS : runs
  SOURCE_RECORDS ||--o{ SENSES : materializes
  SOURCE_RECORDS ||--o{ ENTRIES : materializes
  LEXEMES ||--o{ SENSES : has
  LEXEMES ||--o{ ENTRIES : has
  LEXEMES ||--o{ LEXICAL_RELATIONS : "from"
  LEXEMES ||--o{ CONCEPT_LINKS : links
  LEXEMES ||--o{ SCOPE_LEXEMES : "is in"
  LEXEMES o|--o| LEXEMES : "canonical variant"
  SCOPES ||--o{ SCOPE_LEXEMES : contains
  SENSES ||--o{ LEXICAL_RELATIONS : "from (optional)"
  SENSES ||--o{ CONCEPT_LINKS : "links (optional)"
  CONCEPTS ||--o{ CONCEPT_LINKS : "linked by"
  CONCEPTS ||--o{ ENTRIES : "described by"
  CONCEPTS ||--o{ CONCEPT_RELATIONS : "from"
  CONCEPTS o|--o| CONCEPTS : "taxon item"
  PEOPLE ||--o{ ENTRIES : authored

  SOURCES {
    bigint id PK
    string slug UK
    string tier "aristocracy | middle | plebs"
    string kind "dictionary | encyclopedia | lexical_db | knowledge_graph | media_provider | crowd | bot | corpus"
    string access "dump | api | static | user"
    string url_template "link out when a record has no url"
    string license
    jsonb config "dump url, snapshot date, rate limit"
  }
  SOURCE_RECORDS {
    bigint id PK
    bigint source_id FK
    string external_id "synset id, word/pos/etym, QID, pageid, HEADWORD/pos"
    string url "canonical url at the source"
    jsonb raw "trimmed, load_in_query false"
    string content_hash
    datetime fetched_at
    datetime changed_at "hash changed on refetch"
    datetime materialized_at
    datetime absent_until "set on source-had-nothing markers"
  }
  LEXEMES {
    bigint id PK
    text lemma "case-sensitive, lower() index"
    string pos "default unknown"
    string lang "en"
    string slug "not unique, the page key"
    jsonb forms "inflections with tags"
    jsonb pronunciations
    text etymology
    bigint canonical_lexeme_id FK "spelling variant to canonical"
    bigint origin_source_id FK "who introduced the word"
    int_array source_ids "who attests it, cached"
    jsonb metadata "disambiguation title, etc"
    datetime enriched_at "nil = bare index row"
  }
  SENSES {
    bigint id PK
    bigint lexeme_id FK
    bigint source_id FK
    bigint source_record_id FK
    string external_id
    string group_key "WordNet synset id, nil for Wiktionary"
    text gloss
    string url "optional anchor, else record url"
    int position
    string_array tags
    string_array topics
    jsonb examples
    jsonb metadata "etymology_number, QIDs, ili"
  }
  ENTRIES {
    bigint id PK
    bigint source_id FK
    bigint source_record_id FK
    bigint lexeme_id FK "nullable"
    bigint concept_id FK "nullable"
    bigint author_id FK "nullable"
    string headword
    string pos
    text body
    string body_format "text | markdown | html"
    string url
    string thumbnail_url
    int year
    int position
    jsonb metadata
  }
  LEXICAL_RELATIONS {
    bigint id PK
    bigint source_id FK
    bigint from_lexeme_id FK
    bigint from_sense_id FK "nullable"
    text to_lemma
    string to_pos
    bigint to_lexeme_id FK "nullable until resolved"
    bigint to_sense_id FK "nullable"
    string to_group_key
    string type "hypernym | hyponym | meronym | holonym | synonym | antonym | derived | related | coordinate | form_of | alt_of | see_also | other"
    string subtype
    float weight
    jsonb metadata
  }
  CONCEPTS {
    bigint id PK
    string qid UK
    string label
    text description
    string kind "taxon | thing | other"
    string wikipedia_title
    int wikipedia_pageid
    string image_url "Wikipedia thumbnail or Wikidata P18"
    string image_attribution
    string wordnet_ili
    jsonb taxon "rank, scientific_name, common_names"
    bigint taxon_concept_id FK "everyday concept to taxon item"
    jsonb metadata
  }
  CONCEPT_RELATIONS {
    bigint id PK
    bigint source_id FK
    bigint from_concept_id FK
    bigint to_concept_id FK
    string type "parent_taxon | subclass_of | instance_of | part_of | related"
    string property "P171, P279, P31"
  }
  CONCEPT_LINKS {
    bigint id PK
    bigint lexeme_id FK
    bigint sense_id FK "nullable"
    bigint concept_id FK
    bigint source_id FK "nullable"
    string method "wiktionary_qid | wordnet_wikidata | wikidata_p5137 | wordnet_ili | title_match | disambiguation | manual"
    float confidence
    string status "auto | candidate | confirmed | rejected"
    jsonb metadata
  }
  SCOPES {
    bigint id PK
    string slug UK
    jsonb rules
    jsonb stats
  }
  SCOPE_LEXEMES {
    bigint scope_id PK
    bigint lexeme_id PK
    string_array reasons
  }
  IMPORT_RUNS {
    bigint id PK
    bigint source_id FK
    bigint scope_id FK "nullable"
    string task
    string status "running | done | failed"
    jsonb stats
    text error
    datetime started_at
    datetime finished_at
  }
  PEOPLE {
    bigint id PK
    string name
    string slug UK
    date birth_date
    date death_date
    string wikidata_id
    bigint source_id FK "nullable"
  }
Loading

Tables, column by column

# sources β€” one row per provider, human channel or bot. Tier, kind, access and license live HERE, never on content rows.
schema "sources" do
  field :slug, :string                         # "wordnet" "wiktionary" "wikidata" "wikipedia" "bierce" Β· later "community" "youtube" "bierce-bot"
  field :name, :string
  field :tier, Ecto.Enum, values: [:aristocracy, :middle, :plebs]
  field :kind, Ecto.Enum, values: [:dictionary, :encyclopedia, :lexical_db, :knowledge_graph, :media_provider, :crowd, :bot, :corpus]
  field :access, Ecto.Enum, values: [:dump, :api, :static, :user]
  field :era_year, :integer                    # 1911, 2025 …
  field :license, :string                      # "CC BY-SA 4.0"
  field :license_url, :string
  field :homepage, :string
  field :url_template, :string                 # "https://en.wiktionary.org/wiki/{lemma}#English" β€” link out when a record has no url
  field :attribution, :string                  # the line we must show
  field :active, :boolean, default: true
  field :config, :map, default: %{}            # dump url, snapshot/dump date, rate_limit_ms, budget, trim rules
  has_many :source_records, SourceRecord
  timestamps(type: :utc_datetime_usec)
end
# unique(slug)
# source_records β€” the truth we fetched, trimmed to what we use. One row per (source, external_id). Replaced, never edited.
schema "source_records" do
  belongs_to :source, Source
  field :external_id, :string                  # see the mapping table below
  field :url, :string                          # canonical URL of this record at the source (the "link back")
  field :raw, :map, load_in_query: false       # payload, trimmed per sources.config.trim
  field :content_hash, :string                 # sha256(raw)
  field :fetched_at, :utc_datetime_usec        # last fetch
  field :changed_at, :utc_datetime_usec        # set when a refetch changes content_hash β†’ "changed this week" feeds
  field :materialized_at, :utc_datetime_usec   # nil or < fetched_at = needs materialization
  field :absent_until, :utc_datetime_usec      # "source had nothing" marker (raw = %{}); retry after this
  timestamps(type: :utc_datetime_usec)         # inserted_at = first seen β†’ "new this week" feeds
end
# unique(source_id, external_id); index(source_id, materialized_at); index(absent_until); index(changed_at)
# lexemes β€” a word as a lexical unit: (lang, lemma, pos). The full English index lives here. Any source may create one.
schema "lexemes" do
  field :lang, :string, default: "en"
  field :lemma, :string                        # case-sensitive text; lookups use lower(lemma)
  field :pos, :string, default: "unknown"      # noun verb adj adv name phrase prefix … normalized; "unknown" for crowd sources
  field :slug, :string                         # slugify(lemma). NOT unique: /define/:slug shows every pos and every casing
  field :forms, {:array, :map}, default: []    # [%{"form" => "monkeys", "tags" => ["plural"]}] β†’ "monkeys" resolves here
  field :pronunciations, {:array, :map}, default: []   # [%{"ipa" => "/ˈkæt/", "audio" => url, "source" => "wiktionary"}]
  field :etymology, :string
  field :etymology_source_id, :integer
  belongs_to :canonical_lexeme, Lexeme         # spelling variant β†’ canonical (e-mail β†’ email); #60's redirect in the new model
  belongs_to :origin_source, Source            # who introduced this word (wiktionary for the index; urban for a crowd-only word)
  field :source_ids, {:array, :integer}, default: []   # who attests it; maintained by the materializer β†’ "crowd-only words" is a filter
  field :metadata, :map, default: %{}          # wikipedia_disambiguation_title, etc.
  field :enriched_at, :utc_datetime_usec       # nil = bare index row (no senses/entries yet)
  has_many :senses, Sense
  has_many :entries, Entry
  timestamps(type: :utc_datetime_usec)
end
# unique(lang, lemma, pos); index(lower(lemma)); index(slug); gin(lemma gin_trgm_ops); gin(forms); index(canonical_lexeme_id); index(enriched_at)
# senses β€” one meaning as asserted by ONE source. Structured dictionaries land here. Always short; always linked.
schema "senses" do
  belongs_to :lexeme, Lexeme
  belongs_to :source, Source
  belongs_to :source_record, SourceRecord
  field :external_id, :string                  # wiktionary: "word/pos/etym#n" Β· wordnet: "oewn-02124272-n#cat"
  field :group_key, :string                    # "same meaning" inside one source: WordNet synset id; nil for Wiktionary
  field :gloss, :string                        # the short definition we show
  field :url, :string                          # optional anchor (e.g. Wiktionary senseid); falls back to the record url / source template
  field :position, :integer, default: 0
  field :tags, {:array, :string}, default: []          # archaic slang figurative transitive …
  field :topics, {:array, :string}, default: []        # zoology nautical …
  field :examples, {:array, :map}, default: []
  field :metadata, :map, default: %{}          # etymology_number, raw_glosses, wiktionary QIDs, wordnet ili
  timestamps(type: :utc_datetime_usec)
end
# unique(source_id, external_id); index(lexeme_id, source_id, position); index(group_key)
# entries β€” a text a source published about a word or a thing. Prose sources (Bierce, Wikipedia summaries) land here.
schema "entries" do
  belongs_to :source, Source
  belongs_to :source_record, SourceRecord
  belongs_to :lexeme, Lexeme                   # dictionaries attach to the word
  belongs_to :concept, Concept                 # encyclopedias attach to the thing; both allowed
  belongs_to :author, Person
  field :headword, :string                     # as printed: "CAT"
  field :pos, :string
  field :body, :string                         # what we render: a summary for living sources, full text for public-domain ones
  field :body_format, Ecto.Enum, values: [:text, :markdown, :html], default: :text
  field :url, :string                          # canonical link out
  field :thumbnail_url, :string                # Wikipedia summary thumbnail β†’ feeds
  field :year, :integer
  field :position, :integer, default: 0
  field :metadata, :map, default: %{}          # redirect_from, canonical title, extract length …
  timestamps(type: :utc_datetime_usec)
end
# check(lexeme_id IS NOT NULL OR concept_id IS NOT NULL); unique(source_record_id, position)
# index(lexeme_id, source_id); index(concept_id, source_id)
# lexical_relations β€” typed edges between words, with provenance, tolerant of targets we have not seen yet.
schema "lexical_relations" do
  belongs_to :source, Source
  belongs_to :from_lexeme, Lexeme              # always set
  belongs_to :from_sense, Sense                # set when the source is sense-precise (WordNet, Wiktionary sense-level)
  field :to_lemma, :string                     # always set, exactly as the source wrote it
  field :to_pos, :string
  belongs_to :to_lexeme, Lexeme                # filled by dd.resolve; nil until then
  belongs_to :to_sense, Sense                  # WordNet: the target synset's sense for to_lemma
  field :to_group_key, :string                 # WordNet target synset id β†’ UI can expand to all synonyms
  field :type, Ecto.Enum, values: [:hypernym, :hyponym, :meronym, :holonym, :synonym, :antonym,
                                   :derived, :related, :coordinate, :form_of, :alt_of, :see_also, :other]
  field :subtype, :string                      # the source's label when :other ("instance_hypernym", "entails" …)
  field :weight, :float, default: 1.0
  field :metadata, :map, default: %{}          # Wiktionary "sense" qualifier, tags
  timestamps(type: :utc_datetime_usec)
end
# unique(source_id, from_lexeme_id, coalesce(from_sense_id, 0), to_lemma, type)
# index(lower(to_lemma)) WHERE to_lexeme_id IS NULL; index(from_lexeme_id, type); index(to_lexeme_id, type)
# concepts β€” a thing, keyed by Wikidata QID. Encyclopedias attach here; words reach here through concept_links.
schema "concepts" do
  field :qid, :string                          # "Q146"
  field :label, :string
  field :description, :string                  # Wikidata description / Wikipedia short description
  field :kind, Ecto.Enum, values: [:taxon, :thing, :other], default: :thing
  field :wikipedia_title, :string
  field :wikipedia_pageid, :integer
  field :image_url, :string                    # Wikipedia summary thumbnail, else Wikidata P18 via Commons β†’ feeds, cards
  field :image_attribution, :string            # Commons license/author line
  field :wordnet_ili, :string
  field :taxon, :map                           # %{"rank" => "species", "scientific_name" => "Felis catus", "common_names" => [...]}
  belongs_to :taxon_concept, Concept           # dog (Q144, everyday concept) β†’ Canis lupus familiaris (Q26972265, taxon item)
  field :metadata, :map, default: %{}
  has_many :entries, Entry
  timestamps(type: :utc_datetime_usec)
end
# unique(qid); index(wikipedia_title); index(taxon_concept_id)
# concept_relations β€” encyclopedic edges. In MVP-0: the Wikidata taxonomy.
schema "concept_relations" do
  belongs_to :source, Source
  belongs_to :from_concept, Concept
  belongs_to :to_concept, Concept
  field :type, Ecto.Enum, values: [:parent_taxon, :subclass_of, :instance_of, :part_of, :related]
  field :property, :string                     # "P171" "P279" "P31"
  timestamps(type: :utc_datetime_usec)
end
# unique(from_concept_id, to_concept_id, type, source_id); index(to_concept_id, type)
# concept_links β€” the word ↔ thing bridge. Every link records how we know and how sure we are. The template for every later edge.
schema "concept_links" do
  belongs_to :lexeme, Lexeme                   # always set
  belongs_to :sense, Sense                     # set when the method is sense-precise
  belongs_to :concept, Concept
  belongs_to :source, Source                   # who asserted it (wiktionary, wikidata); nil for title_match / disambiguation
  field :method, Ecto.Enum, values: [:wiktionary_qid, :wordnet_wikidata, :wikidata_p5137, :wordnet_ili, :title_match, :disambiguation, :manual]
  field :confidence, :float                    # 0.95 0.90 0.85 0.70 0.40β†’0.60 1.00 by method, adjusted by checks
  field :status, Ecto.Enum, values: [:auto, :candidate, :confirmed, :rejected], default: :auto
  field :metadata, :map, default: %{}          # disambiguation page, competing QIDs, gloss-match score
  timestamps(type: :utc_datetime_usec)
end
# unique(lexeme_id, coalesce(sense_id, 0), concept_id, method); index(concept_id); index(lexeme_id, status)
# scopes + scope_lexemes β€” a scope is data. "animals" is one row.
schema "scopes" do
  field :slug, :string                         # "animals"
  field :name, :string
  field :rules, :map                           # %{"wordnet_roots" => ["oewn-00015568-n"], "wiktionary_categories" => ["en:Animals"], "wikidata_root" => "Q729"}
  field :stats, :map, default: %{}             # counts per reason, last built
  timestamps(type: :utc_datetime_usec)
end
# unique(slug)

schema "scope_lexemes" do                      # composite primary key (scope_id, lexeme_id)
  belongs_to :scope, Scope
  belongs_to :lexeme, Lexeme
  field :reasons, {:array, :string}, default: []   # "wordnet_closure" "wiktionary_category" "wikidata_taxon"
  timestamps(type: :utc_datetime_usec)
end
# index(lexeme_id)
# import_runs β€” every task run leaves a row. The dashboard and dd.score read these.
schema "import_runs" do
  belongs_to :source, Source
  belongs_to :scope, Scope
  field :task, :string                         # "index" "absorb" "link" "resolve" "materialize" "score"
  field :status, Ecto.Enum, values: [:running, :done, :failed], default: :running
  field :stats, :map, default: %{}             # counts, durations, snapshot pins, dry-run gaps
  field :error, :string
  field :started_at, :utc_datetime_usec
  field :finished_at, :utc_datetime_usec
end
# index(source_id, started_at)
# people β€” authors of layers. Bierce in MVP-0; Johnson, Webster later.
schema "people" do
  field :name, :string
  field :slug, :string
  field :birth_date, :date
  field :death_date, :date
  field :bio, :string
  field :wikidata_id, :string
  belongs_to :source, Source                   # the source this person authored, if any
  timestamps(type: :utc_datetime_usec)
end
# unique(slug)

Designed for, not built: the community and media layers (sketch)

Additive tables only. Every one of them is an edge with provenance, the same shape as concept_links.

# users β€” when auth arrives (Clerk or phx.gen.auth). Roles: reader, contributor, editor, admin.

# examples β€” "X is an example of this word." X is a thing we already have, a URL, a media item, or text.
schema "examples" do
  belongs_to :lexeme, Lexeme                   # nepotism
  belongs_to :sense, Sense                     # optional: which meaning
  field :kind, Ecto.Enum, values: [:concept, :url, :media, :text]
  belongs_to :concept, Concept                 # a public figure, a company … (Wikidata-keyed)
  belongs_to :media_item, MediaItem            # a video, a post, a song …
  field :url, :string                          # a news story
  field :body, :string                         # the sentence, or why it fits
  belongs_to :source, Source                   # "community" or a bot row β†’ tier plebs, provenance intact
  belongs_to :submitted_by, User
  field :status, Ecto.Enum, values: [:pending, :approved, :rejected], default: :pending
  field :score, :float, default: 0.0           # cached from votes
  timestamps(type: :utc_datetime_usec)
end

# media_items β€” links + metadata + thumbnails, never files. A provider is a sources row (kind: media_provider).
schema "media_items" do
  belongs_to :source, Source                   # youtube Β· tiktok Β· instagram Β· x Β· giphy Β· unsplash Β· spotify Β· genius Β· tmdb (via Cinegraph) Β· news Β· web
  belongs_to :source_record, SourceRecord      # the unfurl (oEmbed / OpenGraph) or provider API payload
  field :kind, Ecto.Enum, values: [:image, :video, :audio, :article, :post, :song, :gif, :scene]
  field :url, :string
  field :embed_url, :string                    # official embed only
  field :title, :string
  field :author, :string                       # handle, channel, artist
  field :thumbnail_url, :string
  field :metrics, :map, default: %{}           # likes, views, plays as reported; refreshed by enrich/2
  field :license, :string
  field :published_at, :utc_datetime_usec
  timestamps(type: :utc_datetime_usec)
end
# unique(source_id, url)

# attachments β€” a media item β†’ a word, a sense or a thing, with a role. (#67's evidence wall is role: :evidence.)
schema "attachments" do
  belongs_to :media_item, MediaItem
  field :target_type, :string                  # "lexeme" | "sense" | "concept"
  field :target_id, :integer
  field :role, Ecto.Enum, values: [:evidence, :illustration, :example, :quote_source]
  belongs_to :source, Source                   # community, a bot, or a provider search ("giphy search: monkey")
  belongs_to :submitted_by, User
  field :status, Ecto.Enum, values: [:pending, :approved, :rejected], default: :pending
  field :score, :float, default: 0.0
  timestamps(type: :utc_datetime_usec)
end
# unique(media_item_id, target_type, target_id, role); index(target_type, target_id, status)

# votes β€” polymorphic; humans and bots (#17) both vote.
schema "votes" do
  field :votable_type, :string                 # "example" | "attachment" | "sense" | "entry"
  field :votable_id, :integer
  belongs_to :user, User
  belongs_to :bot_source, Source               # a bot is a sources row
  field :value, :integer                       # +1 / -1
  timestamps(type: :utc_datetime_usec)
end
# unique(votable_type, votable_id, user_id); unique(votable_type, votable_id, bot_source_id)

examples and attachments may fold into one table when built; the point here is that nothing in the thirteen MVP-0 tables changes to support them.

How each source lands

Source source_records.external_id / url lexemes senses entries lexical_relations concepts / concept_links
WordNet synset id / en-word.net synset url; raw carries the synset plus a derived _edges list, because the corpus ships only hypernym and meronym edges and the inverses are computed once at absorb every lemma of every synset one per (synset, lemma); group_key = synset id; no synonym rows, synonymy is co-membership of a group β€” hypernym/hyponym/meronym/holonym, and similar/instance_hypernym/… as :other with subtype; sense-precise; resolved at absorb in one set-based update (R1 green in S0) ili and the synset's wikidata QID in senses.metadata
Wiktionary "word/pos/etymology_number" / wiktionary page url index pass: every English entry as a bare row with forms and metadata.wikt_categories; origin_source = wiktionary one per sense, scoped words only (trimmed raw) β€” entry- and sense-level linkages with to_lemma; form-of entries β†’ form_of; resolved by dd.resolve sense wikidata QIDs β†’ concept_links(wiktionary_qid, 0.95)
Wikidata QID / wikidata entity url β€” β€” β€” β€” concepts + image_url (P18) + concept_relations (P171 chased; P279/P31 recorded) + taxon + taxon_concept_id via P13176
Wikipedia the probed lemma, or concept:<QID> for the concept pass (not the pageid: a miss has no pageid, and two lemmas may share a page) / canonical article url β€” β€” one per concept (extract, description, thumbnail, url) β€” sets wikipedia_title/pageid; title_match links (0.70); a disambiguation hit stores the title on the lexeme and each candidate article as a disambiguation link at 0.40, raised to 0.60 when a Wiktionary sense gloss matches the candidate's description
Bierce "HEADWORD/pos" / gutenberg url + letter anchor; raw = the entry's own <p>/<pre> fragments with their kinds, segmented once at absorb creates the lexeme if the index lacks it (70 words are his alone) β€” one per entry (prose + verse as markdown, attribution kept), author by person slug resolved in the same transaction alternates (BABE or BABY) β†’ alt_of; "See X" β†’ see_also; [from X] β†’ related β€”

Design rules. Tier is inherited from the source. Words and things are different tables joined only by concept_links. Every normalized row points at its source_record, which carries the link back; re-materialization needs no network. Relations keep to_lemma forever. A scope is a row plus a filter. Enums are strings. Humans and bots are sources.


5. Pipeline

flowchart LR
  subgraph inputs["Pinned inputs"]
    WN["OEWN 2025 json.zip<br/>10 MB, full"]
    WK["Kaikki raw-wiktextract<br/>2.6 GB gz, lang=en, trimmed"]
    BI["Bierce, Gutenberg 972<br/>static text"]
  end
  subgraph ondemand["On demand, Oban enrich queue, ≀5 req/s"]
    WD["Wikidata EntityData<br/>per QID, image P18"]
    WP["Wikipedia REST summary<br/>per title, thumbnail,<br/>disambiguation candidates"]
  end
  IDX["dd.absorb wiktionary --index<br/>~1.4M bare lexemes + forms"]
  SC["dd.scope.build animals<br/>scope_lexemes + reasons"]
  RAW[("source_records<br/>trimmed raw, url, hash")]
  LEX[("lexemes Β· senses Β· entries<br/>lexical_relations")]
  CON[("concepts Β· concept_relations<br/>concept_links")]
  WK --> IDX --> SC
  WN --> SC
  WN --> RAW
  WK -->|"scoped records"| RAW
  BI --> RAW
  WD --> RAW
  WP --> RAW
  RAW -->|"materialize/1<br/>one transaction"| LEX
  RAW --> CON
  LEX -->|"QIDs from senses,<br/>title probes"| WD
  CON -->|"enwiki sitelinks"| WP
  LEX --> LNK["dd.link<br/>ladder β†’ concept_links"]
  CON --> LNK
  LEX --> RES["dd.resolve<br/>to_lexeme_id, canonical variants"]
  LNK --> SCORE["dd.score Β· dd.health<br/>PASS / FAIL table"]
  RES --> SCORE
Loading

The Absorb.Source behaviour (mirrors Cinegraph's ApiProcessors.Behaviour):

@callback slug() :: String.t()
@callback absorb(scope :: Scope.t() | nil, opts) :: {:ok, stats} | {:error, term}   # dump/static: stream β†’ source_records
@callback enrich(target, opts) :: {:ok, SourceRecord.t()} | {:absent, until} | {:error, term}   # api: one fetch (a lexeme, a concept, later a URL to unfurl)
@callback materialize(SourceRecord.t()) :: {:ok, %{lexemes: [], senses: [], entries: [], relations: [], concepts: [], links: []}}   # pure, idempotent
@callback trim(raw :: map) :: map                # drop what we never use before storing (Wiktionary: translations, descendants, templates)
@callback rate_limit_ms() :: non_neg_integer()

materialize/1 is pure; the Materializer writes its output and materialized_at inside one Repo.transaction with the record. Upserts on the unique keys above; running it twice is a no-op. The same enrich/2 shape later unfurls a pasted URL (oEmbed/OpenGraph) for the media layer.

Terminal states per (source Γ— target), copied from razrfly/cinegraph#1053:

State Definition Action
Fetched source_records row exists materialize; no network
Source-absent marker row with absent_until in the future skip until then
Needs fetch in scope, no row, no live marker enqueue EnrichWorker (api) or wait for the next absorb (dump)
Needs materialization materialized_at IS NULL OR < fetched_at, or a parity gap re-run materialize/1 locally

Oban queues: absorb: 1, enrich: 3 (per-source rate_limit_ms inside the worker), link: 2, maintenance: 1. Two workers: AbsorbWorker and EnrichWorker. Quota or 429 β†’ {:snooze, seconds}, never discard.

Mix tasks (every one prints numbers and writes an import_runs row):

mix dd.absorb wordnet                      # full
mix dd.absorb wiktionary --index           # bare lexemes + forms for every English entry
mix dd.scope.build animals                 # scope_lexemes; prints counts per reason
mix dd.absorb wiktionary --scope animals   # trimmed raw + senses + relations for scoped lemmas
mix dd.absorb wikidata --scope animals     # concepts, images, taxon chains for discovered QIDs
mix dd.absorb wikipedia --scope animals    # summaries + thumbnails for concepts; title probes; disambiguation candidates
mix dd.absorb bierce                       # full
mix dd.resolve                             # fill to_lexeme_id and canonical variants; prints unresolved by type
mix dd.link --scope animals                # ladder; prints confidence histogram + conflicts + candidates
mix dd.materialize --source wiktionary --dry-run   # parity report, raw vs derived, no network
mix dd.health                              # coverage per source, unresolved, parity, disputed links
mix dd.score                               # Β§7 as a PASS/FAIL table with actuals

Linking ladder (each link stores method + confidence; conflicts are surfaced, never resolved silently):

# Method Signal Confidence
1 wiktionary_qid Wiktionary sense carries wikidata: ["Q146"] (sparse: 752 of the 31,116 Animals senses carry one, measured in S1, so the load falls on rungs 2 and 4) 0.95
2 wordnet_wikidata the OEWN synset itself carries a wikidata QID (22,036 synsets, kept in senses.metadata) 0.90
3 wordnet_ili OEWN ILI ↔ Wikidata P8814 where present 0.85
4 title_match Wikipedia title == lemma, page not a disambiguation, wikibase_item present, pos = noun or name (proper nouns are things too) 0.70
5 disambiguation title probe hit a disambiguation page: each linked article becomes a candidate at 0.40; raised to 0.60 when a Wiktionary sense gloss matches the candidate's description; the page title is stored on the lexeme for a "may refer to" panel 0.40 β†’ 0.60
6 manual editor override 1.00

(wikidata_p5137 joins when the lexeme dump is absorbed.) Concept β†’ taxon: P13176 bridges an everyday concept to its taxon item (sparse: 109 in Animals); the P171 chain is walked to closure and recorded; P279/P31 are recorded, never chased.

Corroboration (S2). The QID rungs reach only ~21 % of the scope and title_match sits below L1's 0.8 bar, so a corroboration pass raises a title match when an independent signal agrees, recording which in metadata.corroboration: the concept is a taxon whose P225 or English P1843 name is the lemma (β†’ 0.90); a QID rung already links the same pair (β†’ 0.90, confirmed); the article's description or extract shares β‰₯ 2 content words with a WordNet or Wiktionary gloss (β†’ 0.85). mix dd.link prints L1 both strict and corroborated.

Media: how any kind of media attaches (later, same machinery). A provider (YouTube, TikTok, Instagram, X, Giphy, Unsplash, Spotify/Genius, TMDb via Cinegraph, news) is a sources row of kind media_provider with its license and rate limit. Intake has two paths: a provider search run by a bot or an editor ("GIFs for monkey"), and a person pasting a link, which enrich/2 on a web source unfurls through oEmbed or OpenGraph. Either way the payload is a source_record, the normalized row is a media_items row (kind, url, official embed url, title, author, thumbnail, metrics, license), and the connection to a word, sense or thing is an attachments edge with a role, a submitter, a status and votes. We store links, thumbnails and metadata; never the file. Ranking is votes plus provider metrics, refreshed by enrich/2 on a schedule. The v1 comment's #67 flow (paste β†’ unfurl β†’ preview β†’ submit) is this path.

Tests. Real raw records for cat, dog, oyster from all five sources are checked in as fixtures. Context tests never touch the network; materialize/1 and trim/1 are tested as pure functions; LiveView tests key on element ids.


6. Pages

Six pages, deliberately plain, structurally complete. Visual direction comes in the design pass after MVP-0, using #66. Tier tint on cards is the only styling MVP-0 commits to. Every card links out (β†—) and opens provenance (β“˜).

2026-09-05: the reader-facing pages (home/search, word page and the hop, provenance, sparse states, a labelled fake-data mode) are specified in #71 on the Oatmeal theme (Tailwind Plus kit), theme boilerplate first. The developer surfaces stay here and plain. #66's three-tier treatment follows #71.

Route Page Must show
/ search trigram search over all ~1.4M lexemes and their forms; A–Z
/define/:slug word page headword block (all pos, IPA); source cards grouped by tier, each with β†— and β“˜; word-graph panel (broader / narrower / family / synonyms / taxon); image from the linked concept; "may refer to" panel when disambiguation candidates exist; "sources disagree" plaque; dashed card for not-yet-fetched on-demand sources
/s/animals scope browse taxonomy/WordNet tree; lexeme list with coverage badges (one glyph per source, tier-tinted); filters: has source X, missing source Y, disputed, crowd-only, bare
/sources/:slug source page tier, kind, license, attribution, snapshot pin, counts, coverage vs scope, sample entries
/admin/imports dashboard per source: fetched / absent / needs-fetch / needs-materialization; last run; health list; buttons for the tasks
drawer provenance raw (trimmed) JSON, external id, url, license, fetched/changed/materialized timestamps, links with method + confidence + status

W1, word page (desktop). Real absorbed content shown.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ ☰  wordhoard                    [ search a word…                 ]   Animals β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚  CAT                                                    in: Animals β€Ί Mammals β”‚
β”‚  /ˈkΓ¦t/ Β· noun (also verb)                       4 of 5 sources Β· 1 disagree  β”‚
β”‚  [ All ] [ πŸ‘‘ Dead ] [ πŸ“š Institutions ] [ πŸ“± Crowd ]      [ β“˜ provenance ]   β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ πŸ‘‘ ARISTOCRACY OF THE DEAD                     β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚
β”‚ ╔═══════════════════════════════════════════╗ β”‚ β”‚  (image Β· Wikipedia/     β”‚ β”‚
β”‚ β•‘ A soft, indestructible automaton provided β•‘ β”‚ β”‚   Commons Β· attribution) β”‚ β”‚
β”‚ β•‘ by nature to be kicked when things go     β•‘ β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚
β”‚ β•‘ wrong in the domestic circle.             β•‘ β”‚ THE WORD GRAPH               β”‚
β”‚ β•‘       β€” Ambrose Bierce, 1911   β†—  β“˜       β•‘ β”‚ broader                      β”‚
β”‚ β•šβ•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β• β”‚  cat β€Ί feline β€Ί carnivore β€Ί  β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€  mammal β€Ί vertebrate β€Ί animalβ”‚
β”‚ πŸ“š THE INSTITUTIONS                            β”‚  (WordNet βœ“ Wiktionary βœ“)    β”‚
β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ narrower (118)               β”‚
β”‚ β”‚ 1 Β· A mammal of the family Felidae.       β”‚ β”‚  domestic cat Β· wildcat Β·    β”‚
β”‚ β”‚ 2 Β· A domesticated species (Felis catus)… β”‚ β”‚  lion Β· tiger Β· ocelot …     β”‚
β”‚ β”‚ … 16 more senses   β€” Wiktionary   β†—  β“˜    β”‚ β”‚ word family (402)            β”‚
β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚  catnap Β· catwalk Β· catcall …│
β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ forms: cats                  β”‚
β”‚ β”‚ feline mammal usually having thick soft   β”‚ β”‚ synonyms                     β”‚
β”‚ β”‚ fur and no ability to roar …  8 synsets   β”‚ β”‚  grimalkin Β· housecat Β· puss β”‚
β”‚ β”‚              β€” Open English WordNet β†—  β“˜  β”‚ β”‚ taxon (Wikidata)             β”‚
β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚  Animalia β€Ί Chordata β€Ί       β”‚
β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚  Mammalia β€Ί Carnivora β€Ί      β”‚
β”‚ β”‚ Small domesticated carnivorous mammal.    β”‚ β”‚  Felidae β€Ί Felis β€Ί F. catus  β”‚
β”‚ β”‚ The cat, also called domestic cat and     β”‚ β”‚ may also refer to            β”‚
β”‚ β”‚ house cat, is a small …                   β”‚ β”‚  CAT scan Β· Cat (Unix) Β·     β”‚
β”‚ β”‚              β€” Wikipedia Β· Q146   β†—  β“˜    β”‚ β”‚  Caterpillar Inc. (candidates)β”‚
β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚ ⚠ sources disagree           β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€  senses: Wiktionary 18 Β·     β”‚
β”‚ πŸ“± THE CROWD                                   β”‚  WordNet 8                   β”‚
β”‚  (no crowd source in MVP-0; slot reserved)     β”‚ ON THIS WORD  Bierce βœ“       β”‚
β”‚                                                β”‚  Wiktionary βœ“ WordNet βœ“      β”‚
β”‚                                                β”‚  Wikipedia βœ“ Wikidata βœ“      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

W3, scope browse (/s/animals).

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ ANIMALS                                    8,412 words Β· 5 sources Β· 71% linkedβ”‚
β”‚ [ search within animals… ]  sort: coverage β–Ύ  filter: [has Bierce] [missing   β”‚
β”‚                             Wikipedia] [disputed] [crowd-only] [bare rows]    β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ TREE (taxon/WordNet) β”‚  πŸ–Ό cat        5/5  πŸ‘‘ πŸ“šπŸ“šπŸ“šπŸ“š   Felidae                β”‚
β”‚ β–Ύ Animalia           β”‚  πŸ–Ό dog        5/5  πŸ‘‘ πŸ“šπŸ“šπŸ“šπŸ“š   Canidae                β”‚
β”‚   β–Ύ Chordata         β”‚  πŸ–Ό oyster     5/5  πŸ‘‘ πŸ“šπŸ“šπŸ“šπŸ“š   Ostreidae              β”‚
β”‚     β–Ύ Mammalia       β”‚  πŸ–Ό hyena      5/5  πŸ‘‘ πŸ“šπŸ“šπŸ“šπŸ“š   Hyaenidae              β”‚
β”‚       β–Ύ Carnivora    β”‚  πŸ–Ό aardvark   4/5     πŸ“šπŸ“šπŸ“šπŸ“š   Orycteropodidae        β”‚
β”‚         β–Έ Felidae 41 β”‚     axolotl   3/5     πŸ“šπŸ“šπŸ“š     Ambystomatidae         β”‚
β”‚         β–Έ Canidae 38 β”‚  …                                                       β”‚
β”‚       β–Έ Rodentia 212 β”‚  ── no dead author wrote about 8,394 of these ──        β”‚
β”‚     β–Έ Aves 1,102     β”‚                                                 β€Ή 1 2 3 β€Ίβ”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

W5, import dashboard (/admin/imports).

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ IMPORTS Β· scope: [ animals β–Ύ ]                                   ● oban ok    β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ source         β”‚ access β”‚ fetched β”‚ absent  β”‚ needs    β”‚ needs    β”‚ last run β”‚
β”‚                β”‚        β”‚         β”‚         β”‚ fetch    β”‚ material.β”‚          β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ wordnet        β”‚ dump   β”‚ 120,630 β”‚    β€”    β”‚      0   β”‚     0    β”‚ 2h ago βœ“ β”‚
β”‚ wiktionary     β”‚ dump   β”‚  8,102  β”‚    β€”    β”‚    310   β”‚     0    β”‚ 2h ago βœ“ β”‚
β”‚ wikidata       β”‚ api    β”‚  6,220  β”‚    41   β”‚  1,120   β”‚    12 ⚠  β”‚ running… β”‚
β”‚ wikipedia      β”‚ api    β”‚  5,980  β”‚   120   β”‚  1,300   β”‚     0    β”‚ running… β”‚
β”‚ bierce         β”‚ static β”‚    966  β”‚    β€”    β”‚      0   β”‚     0    β”‚ 3d ago βœ“ β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ HEALTH  ● 71% lexemes linked  ● 2,113 unresolved targets  ⚠ 38 disputed links β”‚
β”‚         ● 412 disambiguation candidates  ● parity: 0 gaps                     β”‚
β”‚         [absorb β–Ύ] [resolve] [link] [materialize --dry-run] [score]           β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Mobile word page, source page and provenance drawer wireframes are in the v1 comment (W2, W4, W6).


7. What "done" means: the scorecard

mix dd.score computes every row that can be computed and prints PASS / FAIL with the actual number. MVP-0 is done when every row passes. Rows marked report have no threshold; their number is the finding.

ID Check Measured by Pass
A1 all five sources absorbed import_runs with status done + a pin per source: a dump pins its file date, a book its Gutenberg id, an API the day of its last finished run 5 / 5 Β· measured 5 / 5 βœ…
A2 WordNet is full (plus edition) synset groups / distinct lexemes (lemma, pos) with senses β‰₯ 120,000 / β‰₯ 155,000 Β· measured 120,564 / 161,814 βœ…
A3 Wiktionary index is full lexemes with lang = en; lexemes with forms β‰₯ 1,200,000; report Β· measured 1,534,818 / 566,239 βœ…
A4 scope built with reasons scope_lexemes for animals; every row has β‰₯ 1 reason; counts per reason β‰₯ 7,500 and report Β· measured 21,277, 0 without reason βœ…
A5 Wiktionary coverage of scope, English headwords scope lexemes attested by Wiktionary, excluding lemmas Wiktionary files as Translingual: a Linnaean binomial (^[A-Z][a-z]+ [a-z]+$) or a scientific name of any rank (the lemma equals a linked concept's taxon.scientific_name); the excluded set and the other misses counted and listed by kind β‰₯ 90 % of the remainder Β· S1: 92.2 % excl. binomials; after S2's scope growth 85.0 %, on the bar only because genus, family and order names (Archilochus, Paguridae, Therapsida) counted as misses. v12 (S4 audit): excluding every scientific name gives 93.0 % (4,004 of 5,506 misses excluded); bar raised to 90 %; βœ… S4c 900ea5d
A6 Wikidata coverage every QID referenced by a link or relation has a concepts row; plus scope coverage by Wikidata reported next to Wiktionary's, the union of the two expected to approach 100 % because the binomials A5 excludes are Wikidata taxon names 100 % Β· union report Β· measured 42,753 referenced, 0 dangling βœ…; union 97.4 %
A7 Wikipedia coverage v13: concepts a scope word links to at auto/confirmed that were answered (an entry, a disambiguation page, no extract, or an absent marker); the sitelinked population reported beside it β€” a 0.40 candidate is a thing a page merely mentioned, and every summary names more 100 % of asserted Β· S5: 10,412 / 10,412 βœ…, 77.6 % incl. candidates
A8 Bierce is full and attached entries (the text holds 997, not 966); index hit rate = headwords another source already attested (attachment is 100 % by construction) 997; hit rate report Β· measured 997, 93.0 % βœ…
A9 links back everywhere senses and entries with a url of their own, a record url, or a source url_template 100 %
A10 images concepts with an image_url among the concepts the scope's words link to by asserted links (auto/confirmed); the all-concepts figure reported β‰₯ 80 % Β· measured 9,607 / 10,261 = 93.6 % βœ… (70 % over every concept with an entry)
M1 parity dd.materialize --dry-run gaps, all five sources 0
M2 idempotent, offline mix dd.materialize --all per source records the row counts it saw before and after in import_runs; the score reads the latest --all of every source identical Β· measured identical over 271,296 records, all five sources βœ…
M3 atomic writes test injects a failure inside materialize; no record without materialized_at and no derived rows for it passes
M4 trimmed raw mean trimmed Wiktionary record size vs untrimmed on the fixtures; no materialized field lost β‰₯ 50 % smaller; 0 lost
R1 WordNet edges resolved lexical_relations from WordNet with to_sense_id 100 % Β· measured 1,047,918 / 1,047,918 in S0 βœ…
R2 Wiktionary edges resolved Wiktionary edges with to_lexeme_id after dd.resolve β‰₯ 80 %, unresolved report by type
R3 chains render word page for cat shows a hypernym chain reaching animal from β‰₯ 2 sources yes
L1 link rate (the unknown) scope lexemes with β‰₯ 1 concept_link at confidence β‰₯ 0.8, as a share of the scope lexemes for which an English Wikipedia article exists; the raw share, the share with any link and the strict-ladder share reported beside it β‰₯ 70 % of the reachable set (a scope lexeme whose Wikipedia record is not an absent marker, computed by Health.links/2) Β· measured after S3: 82.5 % of 18,028 reachable βœ… (raw 58.6 %; any link 68.4 %; strict 25.4 %). Amended 2026-09-05: 6,840 scope lemmas have no English article at all
L2 conflicts surfaced links where two concepts score β‰₯ 0.7 for one lexeme/sense are listed on the dashboard listed, count report
L3 taxonomy reaches concepts linked by asserted links (auto/confirmed) with a parent_taxon path to Animalia (Q729), directly or via taxon_concept_id; the with-candidates figure reported β‰₯ 60 % Β· measured 7,918 / 10,261 = 77.2 % βœ… (26.6 % incl. candidates)
L4 disambiguation handled scope lemmas with a nominal lexeme whose title probe hit a disambiguation page: flag stored on the lexeme, candidates stored as candidate links (up to 100 per page) 100 % of hits Β· measured 1,753 / 1,753 βœ…, 39,143 candidates
X1 every word has a page 200 random index lexemes rendered via /define/:slug 0 errors
X2 search is fast trigram prefix + fuzzy search over the full index, p95 locally < 150 ms
X3 forms and variants resolve named probes through Lexicon.lookup/1: monkeys β†’ monkey, cats β†’ cat, geese β†’ goose, spat keeps its page all probes Β· measured 4 / 4 βœ…
U1 six pages exist routes + LiveView tests all
U2 the flagship words cat, dog, oyster: β‰₯ 4 source cards across β‰₯ 2 tiers; graph panel with β‰₯ 3 relation types; taxon chain; image all three
U3 provenance everywhere every card opens the drawer with raw JSON, external id, license, timestamps 100 % of cards
U4 mobile word page and browse at 375 px, no horizontal scroll passes
U5 coverage is legible badges + filters on /s/animals, counts match dd.health passes
U6 every card links out β†— on every sense/entry card resolves to the source url 100 %
E1 a new source is cheap add Johnson 1755 after acceptance: touched = 1 sources row, 1 module, fixtures, tests; migrations = 0 0 migrations
E2 a new scope is data build a toy scope from one WordNet root (e.g. emotions) with dd.scope.build; run the scoped absorbs no code change
E3 the community layer fits write the examples + votes migration from Β§4's sketch against the MVP-0 schema; do not ship it 0 changes to existing tables
O1 the scorecard runs itself mix dd.score prints this table with actuals yes
O2 it is fast enough (a) empty DB β†’ WordNet, Wiktionary index and scoped records, Bierce, scope build; laptop, dumps pre-downloaded. (b) on-demand Wikipedia + Wikidata fetches for the whole scope at ≀ 5 req/s (a) ≀ 2 h wall clock (S0 took under 5 min); (b) report, expected β‰ˆ 2 h per source for 21k lexemes, cached forever after
O3 clean and offline-testable mix precommit green; test suite runs with no network on the checked-in fixtures green
O4 health page coverage per source, unresolved targets, link histogram, candidates, parity, disputed links all present

What you will actually be able to do when it passes: type any English word (or an inflected form of it) and get a page. For the ~8k–12k animal words, see Bierce, Wiktionary, WordNet and Wikipedia side by side, ordered by class, with an image, the hypernym chain, the derived-word family, synonyms, the taxon chain, and a "may also refer to" list where the word is ambiguous, and click β†— to go to the source or β“˜ to see exactly which record it came from and how sure we are. Browse animals as a tree with badges showing who bothered to define what. Watch the dashboard while a source absorbs. Turn the network off and rebuild every derived row from raw. Add the next dead author with one module. Write the examples-and-votes migration and watch it touch nothing.

What we expect to learn (reported by dd.score): scope size (A4), index size (A3), Wiktionary coverage of WordNet's scientific and multiword names (A5), the link rate (L1), how many scope words are ambiguous on Wikipedia (L4), and how much trimming saves (M4). If L1 lands far below 70 %, the linker gets another rung before any layer is added.


8. Build order

Tracked in #70 (reset procedure, per-session expectations, directory structure, checklist). Six sessions minimum, eight likely; every session ends with numbers posted there.

Session Produces Scorecard rows
S0 Reset & measure βœ… (58fdb81, 19bccaf) fresh app in place, baseline migration, Absorb.Source + Materializer, WordNet full, Wiktionary index, Animals scope A2 A3 A4, plus R1 and M4-on-fixtures
S1 Wiktionary & WordNet, scoped senses, forms, relations, resolver, parity, trimmed raw, links back A5 A9 M1 M4 R1 R2 X3
S2a/b Things βœ… (4a8cfcf) Wikidata + Wikipedia + enrich worker, then the linking ladder A6 A7 A10 L1–L4
S3 Bierce, health, score βœ… (3fcd293) Bierce layer, dd.health, dd.score, atomicity + offline re-materialize A8 M2 M3 O1 O3 O4 Β· first full scorecard: 24 / 24 graded rows pass
S4 U0 + S4b βœ… (0430e17, 08fadbc; audited B+; S4c βœ… 900ea5d) Oatmeal theme; browse, source page, dashboard, health, mobile Β· rule: nothing slower than the long-poll fallback in mount/3 X2 U4 U5 O2 βœ… Β· X1 U1–U3 U6 with #71's U1–U3
S5 Extensibility βœ… (9db7805, 270e48a; audited Aβˆ’) Johnson 1755, emotions, unshipped community migration; scopes as priv/scopes/*.json E1 E2 E3 βœ… Β· closing scorecard β†’ #71's U3

9. Hosting recommendation (for later)

Develop locally on plain Postgres (no Supabase features are used). When it deploys, use Kamal, the same as Argus and Cinegraph, and put it on the Argus Intel NUC as a second database on that Postgres instance. The dictionary DB is small (single-digit GB even with trimmed raw Wiktionary records for a few scopes), its load is bursty absorbs rather than a constant stream, and keeping it off the Cinegraph Mac Mini avoids sharing that box's PgBouncer pool and heavy Oban queues. Move to its own machine only if we go full-English with raw Wiktionary and Wikipedia, or add media at scale, or open it to the public.


10. Open items

  • Product name. devils_dictionary is internal; Wordhoard is the working title. Shortlist: Glossa, Marginalia, Polysemy, Necrolex. The obvious .com / .app / .io domains for all of them were already registered on 2026-09-05, so the brainstorm must start from availability. Decide before the app.
  • App direction. JSON API (/api/v1/words/:slug, /api/v1/scopes/:slug, feeds) after MVP-0; PWA = the LiveView site plus a manifest and a service worker; iOS = a native client over the API. Cinegraph's Absinthe setup is the reference if GraphQL is wanted.
  • Media providers to evaluate when the media layer starts: YouTube Data API, TikTok oEmbed, Instagram oEmbed (Meta app review), X API (paid tiers), Giphy, Unsplash, Spotify + Genius, TMDb via Cinegraph's catalogue, news via RSS. Each is a sources row; unfurl covers the rest.
  • Unknowns measured in S0–S3: every figure is in Β§7.
  • Resolved in S1b: content_hash is taken on the payload as fetched, before trim/1. A change to trim/1 therefore re-marks every record as changed (19,250 Wiktionary records got changed_at when the trim was tightened). Before feeds ship, hash the untrimmed payload, or version the trim and exclude trim-version changes from changed_at.
  • Resolved in S1b: index rows carry metadata.form_of; Lexicon.lookup/1 prefers a genuine bare headword only on an exact-case match, forms claimants under also. Lexicon.lookup/1 (S1) lets a word that lists the string among its forms win over a bare row, which is right for monkeys and wrong for a bare headword that happens to be a form of another word. The index pass already computes form_of?; storing it as metadata.form_of costs nothing and lets the lookup prefer genuine headwords. Do it in S4 if a case shows up.
  • Wiktionary multi-etymology words (bank has two noun entries): one lexeme row per (lemma, pos); senses keep etymology_number in metadata. Revisit if the word page needs to group by etymology.
  • Concepts without a QID (later sources such as EB1911 headwords that match nothing): qid stays required in MVP-0; relax to a partial unique index when needed.

11. References

Activity

  1. added
    documentationImprovements or additions to documentation
    enhancementNew feature or request
    on Sep 5, 2026
  2. holden commented on Sep 5, 2026

    @holden
    MemberAuthor

    Superseded directional draft (v1, 2026-09-05), kept verbatim for the source research, probe log, wireframes W2/W4/W6 and the deferred-layer plan. The issue body above is the MVP-0 implementation spec that replaced it.

    v1 draft (expand)

    TL;DR

    Change gears: stop hand-building definitions, absorb the word-graph first, then layer every dictionary and encyclopedia on top of it. This is the Cinegraph move (absorb the whole TMDb catalogue, then layer OMDb, festivals, lists on top) applied to words.

    • Verdict on starting over: keep the Phoenix shell, reset the domain schema. The current topics / definitions / topic_relationships model puts the tier on the definition row and the source in a free-text column, has no raw-record store, no notion of a sense, and no encyclopedic entity. It can't hold multiple sources honestly. There is one commit, demo seeds, and zero workers, so a reset costs nothing. (Β§2)
    • Durable spine = four open, bulk-downloadable sources: Wiktionary (via Kaikki), Open English WordNet 2025, Wikidata (lexemes + items), Wikipedia. Together they give us every English headword, its senses, pronunciations, etymology, hypernym/hyponym/derived/synonym edges, the taxonomy, and the encyclopedia article, all under CC BY / CC BY-SA / CC0. Everything else (Johnson 1755, Webster 1913, Bierce, EB1911, Merriam-Webster, Urban Dictionary) is a layer keyed to that spine. (Β§4)
    • MVP vertical slice = Animals. Bounded, measurable, and every source has something to say about a cat. Measured today: WordNet's animal subtree is 4,027 synsets / 7,681 lemmas; EB1911 has 901 animal articles; Bierce defines 18 animals. (Β§5)
    • Architecture copies Cinegraph: raw JSONB per (source Γ— record) β†’ idempotent materialization β†’ normalized tables; a Source behaviour per provider; Oban queues; terminal-state predicates; import dashboard + health checks. (Β§6–§8)
    • The hard problem is linking (dictionary word ↔ encyclopedia thing). We solve it with a resolution ladder that records method + confidence per link, and we show disagreement instead of hiding it. That is the product's thesis anyway. (Β§9)
    • Wireframes for the word page, Animals browse, source page, import dashboard, and provenance drawer are in Β§10. Phased build order with acceptance criteria in Β§11–§12.

    This issue supersedes the build order in #68 Β§4 (which was API-first, per-word fan-out). The vision (#64), the tier joke (#46/#66), relationships UX (#60), evidence wall (#67) and quotes (#65) all still apply and sit on top of what's proposed here.


    1. Where we actually are

    One commit (7c6dd33). Phoenix 1.8 / LiveView 1.1 / Postgres / Tailwind v4 / Oban / Req / Floki / Cachex, all wired. Four domain tables (topics, definitions, people, topic_relationships) + users + Oban. Three LiveViews (HomeLive, TopicLive at /define/:slug, BrowseLive). DictionaryAPI is an empty stub. Zero Oban workers. Seeds: 5 topics, 17 definitions. Tests: Phoenix defaults only. Full audit already in #68 Β§1; nothing has changed since.

    Found while researching this: the old Rails app is not lost. Its final commit is still on GitHub (dangling, but fetchable by SHA). It has all 14 API service objects and 37 models. Pin it before GitHub garbage-collects it:

    git fetch origin 36d3b153261d3bdb2602fbcd6cc2e67572162ecb && git tag rails-final FETCH_HEAD && git push origin rails-final

    app/services at that SHA: artsy, brainy_quotes, concept_net, datamuse, genius, giphy, knowledge_graph, open_library, poetry_db, samuel_johnson, tmdb, unsplash, urban_dictionary, wiki_quotes. Closes the "where is the Rails repo" question from #68 Β§5.


    2. Start over? Analysis and verdict

    Layer Keep or replace Why
    Phoenix app shell, deps, config, Oban/Req/Floki/Cachex, pg_trgm Keep Standard, correct, nothing to gain by regenerating
    users + Clerk-shaped Accounts Keep, still dormant Auth stays deferred (#68 recommendation stands)
    people Keep, extend Authors of layers (Bierce, Johnson, Webster). Add source_id, keep wikidata_id
    topics Replace with lexemes + concepts A "topic" conflates the word (lexical unit: cat, noun) with the thing (encyclopedic entity: Q146). Dictionaries attach to words; encyclopedias attach to things. They need different keys (lemma+pos vs QID) and different relations (hypernym vs parent taxon)
    definitions Replace with entries + senses + source_records Tier and source are properties of the source, not the row. There is no raw record, so nothing can be re-materialized without re-fetching (the exact failure Cinegraph hit in razrfly/cinegraph#1053). No sense granularity, so a 23-sense Wiktionary entry becomes one blob
    topic_relationships Replace with sense_relations + concept_relations Edges need provenance (which source asserted cat β†’ feline?) and unresolved targets (Wiktionary says hypernym carnivore before we have a carnivore lexeme). #60's relationship types and UI patterns survive as a view over the new tables
    TopicLive / DictionaryComponents tier styling Keep the visual language, re-point the data The gilded/corporate/social treatment is the brand. It now keys off source.tier
    Migrations Rewrite as one clean baseline No production data exists. Cinegraph did the same (create_clean_cri_schema). Don't carry six migrations of a model we're abandoning
    Seeds Replace with fixtures for 3 words (cat, dog, oyster) Real absorbed data replaces hand-typed demo content

    Verdict: reset the domain layer, keep the shell. Roughly two days of throwaway. The alternative (bolting source_id and raw onto definitions) leaves the word/thing conflation in place and we would be re-doing this in three months with data in the tables.


    3. The Cinegraph pattern we're copying

    What worked there, translated:

    Cinegraph Dictionary equivalent
    TMDb daily ID export β†’ discovery worker β†’ details worker Bulk dump (Kaikki / OEWN / Wikidata) streamed through a scope filter β†’ source_records
    movies.tmdb_data raw JSONB, load_in_query: false source_records.raw JSONB, load_in_query: false, one row per (source, external_id)
    external_metrics (one row per movie Γ— source Γ— metric) entries / senses / *_relations (one row per lexeme Γ— source Γ— fact)
    ApiProcessors.Behaviour (process_movie, can_process?, has_data?, rate_limit_ms) Absorb.Source behaviour (absorb/2 bulk, enrich/2 on-demand, materialize/1 pure, has_data?/1, rate_limit_ms/0)
    Maintenance module + Sweeper worker Same two-layer pattern: pure run/1 returning stats, thin cron Oban wrapper
    Terminal-state predicate: fetched (blob present) vs source-absent (fetch_attempt + cooldown) vs needs-fetch vs needs-materialization Identical, per (source Γ— lexeme). Blob presence is the proof we fetched. Materialization is measured per-fact, never by "a row exists"
    Blob + derived rows written in one transaction (#1053 4.0) Repo.transaction around raw + materialized writes from day one
    Health.Drift checks scoped to canonical movies Health checks scoped to the active scope (Animals)
    Import dashboard LiveView /admin/imports (Β§10 W5)

    4. Source research

    Everything below was probed on 2026-09-05. Full probe log in the collapsible at the end of this section.

    4a. The spine (bulk, open, durable)

    Source What we get Size / access License Probe
    Wiktionary via Kaikki (wiktextract, weekly) Every English headword: senses with glosses, tags, topics, examples; IPA; etymology; forms; hypernyms / hyponyms / meronyms / holonyms / synonyms / antonyms / derived / related / coordinate terms; sense-level Wikidata QIDs; topical categories (en:Cats, en:Dogs, en:Mammals). ~1.39M English forms (964k nouns) English extract 502 MB gz / 3.0 GB JSONL (dump 2026-08-05, extracted 2026-08-28). Kaikki marks the per-language file deprecated; the durable path is the all-language raw-wiktextract-data.jsonl.gz (2.6 GB gz / 22.9 GB) filtered to lang_code == "en" CC BY-SA 4.0 (Wiktionary); wiktextract MIT dog noun: 23 senses, 8 hypernyms, 759 derived terms, sense QID Q144, IPA. cat noun: 18 senses, 118 hyponyms, 402 derived
    Open English WordNet 2025 (released 2025-12-31) Synsets, lemmas, definitions, examples, and the canonical hypernym/hyponym/meronym/holonym graph with ILI ids. 2024 edition: 120,630 synsets / 161,705 words / 418,168 relations 10 MB JSON zip, or XML (GWN-LMF), RDF, WNDB CC BY 4.0 animal.n.01 closure: 4,027 synsets, 7,681 lemmas (2,607 single-word), 4,061 hyponym edges
    Wikidata lexemes Lexeme (L-id) β†’ forms β†’ senses with gloss and P5137 "item for this sense" = the bridge from word to thing latest-lexemes.json.gz 614 MB. Live counts: 74,860 English lexemes, 59,818 senses (P5137 coverage not yet measured; query times out, measure from dump in Phase 0) CC0 dog L1122: 3/3 senses linked (Q144 dog, Q5288153 tool, Q10538/Q9305 constellations). cat = L7
    Wikidata items Concepts keyed by QID: label, description, sitelinks, taxonomy (P171 parent taxon, P105 rank, P225 name, P1843 common names), P31/P279 Per-item Special:EntityData/Q146.json on demand, or SPARQL batches. Full item dump is ~100+ GB, don't CC0 Note the split: dog Q144 (everyday concept) β‰  Canis lupus familiaris Q26972265 (taxon, P171 β†’ Q18498 Canis lupus). Linking must handle both
    Wikipedia Article per concept: extract, short description, wikibase_item, redirects, disambiguation flags On demand: REST page/summary (200 req/s soft ceiling, returns QID + extract). Bulk: Wikimedia Enterprise free tier (since 2026-06-02: 50,000 on-demand req/month, 30 snapshot downloads/month, Structured Contents included). SQL tables if needed: page_props 471 MB, redirect 187 MB CC BY-SA 4.0 REST Cat β†’ Q146, "Small domesticated carnivorous mammal", extract. ⚠️ The CirrusSearch dumps are stale/deprecated (latest 2025-12-29, 43 GB, DEPRECATED.txt in the listing). Don't build on them

    4b. Dictionary layers (definitions, attach to lexemes)

    Source Tier Access License / terms Probe / notes
    Ambrose Bierce, The Devil's Dictionary (1911) πŸ‘‘ Project Gutenberg #972, static text, regex-parseable Public domain 966 headwords; 18 animals (alligator, ass, camel, cat, dog, frog, goose, hog, hyena, magpie, monkey, mouse, ostrich, oyster, pig, seal, tortoise, turkey)
    Samuel Johnson, A Dictionary (1755) πŸ‘‘ LEME (U. Toronto) TEI-XML transcription, CC BY 4.0 (Ian Lancashire; on TSpace). The UCF Johnson's Dictionary Online site is non-commercial-research-only and has no API; it also carries the 1773 edition (43,279 entries) CC BY 4.0 (LEME XML); JDO site restricted CAT: "A domestick animal that catches mice, commonly reckoned by naturalists the lowest order of the leonine species." Replaces the Rails-era Zyte scraper
    Webster's 1913 via GCIDE 0.54 (2024-12-31) πŸ‘‘ gcide-0.54.tar.xz 14.8 MB, SGML-ish markup (<ent>, <hw>, <pos>, <def>, [1913 Webster]), ~99k words / ~160k definitions. A separate GCIDE_XML exists 1913 text is public domain; GCIDE package is GPL (fine for content, note it) Parser needed; several community parsers exist to crib from
    Voltaire, Philosophical Dictionary (1764) πŸ‘‘ Gutenberg #18569 (+ vols #35621–35630) Public domain Optional in MVP; fits #64's Diderot/Voltaire framing
    Merriam-Webster Collegiate + Thesaurus πŸ“š API, key, 1,000 queries/day/key, non-commercial, 2 reference APIs MW terms; commercial needs an agreement On-demand only, cache forever, never bulk
    Wordnik πŸ“š API, key, ~1,000/day free Aggregates AHD/Century/Wiktionary/GCIDE/WordNet, not redistributable Skip: we already have its open constituents
    Oxford Dictionaries API πŸ“š Relaunched 2025-01-09, from Β£50/month Paid Skip for MVP
    Free Dictionary API (dictionaryapi.dev) πŸ“š No key Wiktionary-derived 15 s timeout then 19.7 s on retry. Superseded by Kaikki. Drop it

    4c. Encyclopedia layers (articles, attach to concepts)

    Source Tier Access License Probe / notes
    Wikipedia πŸ“š see 4a CC BY-SA 4.0 The living encyclopedia layer
    EncyclopΓ¦dia Britannica, 11th ed. (1911) πŸ‘‘ Britannica11.org corpus: 36,691 articles as Markdown + metadata + cross-reference graph + topic index (94 MB tar.gz); TEI-P5 edition 37,225 docs (105 MB), DOI on Zenodo. Source text is Wikisource CC BY-SA 4.0 Wikisource Category:EB1911:Science:Biology:Animals = 901 articles, a ready-made animal scope. CAT: "properly the name of the well-known domesticated feline animal usually termed by naturalists Felis domestica…"
    Diderot & d'Alembert, EncyclopΓ©die πŸ‘‘ ARTFL (U. Chicago) French original; Michigan's English translations are CC BY-NC-ND 3.0 Link, don't copy (translations) Later layer; the French text is public domain but needs its own parse
    Wikidata taxonomy πŸ“š see 4a CC0 The encyclopedic relationship spine for animals (parent taxon chain, ranks, common names)

    4d. Relationship helpers (weak signals, on demand)

    Source Status Use
    Datamuse Live, no key, 100k req/day until 2027-01-01, commercial use needs agreement. rel_gen = hyponyms, rel_spc = hypernyms, rel_com/rel_par = holonym/meronym, rel_trg = associations, md=d = definitions Noisy (rel_spc=cat β†’ "trounce, pass" because of verb senses). Weak signal for related chips only, never for the graph
    ConceptNet 5.7 API returned 502 in probe (long-standing instability). Dump conceptnet-assertions-5.7.0.csv.gz 498 MB, 34M edges, frozen since 2019 If used at all, from the dump, as a related signal. Not in MVP

    4e. Plebs layer (attach to lexemes; unlicensed, link out)

    Source Status Terms Use
    Urban Dictionary (api.urbandictionary.com/v0/define) Live, 200 in 0.43 s, 10 defs per term with thumbs_up/down, author, written_on, permalink Unofficial API, no license, UD ToS forbids bulk reuse On demand per word, cache with TTL, always attribute + link, never bulk import, never redistribute
    Kaggle "Urban Dictionary Words And Definitions" (2.6M rows) Exists Scraped; provenance unclear Don't import
    The Guardian Gen Z terms (#63) Static Quote + link Keep as planned in #63

    4f. Verdict

    Spine: Kaikki + OEWN + Wikidata + Wikipedia. They are the only sources that are simultaneously complete, bulk-downloadable, openly licensed, and maintained. They give us words, senses, pronunciations, etymology, the lexical graph, the taxonomy, and the encyclopedia article without a single API key.

    First layers: Bierce, Johnson 1755 (LEME), Webster 1913 (GCIDE), EB1911 (Britannica11). All public domain or CC BY(-SA), all static files, all "dead aristocracy" in the brand's sense. Then the on-demand living layers: Wikipedia summaries (πŸ“š), Merriam-Webster (πŸ“š, 1k/day), Urban Dictionary (πŸ“±).

    Probe log (2026-09-05)
    datamuse rel_gen=dog             -> cur, hound, pooch (hyponyms)           OK
    datamuse rel_spc=animal          -> organism, being, life form (hypernyms) OK
    dictionaryapi.dev /entries/en/dog -> timeout @15s; retry 200 in 19.7s     UNRELIABLE
    api.urbandictionary.com v0 dog   -> 200 in 0.43s, 10 defs                  OK (unlicensed)
    api.conceptnet.io /c/en/dog      -> 502 Bad Gateway                        DOWN
    en.wikipedia REST page/summary   -> Q144, description, extract             OK
    wikidata wbsearchentities lexeme -> L1122 dog/n, L31883 dog/v, L7 cat/n    OK
    wikidata L1122 senses            -> 3 senses, all with P5137               OK
    wikidata SPARQL English lexemes  -> 74,860; senses 59,818                  OK (P5137 count timed out)
    wikidata Q144 vs Q26972265       -> concept vs taxon split confirmed
    kaikki English jsonl             -> 3,212,282,689 B; gz 501,982,901 B      OK
    kaikki per-word dog.jsonl        -> 232 KB; fields verified                 OK
    wikidata latest-lexemes.json.gz  -> 614,267,037 B                          OK
    OEWN release                     -> 2025-edition, 2025-12-31, json.zip 10 MB
    OEWN animal.n.01 closure (2024)  -> 4,027 synsets / 7,681 lemmas
    cirrussearch listing             -> /current 404; latest 20251229 (43.4 GB) + DEPRECATED.txt
    enwiki page_props/redirect/page  -> 471 MB / 187 MB / 2.39 GB
    conceptnet-assertions-5.7.0      -> 497,963,447 B
    gcide-0.54.tar.xz                -> 14,803,080 B; CIDE.C has 12,439 <ent>
    Gutenberg #972 (Bierce)          -> 966 headwords, 18 animals
    Wikisource EB1911 Animals cat.   -> 901 pages; CAT article renders via action=parse
    Wiktionary categoryinfo          -> en:Animals 131+18 subcats, en:Mammals 167, en:Birds 146,
                                        en:Fish 450, en:Reptiles 175, en:Insects 121, en:Dogs 402
                                        (full-tree crawl hit 429; measure from the dump instead)
    Rails final commit 36d3b153      -> still fetchable; app/services has 14 clients
    

    5. The MVP vertical slice: Animals

    Why animals: bounded (thousands, not millions), every source has coverage, the encyclopedic relationships are a real tree (taxonomy) rather than fuzz, the dictionary relationships are rich (cat β†’ feline β†’ carnivore β†’ mammal β†’ animal; 402 derived terms), and Bierce, Johnson and Britannica all wrote about them. It exercises every layer and every relationship type in the schema.

    Scope definition (a headword is "in Animals" if any of):

    1. Its lemma is in the OEWN animal.n.01 hyponym closure (7,681 lemmas).
    2. Its Wiktionary entry sits in the en:Animals category tree (en:Mammals, en:Birds, en:Fish, en:Dogs…).
    3. It is the English P1843 common name of a Wikidata taxon under Animalia (Q729) that has an enwiki sitelink.

    Each membership is recorded with its reason (scope_lexemes.reason). Expect ~8–12k headwords after dedupe; the exact number is Phase 0's first measurement. Layers (Bierce, Johnson, Webster, EB1911, WordNet) are small enough to absorb in full; only Wiktionary and Wikidata are filtered to scope.

    Worked example, cat, everything below is real absorbed data:

    Layer Source What it says about cat
    πŸ‘‘ Bierce 1911 "A soft, indestructible automaton provided by nature to be kicked when things go wrong in the domestic circle."
    πŸ‘‘ Johnson 1755 "A domestick animal that catches mice, commonly reckoned by naturalists the lowest order of the leonine species."
    πŸ‘‘ EB1911 "properly the name of the well-known domesticated feline animal usually termed by naturalists Felis domestica, but in a wider sense employed to denote all the more typical members of the family Felidae…"
    πŸ“š Wiktionary 18 noun senses; sense 1 "A mammal of the family Felidae"; hypernyms animal, creature, carnivore, feline, mammal, pet, vertebrate; 118 hyponyms; 402 derived; synonyms grimalkin, housecat, baudrons; IPA /ˈkΓ¦t/
    πŸ“š WordNet cat.n.01 "feline mammal usually having thick soft fur and no ability to roar: domestic cats; wildcats"; hypernym feline; hyponyms domestic cat, wildcat; 8 noun synsets total
    πŸ“š Wikidata lexeme L7; concept Q146 "cat"; taxon Felis catus via the P279/P1843 bridge
    πŸ“š Wikipedia "Small domesticated carnivorous mammal" Β· "The cat, also called domestic cat and house cat, is a small domesticated carnivorous mammal. It is a member of Felidae…"
    πŸ“± Urban Dictionary "an epic creature that will shoot fire at you if you get near it…" (bjc2002, 2013)
    β€” Datamuse (weak) associations: felis, feline, burglar, kitten, mouse, leopard, litter

    The page for cat should show all of that, in tier order, with provenance one click away. That is the MVP.


    6. Architecture

    lib/devils_dictionary/
    β”œβ”€β”€ absorb/                  # THE IMPORT LAYER (Cinegraph: importers + api_processors + maintenance)
    β”‚   β”œβ”€β”€ source.ex            # behaviour: absorb/2, enrich/2, materialize/1, has_data?/1, rate_limit_ms/0
    β”‚   β”œβ”€β”€ sources/
    β”‚   β”‚   β”œβ”€β”€ wiktionary.ex    # Kaikki stream (gz -> JSONL -> filter lang/scope) -> source_records
    β”‚   β”‚   β”œβ”€β”€ wordnet.ex       # OEWN JSON zip -> synsets, lemmas, relations, ILI
    β”‚   β”‚   β”œβ”€β”€ wikidata_lexemes.ex
    β”‚   β”‚   β”œβ”€β”€ wikidata_items.ex  # on-demand EntityData + SPARQL batches -> concepts, concept_relations
    β”‚   β”‚   β”œβ”€β”€ wikipedia.ex     # REST summary on demand; Enterprise snapshot later
    β”‚   β”‚   β”œβ”€β”€ bierce.ex        # Gutenberg #972 parser
    β”‚   β”‚   β”œβ”€β”€ johnson_1755.ex  # LEME TEI-XML
    β”‚   β”‚   β”œβ”€β”€ webster_1913.ex  # GCIDE parser
    β”‚   β”‚   β”œβ”€β”€ eb1911.ex        # Britannica11 corpus (Markdown + cross-refs)
    β”‚   β”‚   β”œβ”€β”€ merriam_webster.ex   # enrich only, 1k/day budget
    β”‚   β”‚   β”œβ”€β”€ urban_dictionary.ex  # enrich only, TTL cache, attribution
    β”‚   β”‚   └── datamuse.ex          # enrich only, weak relations
    β”‚   β”œβ”€β”€ scope.ex             # builds scope_lexemes ("animals") from OEWN + Wiktionary cats + Wikidata taxa
    β”‚   β”œβ”€β”€ linker.ex            # the resolution ladder (Β§9) -> sense_concept_links
    β”‚   β”œβ”€β”€ materializer.ex      # raw -> normalized, pure, idempotent, transactional
    β”‚   β”œβ”€β”€ import_state.ex      # per (source, scope) progress
    β”‚   └── maintenance/         # pure run/1 modules: resolve_relation_targets, rematerialize, backfill_links
    β”œβ”€β”€ lexicon/                 # lexemes, senses, sense_relations, entries (dictionary side)
    β”œβ”€β”€ encyclopedia/            # concepts, concept_relations (thing side)
    β”œβ”€β”€ sources/                 # sources, people, licensing
    β”œβ”€β”€ health/                  # coverage, drift, parity checks (scoped to active scope)
    └── workers/                 # thin Oban wrappers: AbsorbWorker, EnrichWorker, LinkWorker, *Sweeper
    

    Oban queues (mirror Cinegraph's DB-protective defaults): absorb: 1 (bulk streams, one at a time), enrich: 3 (per-source rate limits inside the worker), link: 2, maintenance: 1.

    Mix tasks (every component must be runnable and produce a number, the Argus/Cinegraph rule):

    mix dd.scope.build animals            # -> scope_lexemes (+ counts per reason)
    mix dd.absorb wiktionary --scope animals
    mix dd.absorb wordnet                 # full
    mix dd.absorb wikidata_lexemes --scope animals
    mix dd.absorb wikidata_items --scope animals
    mix dd.absorb wikipedia --scope animals
    mix dd.absorb bierce | johnson_1755 | webster_1913 | eb1911     # full
    mix dd.link --scope animals           # resolution ladder, prints confidence histogram
    mix dd.enrich cat                     # fan out on-demand sources for one word (the demo moment)
    mix dd.materialize --source wiktionary --dry-run   # parity report, raw vs derived (no network)
    mix dd.health                         # coverage / drift / unresolved targets
    

    7. Schema

    erDiagram
      SOURCES ||--o{ SOURCE_RECORDS : "absorbs into"
      SOURCES ||--o{ ENTRIES : publishes
      SOURCES ||--o{ SENSES : asserts
      SOURCES ||--o{ SENSE_RELATIONS : asserts
      SOURCES ||--o{ CONCEPT_RELATIONS : asserts
      SOURCES ||--o{ SENSE_CONCEPT_LINKS : asserts
      SOURCES ||--o{ IMPORT_RUNS : runs
      SOURCE_RECORDS ||--o{ ENTRIES : materializes
      SOURCE_RECORDS ||--o{ SENSES : materializes
      LEXEMES ||--o{ ENTRIES : has
      LEXEMES ||--o{ SENSES : has
      LEXEMES ||--o{ SCOPE_LEXEMES : "is in"
      SCOPES ||--o{ SCOPE_LEXEMES : contains
      SENSES ||--o{ SENSE_RELATIONS : "from"
      SENSES ||--o{ SENSE_CONCEPT_LINKS : "links to"
      CONCEPTS ||--o{ SENSE_CONCEPT_LINKS : "linked by"
      CONCEPTS ||--o{ ENTRIES : "described by"
      CONCEPTS ||--o{ CONCEPT_RELATIONS : "from"
      PEOPLE ||--o{ ENTRIES : authored
    
      SOURCES {
        int id PK
        string slug "wiktionary, wordnet, bierce, johnson-1755 ..."
        enum tier "aristocracy | middle | plebs"
        enum kind "dictionary | encyclopedia | lexical_db | knowledge_graph | crowd | corpus"
        enum access "dump | api | static"
        int era_year
        string license
        map config
      }
      SOURCE_RECORDS {
        int id PK
        int source_id FK
        string external_id "L1122, oewn-02124272-n, Q146, 'cat' ..."
        jsonb raw "load_in_query false"
        datetime fetched_at
        datetime materialized_at
        string content_hash
      }
      LEXEMES {
        int id PK
        citext lemma
        string pos
        string slug
        string lang "en"
        jsonb pronunciations
        text etymology
      }
      SENSES {
        int id PK
        int lexeme_id FK
        int source_id FK
        int source_record_id FK
        string external_id "senseid, synset id, L7-S1"
        text gloss
        int position
        string_array tags
        string_array topics
      }
      ENTRIES {
        int id PK
        int source_id FK
        int source_record_id FK
        int lexeme_id FK "nullable"
        int concept_id FK "nullable"
        int author_id FK "nullable"
        string headword
        string pos
        text body
        string body_format "text | markdown | html"
        string url
        int year
        int position
      }
      SENSE_RELATIONS {
        int id PK
        int from_sense_id FK
        int to_sense_id FK "nullable until resolved"
        citext to_lemma
        string to_pos
        enum type "hypernym | hyponym | meronym | holonym | synonym | antonym | derived | related | coordinate | form_of | alt_of | see_also"
        int source_id FK
        float weight
      }
      CONCEPTS {
        int id PK
        string qid UK
        string label
        text description
        enum kind "taxon | thing | other"
        string wikipedia_title
        string wordnet_ili
        jsonb taxon "rank, name, common_names"
      }
      CONCEPT_RELATIONS {
        int id PK
        int from_concept_id FK
        int to_concept_id FK
        enum type "parent_taxon | subclass_of | instance_of | part_of | related"
        int source_id FK
      }
      SENSE_CONCEPT_LINKS {
        int id PK
        int sense_id FK
        int concept_id FK
        enum method "wiktionary_qid | wikidata_p5137 | title_match | wordnet_ili | manual"
        float confidence
        int source_id FK
      }
      SCOPES {
        int id PK
        string slug "animals"
        jsonb rules
      }
      SCOPE_LEXEMES {
        int scope_id FK
        int lexeme_id FK
        string reason "wordnet_closure | wiktionary_category | wikidata_taxon"
      }
      IMPORT_RUNS {
        int id PK
        int source_id FK
        string scope
        enum status
        jsonb stats
        datetime started_at
        datetime finished_at
      }
      PEOPLE {
        int id PK
        string name
        date birth_date
        date death_date
        string wikidata_id
      }
    
    Loading

    Design rules baked into this:

    Indexes that matter: lexemes (lemma, pos, lang) unique; lexemes lemma gin_trgm; source_records (source_id, external_id) unique; entries (lexeme_id, source_id), entries (concept_id, source_id); sense_relations (from_sense_id, type), (to_lemma) for resolution; concepts (qid) unique; sense_concept_links (sense_id, concept_id, method) unique.

    Migration plan: one baseline migration create_absorption_schema replacing the four domain migrations; keep users, people (altered), Oban, pg extensions. Seed sources (12 rows) in a migration or seeds.exs.


    8. Pipeline

    flowchart LR
      subgraph bulk["Bulk dumps (static or weekly)"]
        K["Kaikki Wiktionary<br/>502 MB gz"]
        W["OEWN 2025<br/>10 MB"]
        WL["Wikidata lexemes<br/>614 MB gz"]
        ST["Bierce Β· Johnson Β· Webster Β· EB1911<br/>static files"]
      end
      subgraph scope["Scope"]
        S["scope_lexemes<br/>(animals)"]
      end
      subgraph raw["Raw (truth we fetched)"]
        R[("source_records<br/>raw JSONB")]
      end
      subgraph norm["Materialized (derived, idempotent)"]
        L[("lexemes Β· senses<br/>entries Β· relations")]
        C[("concepts Β·<br/>concept_relations")]
      end
      subgraph od["On demand (per word, rate-limited)"]
        WI["Wikipedia REST summary"]
        WD["Wikidata EntityData / SPARQL"]
        MW["Merriam-Webster 1k/day"]
        UD["Urban Dictionary TTL"]
        DM["Datamuse weak rels"]
      end
      W --> S
      K --> S
      S --> K
      K --> R
      W --> R
      WL --> R
      ST --> R
      R --> |"materialize/1 in one transaction"| L
      L --> |"QIDs discovered<br/>(Wiktionary sense, P5137, sitelink)"| WD
      WD --> R
      R --> C
      C --> WI
      WI --> R
      L --> |"mix dd.enrich"| MW
      L --> UD
      L --> DM
      MW --> R
      UD --> R
      DM --> R
      L --> LK["Linker: resolution ladder<br/>sense_concept_links + confidence"]
      C --> LK
      LK --> H["Health: coverage per source,<br/>unresolved targets, parity, drift"]
    
    Loading

    Terminal states per (source Γ— lexeme), copied from razrfly/cinegraph#1053 because they were load-bearing there:

    State Definition Action
    Fetched source_records row exists for this source and external id Materialize whatever the raw supports, idempotently. No network
    Source-absent a fetch_attempt marker row (raw {} + absent_until) inside the cooldown Done; retry after cooldown
    Needs fetch in scope, no record, no fresh marker Enqueue on enrich (API sources) or wait for the next bulk absorb (dump sources)
    Needs materialization record present, materialized_at < fetched_at or parity gap Re-derive locally

    Raw and derived writes commit in one transaction so the "orphaned blob" class of bug never exists here.


    9. Linking words to things (the hard part, done honestly)

    The dictionary side keys on (lemma, pos); the encyclopedia side keys on QID. Resolution ladder, highest confidence first, every link stored with method and confidence:

    # Method Signal Confidence Evidence from probes
    1 wiktionary_qid Wiktionary sense carries wikidata: ["Q144"] 0.95 dog sense 1 β†’ Q144, sense 2 β†’ Q25324
    2 wikidata_p5137 Wikidata lexeme sense P5137 β†’ item; align to our sense by gloss similarity 0.90 L1122 3/3 senses linked
    3 wordnet_ili OEWN ILI ↔ Wikidata P8814 (WordNet 3.1 synset id) where present 0.85 dog.n.01 ILI i46360
    4 title_match Wikipedia title == lemma, page not a disambiguation, wikibase_item from REST/page_props; POS must be noun 0.70 Cat β†’ Q146; needs disambiguation guard
    5 manual Editor override 1.00 β€”

    Then concept β†’ taxon: Wikidata models cat (Q146, the everyday concept) separately from Felis catus (the taxon). Walk P279/P31 from the concept and match P1843 English common names against the lemma to attach the taxon and its P171 chain. Store the taxon on concepts.taxon and the chain in concept_relations.

    Disagreement is content, not an error. Wiktionary says 18 senses, WordNet says 8, Wikidata lexeme says 1; the UI shows the count per source and lets the reader pick a lens. Conflicting links (two concepts with confidence β‰₯ 0.7 for one sense) are surfaced in /admin/imports and on the page as "sources disagree".


    10. Wireframes and UX

    Low-fidelity, orientation only. Visual direction stays #66's: gilded πŸ‘‘, corporate πŸ“š, group-chat πŸ“±. What changes is that every card is a source card, and the word graph is a first-class panel, not a footer.

    W1 β€” Word page, desktop (/define/cat)

    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚ ☰  The Devil's Dictionary        [ search a word…                 ]   Animals β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚  CAT                                                    in: Animals β€Ί Mammals β”‚
    β”‚  /ˈkΓ¦t/ Β· noun (also verb)                      9 of 12 sources Β· 3 disagree  β”‚
    β”‚  [ All ] [ πŸ‘‘ Dead ] [ πŸ“š Institutions ] [ πŸ“± Crowd ]      [ β“˜ provenance ]   β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ‘‘ ARISTOCRACY OF THE DEAD                     β”‚ THE WORD GRAPH               β”‚
    β”‚ ╔═══════════════════════════════════════════╗ β”‚                              β”‚
    β”‚ β•‘ A soft, indestructible automaton provided β•‘ β”‚ broader                      β”‚
    β”‚ β•‘ by nature to be kicked when things go     β•‘ β”‚  cat β€Ί feline β€Ί carnivore β€Ί  β”‚
    β”‚ β•‘ wrong in the domestic circle.             β•‘ β”‚  mammal β€Ί vertebrate β€Ί animalβ”‚
    β”‚ β•‘          β€” Ambrose Bierce, 1911    β“˜      β•‘ β”‚  (WordNet Β· Wiktionary βœ“βœ“)   β”‚
    β”‚ β•šβ•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β• β”‚                              β”‚
    β”‚ ╔═══════════════════════════════════════════╗ β”‚ narrower (118)               β”‚
    β”‚ β•‘ A domestick animal that catches mice,     β•‘ β”‚  domestic cat Β· wildcat Β·    β”‚
    β”‚ β•‘ commonly reckoned by naturalists the      β•‘ β”‚  lion Β· tiger Β· ocelot …     β”‚
    β”‚ β•‘ lowest order of the leonine species.      β•‘ β”‚                              β”‚
    β”‚ β•‘          β€” Samuel Johnson, 1755    β“˜      β•‘ β”‚ word family (402)            β”‚
    β”‚ β•šβ•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β• β”‚  catnap Β· catwalk Β· cattish Β·β”‚
    β”‚ ╔═══════════════════════════════════════════╗ β”‚  cat burglar Β· catcall …     β”‚
    β”‚ β•‘ CAT, properly the name of the well-known  β•‘ β”‚                              β”‚
    β”‚ β•‘ domesticated feline animal usually termed β•‘ β”‚ synonyms                     β”‚
    β”‚ β•‘ by naturalists Felis domestica …  [more]  β•‘ β”‚  grimalkin Β· housecat Β·      β”‚
    β”‚ β•‘          β€” EncyclopΓ¦dia Britannica, 1911 β“˜β•‘ β”‚  baudrons Β· puss             β”‚
    β”‚ β•šβ•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β• β”‚                              β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€ taxon (Wikidata)             β”‚
    β”‚ πŸ“š THE INSTITUTIONS                            β”‚  Animalia β€Ί Chordata β€Ί       β”‚
    β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚  Mammalia β€Ί Carnivora β€Ί      β”‚
    β”‚ β”‚ 1 Β· A mammal of the family Felidae.       β”‚ β”‚  Felidae β€Ί Felis β€Ί F. catus  β”‚
    β”‚ β”‚ 2 Β· A domesticated species (Felis catus)… β”‚ β”‚                              β”‚
    β”‚ β”‚ … 16 more senses                          β”‚ β”‚ associations (weak)          β”‚
    β”‚ β”‚              β€” Wiktionary  β“˜  CC BY-SA    β”‚ β”‚  kitten Β· mouse Β· litter Β·   β”‚
    β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚  burglar Β· leopard           β”‚
    β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚                              β”‚
    β”‚ β”‚ feline mammal usually having thick soft   β”‚ β”‚ ⚠ sources disagree           β”‚
    β”‚ β”‚ fur and no ability to roar …  8 synsets   β”‚ β”‚  senses: Wiktionary 18 Β·     β”‚
    β”‚ β”‚              β€” Open English WordNet  β“˜    β”‚ β”‚  WordNet 8 Β· Wikidata 1      β”‚
    β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚ ALSO AN ANIMAL               β”‚
    β”‚ β”‚ Small domesticated carnivorous mammal.    β”‚ β”‚  dog Β· mouse Β· lion Β· oyster β”‚
    β”‚ β”‚ The cat, also called domestic cat and     β”‚ β”‚                              β”‚
    β”‚ β”‚ house cat, is a small … [read on Wikipedia]β”‚ β”‚ ON THIS WORD                 β”‚
    β”‚ β”‚              β€” Wikipedia Β· Q146  β“˜        β”‚ β”‚  Bierce βœ“ Johnson βœ“ Webster βœ“β”‚
    β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚  EB1911 βœ“ Wiktionary βœ“       β”‚
    β”‚ β”Œ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ┐ β”‚  WordNet βœ“ Wikidata βœ“        β”‚
    β”‚   Merriam-Webster Β· not fetched yet  [fetch] β”‚ β”‚  Wikipedia βœ“ Urban βœ“         β”‚
    β”‚ β”” ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ ─ β”˜ β”‚  Merriam-Webster β—‹ Voltaire β—‹β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€                              β”‚
    β”‚ πŸ“± THE CROWD                                   β”‚                              β”‚
    β”‚  β–² 1.2k  "an epic creature that will shoot    β”‚                              β”‚
    β”‚          fire at you if you get near it…"     β”‚                              β”‚
    β”‚          β€” bjc2002 Β· Urban Dictionary Β· 2013 β†—β”‚                              β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ”₯ EVIDENCE FROM THE CULTURE  (#67, later)                   [οΌ‹ add]  β–Έ open β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    

    Notes: tier filter chips at the top swap the stack in place (#66 option B) while the graph panel stays put (#67's "stays put while the definitions argue"). Every card has β“˜ β†’ W6. Dashed card = a source that exists but hasn't been fetched for this word (on-demand budget). "Sources disagree" is a feature, styled as a small warning plaque.

    W2 β€” Word page, mobile

    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚ CAT  /ˈkΓ¦t/ Β· n.           β”‚
    β”‚ Animals β€Ί Mammals   9/12 β“˜ β”‚
    β”‚ [All][πŸ‘‘][πŸ“š][πŸ“±][Graph]    β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ‘‘ Bierce, 1911            β”‚
    β”‚ "A soft, indestructible    β”‚
    β”‚  automaton…"          β“˜    β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ‘‘ Johnson, 1755           β”‚
    β”‚ "A domestick animal that   β”‚
    β”‚  catches mice…"       β“˜    β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ‘‘ Britannica, 1911  [more]β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ“š Wiktionary Β· 18 senses  β”‚
    β”‚  1. A mammal of the family β”‚
    β”‚     Felidae.               β”‚
    β”‚  β–Ύ show all                β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ“š WordNet Β· πŸ“š Wikipedia  β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ πŸ“± Urban β–²1.2k "an epic    β”‚
    β”‚  creature…"           β†—    β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ β–Έ WORD GRAPH  (sheet)      β”‚
    β”‚   broader Β· narrower Β·     β”‚
    β”‚   family Β· taxon           β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    

    The graph panel becomes a bottom sheet triggered by the [Graph] chip.

    W3 β€” Browse a scope (/animals)

    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚ ANIMALS                                   8,412 words Β· 12 sources Β· 71% linkedβ”‚
    β”‚ [ search within animals… ]   sort: coverage β–Ύ   filter: [has Bierce] [has     β”‚
    β”‚                              Johnson] [has EB1911] [missing Wikipedia] [disputed]β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ TREE (taxon/WordNet) β”‚  cat        9/12  πŸ‘‘πŸ‘‘πŸ‘‘ πŸ“šπŸ“šπŸ“šπŸ“š πŸ“±   Felidae            β”‚
    β”‚ β–Ύ Animalia           β”‚  dog        9/12  πŸ‘‘πŸ‘‘πŸ‘‘ πŸ“šπŸ“šπŸ“šπŸ“š πŸ“±   Canidae            β”‚
    β”‚   β–Ύ Chordata         β”‚  oyster     7/12  πŸ‘‘πŸ‘‘   πŸ“šπŸ“šπŸ“šπŸ“š      Ostreidae          β”‚
    β”‚     β–Ύ Mammalia       β”‚  hyena      6/12  πŸ‘‘     πŸ“šπŸ“šπŸ“šπŸ“š      Hyaenidae          β”‚
    β”‚       β–Ύ Carnivora    β”‚  aardvark   5/12         πŸ“šπŸ“šπŸ“šπŸ“š      Orycteropodidae    β”‚
    β”‚         β–Έ Felidae 41 β”‚  axolotl    4/12         πŸ“šπŸ“šπŸ“š        Ambystomatidae     β”‚
    β”‚         β–Έ Canidae 38 β”‚  …                                                       β”‚
    β”‚       β–Έ Rodentia 212 β”‚                                                          β”‚
    β”‚     β–Έ Aves 1,102     β”‚  ── no Bierce, no Johnson, no EB1911: 6,930 words ──     β”‚
    β”‚     β–Έ Actinopterygii β”‚     (the long tail is where the crowd gets to speak)     β”‚
    β”‚   β–Έ Arthropoda 2,240 β”‚                                                          β”‚
    β”‚   β–Έ Mollusca 410     β”‚                                                 β€Ή 1 2 3 β€Ίβ”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    

    Coverage badges (one glyph per source, tinted by tier) make the shape of knowledge visible at a glance: dead men wrote about cats and oysters, nobody dead wrote about the axolotl. That's the joke, in data.

    W4 β€” Source page (/sources/johnson-1755)

    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚ πŸ‘‘ A Dictionary of the English Language Β· Samuel Johnson Β· 1755              β”‚
    β”‚ dictionary Β· static (LEME TEI-XML) Β· CC BY 4.0 Β· absorbed 2026-09-12         β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ 42,773 entries absorbed Β· 1,206 in Animals (14% of scope) Β· 0 parity gaps     β”‚
    β”‚ [ coverage bar β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‘β–‘β–‘β–‘β–‘β–‘β–‘β–‘ vs Wiktionary ]                              β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ What we take: headword, part of speech, senses, etymology note, quotations   β”‚
    β”‚ What we don't: page images, 1773 revisions (UCF site, non-commercial only)   β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ A–Z of headwords in this source Β· random entry Β· about this source β†—         β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    

    W5 β€” Import dashboard (/admin/imports, dev-only until auth exists)

    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚ IMPORTS Β· scope: [ animals β–Ύ ]                                   ● oban ok    β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ source         β”‚ access β”‚ fetched β”‚ absent  β”‚ needs    β”‚ needs    β”‚ last run β”‚
    β”‚                β”‚        β”‚         β”‚         β”‚ fetch    β”‚ material.β”‚          β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ wiktionary     β”‚ dump   β”‚  8,102  β”‚    β€”    β”‚    310   β”‚     0    β”‚ 2h ago βœ“ β”‚
    β”‚ wordnet        β”‚ dump   β”‚  7,681  β”‚    β€”    β”‚      0   β”‚     0    β”‚ 2h ago βœ“ β”‚
    β”‚ wikidata_lex   β”‚ dump   β”‚  3,904  β”‚    β€”    β”‚  4,508   β”‚     0    β”‚ 2h ago βœ“ β”‚
    β”‚ wikidata_items β”‚ api    β”‚  6,220  β”‚    41   β”‚  1,120   β”‚    12 ⚠  β”‚ running… β”‚
    β”‚ wikipedia      β”‚ api    β”‚  5,980  β”‚   120   β”‚  1,300   β”‚     0    β”‚ running… β”‚
    β”‚ bierce         β”‚ static β”‚    966  β”‚    β€”    β”‚      0   β”‚     0    β”‚ 3d ago βœ“ β”‚
    β”‚ johnson_1755   β”‚ static β”‚ 42,773  β”‚    β€”    β”‚      0   β”‚     0    β”‚ 3d ago βœ“ β”‚
    β”‚ webster_1913   β”‚ static β”‚ 98,900  β”‚    β€”    β”‚      0   β”‚   414 ⚠  β”‚ 3d ago   β”‚
    β”‚ eb1911         β”‚ static β”‚ 36,691  β”‚    β€”    β”‚      0   β”‚     0    β”‚ 3d ago βœ“ β”‚
    β”‚ merriam_websterβ”‚ api    β”‚    312  β”‚     9   β”‚  8,091   β”‚     0    β”‚ budget 1kβ”‚
    β”‚ urban          β”‚ api    β”‚  1,004  β”‚   206   β”‚  7,202   β”‚     0    β”‚ ttl 30d  β”‚
    β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
    β”‚ HEALTH   ● 71% senses linked  ● 2,113 unresolved relation targets  ⚠ 38 sense β”‚
    β”‚          links disputed  ● parity: wiktionary 0 gaps Β· webster 414 gaps       β”‚
    β”‚ [absorb β–Ύ] [link] [materialize --dry-run] [health]                            β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    

    W6 β€” Provenance drawer (any β“˜)

    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
    β”‚ PROVENANCE Β· Johnson 1755 Β· "cat"             β”‚
    β”‚ source        johnson-1755 (πŸ‘‘ Β· dictionary)  β”‚
    β”‚ external id   leme:johnson1755:cat            β”‚
    β”‚ fetched       2026-09-12 Β· sha256 3fa…        β”‚
    β”‚ materialized  2026-09-12 Β· entries 1 Β· senses 2β”‚
    β”‚ license       CC BY 4.0 (LEME) Β· attribution β†—β”‚
    β”‚ links         β†’ Q146 cat  (title_match Β· 0.70)β”‚
    β”‚               β†’ Felis catus (P1843 Β· 0.80)    β”‚
    β”‚ β–Ύ raw record (JSON)                           β”‚
    β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
    

    UX principles

    • Source-first. Nothing appears on screen without a source card and a β“˜. No anonymous text.
    • The tier styling is inherited from the source, so adding Voltaire means adding one sources row and a parser; the page already knows how to dress him.
    • Disagreement is content. Sense counts, conflicting links, and coverage gaps are shown, never smoothed over.
    • Coverage is legible everywhere (badges on lists, "9 of 12" on pages), because who bothered to define this is the editorial point.
    • Sparse states are designed: a word with only Wiktionary + WordNet shows the graph panel prominently and a "no aristocrat has spoken" plaque; a word with nothing but a scope membership shows "known to exist" with its taxon.
    • On-demand sources are budgeted and visible: dashed cards with [fetch], never a spinner that hides a 1,000/day limit.
    • Keyboard-first search (/), A–Z browse and Architecture: Topic Relationships, Word Forms & DisambiguationΒ #60's empty-topic fallbacks carry over unchanged.

    11. Build order

    Phase 0 β€” Decide & reset (β‰ˆ2 days)

    • Tag the Rails commit (rails-final) so it can't be garbage-collected.
    • Baseline migration for Β§7; drop the four domain migrations; keep users, people, Oban, extensions.
    • Absorb.Source behaviour + sources seed (12 rows with tier/kind/access/license/era).
    • Fixtures: real raw records for cat, dog, oyster from every source (checked in, tiny) so tests never touch the network.
    • mix dd.scope.build animals β†’ first real number for scope size; measure P5137 coverage and Wiktionary en:Animals tree size from the dumps.

    Phase 1 β€” Absorb the spine, scoped to Animals

    • Wiktionary (Kaikki gz stream, filter lang_code=en ∧ lemma ∈ scope; keep the all-language raw path since the per-language file is deprecated) β†’ lexemes, senses, pronunciations, etymology, relations (with unresolved to_lemma), sense QIDs, categories.
    • OEWN 2025 (full, 10 MB) β†’ senses (synsets), relations, ILI.
    • Wikidata lexemes (stream 614 MB gz, keep English) β†’ senses + P5137.
    • Wikidata items on demand for every QID discovered β†’ concepts, taxonomy relations, common names.
    • Wikipedia REST summary for every concept with an enwiki sitelink β†’ encyclopedia entries. (Evaluate the Enterprise free snapshot for bulk once counts are known.)
    • /admin/imports v0: counts per source per state.

    Phase 2 β€” Relations and linking

    Phase 3 β€” The dead speak (static layers, full corpora)

    • Bierce (Gutenberg #972; 966 entries; parse "See X" cross-refs into see_also, as Architecture: Topic Relationships, Word Forms & DisambiguationΒ #60 asked).
    • Johnson 1755 (LEME TEI-XML; verify TSpace download + attribution text).
    • Webster 1913 (GCIDE 0.54 parser; 12,439 <ent> in the C file alone).
    • EB1911 (Britannica11 corpus Markdown + cross-reference graph β†’ entries on concepts via title match, plus the 901-article Wikisource animal category as a scope hint).
    • People rows for Bierce, Johnson, Webster, EB1911 contributors (from the corpus contributor index) with wikidata_id.

    Phase 4 β€” UI

    Phase 5 β€” Living layers, budgets, health

    • Urban Dictionary enricher (TTL cache, attribution, link-out, no bulk).
    • Merriam-Webster enricher (1k/day budget, snooze on quota like Cinegraph's {:snooze, 3600}).
    • Datamuse for the "associations" chips only.
    • mix dd.health + drift checks + parity watchdog; mix dd.enrich <word> demo path.

    Deferred (unchanged from #68)

    Clerk auth Β· votes Β· evidence wall backend (#67) Β· quotes with provenance (#65) Β· curator bots (#17) Β· Voltaire/Diderot layers Β· media sources (TMDB/Giphy/Unsplash) Β· other scopes (emotions, politics, food are one scope.build each).


    12. MVP acceptance criteria

    • mix dd.scope.build animals yields β‰₯ 8,000 lexemes, each with a recorded reason.
    • β‰₯ 95% of scoped lexemes have entries from β‰₯ 3 sources; 100% have Wiktionary or WordNet.
    • β‰₯ 70% of scoped noun senses carry a sense_concept_link with confidence β‰₯ 0.8; conflicts are listed, not hidden.
    • /define/cat, /define/dog, /define/oyster each render β‰₯ 7 source cards across all three tiers, the word graph, and the taxon chain, with β“˜ provenance on every card.
    • Turning the network off, mix dd.materialize --dry-run reports 0 parity gaps and re-materialization reproduces every normalized row from source_records.
    • /animals browses the taxonomy tree with coverage badges and filters.
    • Every source has a source page with license and attribution; no Urban Dictionary or Merriam-Webster text is bulk-stored or exported.
    • /admin/imports shows per-source terminal-state counts and health is green for the spine.
    • Adding a new static source is: one sources row + one module implementing Absorb.Source + one mix task run. Proven by adding Voltaire last.

    13. Open decisions (recommendations inline)

    • Wiktionary file: per-language English extract (502 MB, flagged deprecated) vs all-language raw (2.6 GB) filtered. Recommend raw-filtered from day one; the filter is one line and it won't disappear.
    • Wikipedia bulk path: REST on demand (fine at ~10k concepts) vs Enterprise free snapshot (30/month, structured contents). Recommend REST for MVP, Enterprise when a second scope lands.
    • Keep aristocracy / middle / plebs as sources.tier? Yes. It's the brand; πŸ“ State of the project + MVP build order (dictionary β†’ layered encyclopedia)Β #68 already decided this.
    • Concept vs taxon in the UI: show the everyday concept (Q146) as the primary encyclopedia card and the taxon chain in the graph panel. Recommend yes; readers think "cat", not "Felis catus".
    • Scope cap: if Animals comes back at 12k+ lexemes, cap the first pass to lexemes with a WordNet synset (β‰ˆ7.7k) and let the long tail in via Wiktionary later. Recommend measuring first.
    • GCIDE's GPL: the 1913 text is public domain, the packaged corpus is GPL. We're storing content, not linking code. Recommend proceeding with an attribution line; note it on the source page.
    • Johnson: LEME XML (CC BY 4.0) is the durable path; the UCF site is nicer but non-commercial-only with no API. Recommend LEME; link the UCF page from the source page.
    • Urban Dictionary posture: on-demand, cached with TTL, attributed, never exported. Recommend yes; it's the only way to have the plebs at all.

    14. Licensing summary

    Source License We may We must
    Wiktionary (Kaikki) CC BY-SA 4.0 store, display, derive attribute, share-alike derived text, cite wiktextract
    Open English WordNet CC BY 4.0 everything attribute
    Wikidata CC0 everything nothing (attribute anyway)
    Wikipedia CC BY-SA 4.0 store extracts, display attribute, link
    Bierce, Johnson (text), Webster 1913 (text), Voltaire, EB1911 (text) Public domain everything credit the transcription (LEME CC BY 4.0; Britannica11 CC BY-SA 4.0; GCIDE GPL)
    Merriam-Webster API terms, non-commercial, 1k/day display cached responses attribute; commercial use needs an agreement
    Urban Dictionary none (unofficial API) display on demand with attribution never bulk-store or redistribute
    Datamuse free ≀100k/day until 2027-01-01 display commercial use needs an agreement
    Diderot translations (Michigan) CC BY-NC-ND 3.0 link not copy

    15. Issue map

  3. changed the title [-]πŸ” MVP reset: absorb the word-graph first (Wiktionary Β· WordNet Β· Wikidata Β· Wikipedia), layer dictionaries on top β€” Animals vertical slice (sources, schema, pipeline, wireframes)[/-] [+]πŸ” MVP-0: absorption-first word graph, walking skeleton (WordNet Β· Wiktionary Β· Wikidata Β· Wikipedia Β· Bierce, Animals scope) β€” decisions, schema, pipeline, scorecard[/+] on Sep 5, 2026
  4. holden commented on Sep 5, 2026

    @holden
    MemberAuthor

    Spec amendments from S0b (2026-09-05, commit 19bccaf)

    Five things the real data contradicted. Tracker and full numbers: #70.

    Β§2 / Β§7 A2 β€” the pinned WordNet asset was wrong. english-wordnet-2025-json.zip holds 107,519 synsets, 128,009 lemmas, 135,969 (lemma, pos) pairs, and fails A2 by ~13k synsets. english-wordnet-2025-plus-json.zip (11 MB, same CC BY 4.0, same format) holds 120,564 / 153,888 / 161,875 β€” which is exactly this issue's "~120k synsets, ~161k words". Now pinned. A2's second metric must also be read as distinct lexemes (lemma, pos), not distinct lemma strings: the plus edition's distinct lemma strings are 153,888, which would fail the β‰₯155,000 bar, while its (lemma, pos) pairs are 161,875. Measured: 120,564 groups and 161,814 lexemes (the 61-row gap is adjective satellites collapsing onto adj).

    Β§4 "How each source lands" β€” WordNet has no hyponym or holonym edges. The corpus carries only hypernym (93,395) and mero_* (22,312). Both inverse directions must be derived. Inversion is inherently global, while materialize/1 is pure and per record, so the absorb inverts once and writes an expanded _edges list into source_records.raw. That is also what makes M2 true in the strong sense: raw alone rebuilds every derived row. Result: 1,047,918 relations, 100% resolved (R1 green in S0b, not S1).

    Β§5 linking ladder β€” WordNet ships 22,036 synsets with a wikidata QID. Not listed as a rung. It costs one line to keep, so it now lives in senses.metadata. Given L1 (β‰₯70% link rate) is the flagged unknown of this project, this is plausibly the rung that saves it; suggest adding wordnet_wikidata to the ladder at ~0.90 when S2 writes the Linker.

    Β§3 rule 2 β€” the en:Animals category tree is not in the Kaikki dump. Records carry a flat array of category strings ("en:Corvids" next to "English countable nouns") with no hierarchy. The tree has to come from the Wiktionary API. It is now walked once (mix dd.scope.categories animals, depth 4, 12 subtrees denylisted as about-animals-but-not-animals: body parts, animal products, equestrian equipment and sport, veterinary medicine, a toy franchise) and pinned as 231 categories in scopes.rules, so scope building itself stays offline (O3).

    Two consequences worth recording in Β§4:

    • The index pass stores each entry's en:-prefixed categories in lexemes.metadata["wikt_categories"]. Β§4 describes an index row as carrying only forms. Without the categories, every scope build needs a second full 2.6 GB pass; with them, the rule is one SQL query against a GIN index β€” which is what E2 ("a new scope is data, no code change") actually promises.
    • lexical_relations needs index(from_sense_id), which Β§4's index list omits. The scope closure CTE and the word page's graph panel both join on it.

    Β§7 M4 β€” trimming is much better than the bar. Dropping translations, descendants, etymology_templates, head_templates saves 81% on the checked-in fixtures (needs β‰₯50%). Fixtures are stored untrimmed on purpose, so the denominator survives.

    Measured, from Β§10's "unknowns to measure in S0–S2"

    Unknown Answer
    Index size (A3) 1,534,818 English lexemes; 566,239 carry forms; 534,780 of 1,487,639 English dump records are form-of entries (36%)
    Scope size (A4) 21,277 animal lexemes β€” wordnet_closure 7,692 (spec predicted 7,681), wiktionary_category 15,612, overlap 2,027
    Trim savings (M4) 81%

    Still open: A5 (Wiktionary coverage of WordNet's multiword and scientific names) in S1, L1/L4 in S2.

  5. holden commented on Sep 5, 2026

    @holden
    MemberAuthor

    Proposed amendment to scorecard row A5 (from S1, commit dc6c326)

    A5 as written cannot pass, and no work on our side changes that. Measured on the real data after the scoped Wiktionary absorb:

    A5 Wiktionary coverage of scope β€” 17,773 / 21,277 = 83.5 %, against a bar of β‰₯ 85 %.

    Why

    All 3,504 misses are nouns. Bucketed:

    Kind Count Examples
    Linnaean binomial 1,995 Cimex lectularius, Perdix perdix, Bufo marinus, Mugil cephalus
    Other multiword 1,299 woodland caribou, bird-footed dinosaur, dusky-footed wood rat
    Single word 210 soup-fin, dickeybird, percoidean, groenendael

    The binomials are the story. They enter the scope through the wordnet_closure rule β€” WordNet lists scientific names as lemmas β€” and Wiktionary files binomials under Translingual, not English. Decision #3 and the index pass both key on lang_code == "en", so a binomial can never acquire an English lexemes row and can never be covered by this source. domestic cat is in Wiktionary and is covered; Felis catus is Translingual and is not. Chasing the last 1.5 % would mean adding a second language to an index the spec defines as "every English Wiktionary headword", for words S2 is about to cover properly from Wikidata anyway.

    Β§7 already anticipated this: A5 is listed under "what we expect to learn: Wiktionary coverage of WordNet's scientific and multiword names". The number is the finding.

    Proposed wording

    ID Check Measured by Pass
    A5 Wiktionary coverage of scope scope lexemes with a Wiktionary record, excluding lemmas Wiktionary files as Translingual (Linnaean binomials); the excluded set counted and listed β‰₯ 85 % of the remainder Β· measured 17,773 / 19,282 = 92.2 % βœ…, 1,995 binomials excluded and reported

    Two things that follow, if this is accepted:

    1. A6/L3 inherit the burden. The binomials are exactly the words Wikidata's taxon pass (P225 scientific name, P171 parent taxon) covers well, so S2 should report scope coverage for wikidata alongside wiktionary and the two together should approach 100 %. Worth adding as a report line rather than a new row.
    2. mix dd.score prints both numbers, raw and adjusted, so the exclusion is never invisible: A5 83.5% raw Β· 92.2% excluding 1,995 Translingual binomials.

    If the preference is instead to leave A5 at β‰₯ 85 % of everything and let it sit red until S2, that is also a defensible read β€” the row would then be the thing that forces the Wikidata pass to be good. Either way S1 leaves the number measured, bucketed and reproducible (DevilsDictionary.Health.coverage("animals", "wiktionary")).

    Full S1 numbers and the other two spec amendments (trim/1 narrowing rather than dropping, which takes M4 from 45.6 % to 67.7 % on real records; and X3 resolving through lexemes.forms rather than the scoped absorb) are on #70.

  6. holden commented on Sep 5, 2026

    @holden
    MemberAuthor

    S2 measured L1, and it cannot pass as written (2026-09-05, 4a8cfcf). Numbers and reasoning in #70; this is the amendment Β§7 needs.

    L1 as specified: β‰₯ 70 % of scope lexemes with a concept_link at confidence β‰₯ 0.8. Measured: 57.7 % (14,643 / 25,393), with a ceiling of 68.1 % β€” that is how many scope lexemes have any link at all.

    The 31.9 % with no link are not a linker failure: 6,840 of them have no English Wikipedia article at all (soup-fin, trochid, prophaethontid, sandprawn β€” the en:Animals category tail's fossil groups, dialect names and breed variants). 1,209 have an article that no rung matched, and 39 were never probed. Β§7's clause "if L1 lands far below 70 %, the linker gets another rung" was written for exactly this, but another rung cannot conjure an article that does not exist.

    The ladder itself was never going to reach the bar either, and this was measurable before a line of the linker was written: only 4,216 scope lexemes have a WordNet sense carrying a QID and 546 a Wiktionary one β€” about 21 % β€” while Β§5 pins title_match at 0.70, below L1's 0.8 threshold. Β§5 already anticipates the fix ("0.95 0.90 0.85 0.70 0.40β†’0.60 1.00 by method, adjusted by checks"), so a corroboration pass raises a title match when a second independent signal agrees, recording which one in metadata["corroboration"]:

    check raises to raises
    the concept is a taxon whose P225 binomial or English P1843 common name is the lemma 0.90 6,437
    a QID rung already links that lexeme to that concept 0.90, status: :confirmed 4,466
    the article's description or extract shares β‰₯ 2 content words with a WordNet or Wiktionary gloss 0.85 6,940

    That is what takes L1 from 25.2 % (strict ladder) to 57.7 %. Both figures are printed by mix dd.link every run.

    Proposed amendment to Β§7's L1 row:

    L1 | link rate (the unknown) | scope lexemes with β‰₯ 1 concept_link at confidence β‰₯ 0.8, as a share of the scope lexemes for which an English Wikipedia article exists; the raw share of the whole scope and the share with any link at all are reported beside it | β‰₯ 70 % of the reachable set, and report

    On that reading: 14,643 / 16,553 = 88.5 % βœ…, with 57.7 % raw and 68.1 % reachable reported. The shape mirrors the A5 amendment accepted after S1 β€” exclude what the source structurally cannot cover, report the excluded set and the raw figure, and keep the finding visible.

    Two smaller amendments the same session earned, both about denominators rather than thresholds:

    • L3 β€” the population is links we assert (auto/confirmed), not every link. An Animals scope carries ~38,000 :candidate rows from "may refer to" pages and BYD Seal was never going to reach Animalia. On asserted links: 77.3 % βœ…; including candidates, 26.7 %. Both reported.
    • A10 β€” the population is the concepts a scope's words link to, not every concept with an entry. The concept pass gives an entry to all 32,000 disambiguation candidates, and Cherry Bomb (album) having no picture says nothing about whether cat does. On linked concepts: 93.7 % βœ… (96.3 % of linked scope lexemes get a picture); over all concepts with an entry, 70.0 %. Both reported.

    A6's union came out as predicted: Wiktionary 78.3 % βˆͺ Wikidata 68.1 % = 97.4 % of the scope, and the 2,008 Linnaean binomials A5 structurally cannot cover are linked by Wikidata β€” Cimex lectularius β†’ Q940337 at 0.90. A7 100 % and M1 0 gaps across all four sources.

    Three deviations from Β§2/Β§4/Β§5, each recorded in the commit and on #70: the batched endpoints (wbgetentities at 50 ids, the Action API at 20 titles) instead of the pinned per-item URLs, which turned 100,201 fetches into 7,380 requests and O2(b)'s predicted β‰ˆ 4 h into 1 h 37 m; a Wikipedia record keyed by the thing we asked about (the probed lemma, or concept:<QID>) rather than by pageid, because an absent marker for a lemma with no article has no pageid to key on; and title_match accepting Wiktionary's name part of speech alongside noun, since it files proper nouns separately and Wild Turkey is a thing.

    Also worth pinning in Β§3: wikidata_taxon grew the Animals scope from 21,277 to 25,393 lexemes. The enwiki-sitelink requirement is applied (8,870 matched) and the count without it reported (9,290), because the article usually sits on the everyday concept rather than on the taxon item β€” Q146 Cat has one, Q20980826 Felis catus has none.

  7. 2 remaining items

  8. holden commented on Sep 6, 2026

    @holden
    MemberAuthor

    S5 closed. 29 / 29 graded rows pass; the seven that remain are #71's.

    mix dd.score in full, against the development database β€” six sources, two scopes, 344,290 raw records. M1 is shown as the full parity run gave it (0 gaps over 344,290 records, 24.6 s); everything else is verbatim from this run.

    MVP-0 scorecard β€” 4.3 s
    
      ABSORB
      PASS  A1  every source absorbed          6 / 6 absorbed, 6 pinned
      PASS  A2  WordNet is full (plus edition) 120,564 synsets / 161,814 lexemes
      PASS  A3  Wiktionary index is full       1,541,669 lexemes, 566,241 with forms
      PASS  A4  scope built with reasons       25,402 lexemes, 0 without a reason Β· wikidata_taxon 8,887 Β· wiktionary_category 15,612 Β· wordnet_closure 7,692
      PASS  A5  Wiktionary coverage of scope   78.3% raw Β· 93.0% excl. 4,004 scientific names
      PASS  A6  Wikidata coverage              57,228 referenced, 0 dangling Β· union 97.4%
      PASS  A7  Wikipedia coverage             10,412 / 10,412 asserted = 100.0% Β· 70,224 / 90,481 incl. candidates = 77.6%
      PASS  A8  Bierce is full and attached    997 entries, 100.0% attached Β· 93.0% already in the index
      PASS  A9  links back everywhere          365,037 / 365,037 = 100.0%
      PASS  A10 images                         9,678 / 10,386 = 93.2%
    
      MATERIALIZE
        ⬜  M1  parity, every source           skipped (--skip-parity)
      PASS  M2  idempotent, offline            row counts identical over 344,290 records, all 6 sources
      PASS  M3  atomic writes                  proven by test
      PASS  M4  trimmed raw                    14.8 MB β†’ 3.9 MB = 73.7% smaller
    
      RESOLVE
      PASS  R1  WordNet edges resolved         1,047,918 / 1,047,918 = 100.0%
      PASS  R2  Wiktionary edges resolved      114,827 / 130,519 = 88.0%
        ⬜  R3  chains render                  the word page shows a hypernym chain from >= 2 sources   (S4)
    
      LINK
      PASS  L1  link rate                      82.5% of 18,028 reachable Β· raw 58.6% Β· any 68.4%
        Β·   L2  conflicts surfaced             1,418 lexemes with two concepts >= 0.7
      PASS  L3  taxonomy reaches Animalia      8,025 / 10,386 = 77.3%
      PASS  L4  disambiguation handled         1,764 / 1,775 = 100.0% of nominal lemmas
    
      EXPERIENCE
        ⬜  X1  every word has a page          200 random index lexemes render   (U1)
      PASS  X2  search is fast                 p95 70 ms over 20 probes Β· median 20 ms Β· slowest 137 ms
      PASS  X3  forms and variants resolve     4 / 4 probes land: monkeys, cats, geese, spat
    
      PAGES
        ⬜  U1  six pages exist                5 / 6 routes · still to build: /define/:slug (the word page)   (U1)
        ⬜  U2  the flagship words             cat, dog, oyster: >= 4 cards across >= 2 tiers   (S4)
        ⬜  U3  provenance everywhere          every card opens the drawer   (S4)
        ⬜  U4  mobile                         browse, source, imports, health and /kit: no sideways scroll at 375 px; the word page is #71's   (U3)
      PASS  U5  coverage is legible            6 / 6 sources agree with dd.health Β· bierce 66 Β· johnson 1,313 Β· wikidata 0 Β· wikipedia 18,028 Β· wiktionary 19,896 Β· wordnet 10,875
        ⬜  U6  every card links out           β†— on every card resolves   (S4)
    
      EXTENSIBILITY
      PASS  E1  a new source is cheap          johnson: 1 sources row, 1 module, 1 registry line; 2 migrations
      PASS  E2  a new scope is data            animals 25,402 from 1 WordNet root (oewn-00015568-n) Β· emotions 809 from 1 WordNet root (oewn-00026390-n); 0 code changes
      PASS  E3  the community layer fits       users + examples + votes migrate and roll back cleanly
    
      OPERATIONS
      PASS  O1  the scorecard runs itself      this table
      PASS  O2  it is fast enough              (a) dumps 10m 6s Β· (b) APIs 266m 33s
      PASS  O3  clean and offline-testable     `mix precommit`: compile, format, full suite
      PASS  O4  health page                    `mix dd.health` and /health: coverage, resolution, the link histogram, candidates, conflicts, parity
    
      29 / 29 graded rows pass, 1 reported, 7 pending
    

    What this means, in the words of Β§7

    "type any English word (or an inflected form of it) and get a page" β€” not yet. X1, U1, U2, U3, U6 and R3 are #71's U1–U3, and U4 waits on the word page too. Every other row is green, including the four developer surfaces, so what remains is the reader-facing half rather than anything about the backbone.

    The three extensibility rows, which S5 existed to answer

    E1 Johnson 1755 (LEME TEI-XML, CC BY 4.0, TSpace 1807/124274) as the sixth source: 42,726 entries, 37,235 lemmas, 91.9 % already in the index, 6,780 words of his own, 114,787 quotations. Cost: one sources row, one people row, one registry line, one module, fixtures and tests. schema_migrations stayed at 2 β€” which is now what the row measures, not what it asserts.
    E2 emotions, 809 lexemes from one WordNet root, built and absorbed with zero code changed. Every scope is a priv/scopes/<slug>.json file now, animals included, so there is no scope defined in Elixir left to point at.
    E3 users + examples + votes generated, applied to a full database, schema-diffed, rolled back, and moved to docs/sketches/. Three tables, seven indexes, two check constraints; no column, index or constraint of the thirteen changed.

    Detail, and the two things the second scope found β€” A7 v2, and an unscoped concept_qids/0 that makes scope N re-walk scopes 1..Nβˆ’1 β€” are in the S5 comment on #70.

    One amendment for your assent: A7 v2 (v13)

    Building the second scope grew the concept table to 90,481 sitelinked rows, 54,273 of which have no link to any scope word at all β€” things a disambiguation page merely mentioned. Every summary fetched names more of them, so the old denominator grows faster than any pass can fill it: one concept pass closed 274 gaps and introduced 20,526.

    The S3 audit called this in advance and wrote the remedy on #70 β€” "for the next scope consider limiting the concept pass to asserted concepts plus candidates promoted to 0.6, and reporting A7 on that population." This is the next scope, so A7 is now graded on the concepts a scope word links to at auto/confirmed: 10,412 / 10,412 = 100 %, with 77.6 % including candidates reported beside it. Same shape as A5 v2 in S4c.

  9. holden commented on Sep 7, 2026

    @holden
    MemberAuthor

    The closing scorecard β€” MVP-0 passes on both scopes

    a2ef867 (2026-09-07), the U3 commit on #71. Both runs are with parity β€” no --skip-parity,
    so M1 re-runs materialize/1 over all 344,635 records and diffs the result against the database.

    Every row of Β§7 is green, on both scopes, with nothing pending. That was the exit condition for
    MVP-0, written into this issue in v1 and unchanged since.

    mix dd.score --scope animals

    
    MVP-0 scorecard β€” 23.0 s
    
      ABSORB
      PASS  A1  every source absorbed          6 / 6 absorbed, 6 pinned
      PASS  A2  WordNet is full (plus edition) 120,564 synsets / 161,814 lexemes
      PASS  A3  Wiktionary index is full       1,541,669 lexemes, 566,241 with forms
      PASS  A4  scope built with reasons       25,402 lexemes, 0 without a reason Β· wikidata_taxon 8,887 Β· wiktionary_category 15,612 Β· wordnet_closure 7,692
      PASS  A5  Wiktionary coverage of scope   78.3% raw Β· 93.0% excl. 4,004 scientific names
      PASS  A6  Wikidata coverage              57,231 referenced, 0 dangling Β· union 97.4%
      PASS  A7  Wikipedia coverage             10,412 / 10,412 asserted = 100.0% Β· 70,224 / 90,481 incl. candidates = 77.6%
      PASS  A8  Bierce is full and attached    997 entries, 100.0% attached Β· 93.0% already in the index
      PASS  A9  links back everywhere          365,037 / 365,037 = 100.0%
      PASS  A10 images                         9,678 / 10,386 = 93.2%
    
      MATERIALIZE
      PASS  M1  parity, every source           0 gaps over 344,635 records
      PASS  M2  idempotent, offline            row counts identical over 344,290 records, all 6 sources
      PASS  M3  atomic writes                  proven by test
      PASS  M4  trimmed raw                    14.8 MB β†’ 3.9 MB = 73.7% smaller
    
      RESOLVE
      PASS  R1  WordNet edges resolved         1,047,918 / 1,047,918 = 100.0%
      PASS  R2  Wiktionary edges resolved      114,827 / 130,519 = 88.0%
      PASS  R3  chains render                  cat: WordNet feline > carnivore > placental > mammal, Wiktionary broader 7 Β· dog: WordNet domestic animal > animal > organism > living thing, Wiktionary broader 12
    
      LINK
      PASS  L1  link rate                      82.5% of 18,028 reachable Β· raw 58.6% Β· any 68.4%
        Β·   L2  conflicts surfaced             1,418 lexemes with two concepts >= 0.7
      PASS  L3  taxonomy reaches Q729          8,025 / 10,386 = 77.3%
      PASS  L4  disambiguation handled         1,764 / 1,775 = 100.0% of nominal lemmas
    
      EXPERIENCE
      PASS  X1  every word has a page          200 / 200 random index lexemes render Β· 152 of them bare
      PASS  X2  search is fast                 p95 62 ms over 20 probes Β· median 18 ms Β· slowest 130 ms
      PASS  X3  forms and variants resolve     4 / 4 probes land: monkeys, cats, geese, spat
    
      PAGES
      PASS  U1  six pages exist                6 / 6 routes
      PASS  U2  the flagship words             cat 8 cards / 2 tiers Β· dog 8 cards / 2 tiers Β· oyster 8 cards / 2 tiers
      PASS  U3  provenance everywhere          43 / 43 cards over 6 words open a record Β· 156 / 156 citations carry one Β· thing panel 5 / 5, reported
      PASS  U4  mobile                         2026-09-07: 12 pages at 375 px β€” home, the word page, its relation groups, its thing panel, the provenance drawer, fake-data mode, the evidence wall, browse, one source, imports, health, /kit
      PASS  U5  coverage is legible            6 / 6 sources agree with dd.health Β· bierce 66 Β· johnson 1,313 Β· wikidata 0 Β· wikipedia 18,028 Β· wiktionary 19,896 Β· wordnet 10,875
      PASS  U6  every card links out           53 / 53 resolve a link out = 100% (43 cards + 10 thing-panel links)
    
      EXTENSIBILITY
      PASS  E1  a new source is cheap          johnson: 1 sources row, 1 module, 1 registry line; 2 migrations
      PASS  E2  a new scope is data            animals 25,402 from 1 WordNet root (oewn-00015568-n) Β· emotions 809 from 1 WordNet root (oewn-00026390-n); 0 code changes
      PASS  E3  the community layer fits       users + examples + votes migrate and roll back cleanly
    
      OPERATIONS
      PASS  O1  the scorecard runs itself      this table
      PASS  O2  it is fast enough              (a) dumps 10m 6s Β· (b) APIs 266m 47s
      PASS  O3  clean and offline-testable     `mix precommit`: compile, format, full suite
      PASS  O4  health page                    `mix dd.health` and /health: coverage, resolution, the link histogram, candidates, conflicts, parity
    
      36 / 36 graded rows pass, 1 reported, 0 pending
    

    mix dd.score --scope emotions

    
    MVP-0 scorecard β€” 21.9 s
    
      ABSORB
      PASS  A1  every source absorbed          6 / 6 absorbed, 6 pinned
      PASS  A2  WordNet is full (plus edition) 120,564 synsets / 161,814 lexemes
      PASS  A3  Wiktionary index is full       1,541,669 lexemes, 566,241 with forms
      PASS  A4  scope built with reasons       809 lexemes, 0 without a reason Β· wordnet_closure 809
      PASS  A5  Wiktionary coverage of scope   96.3% raw Β· 96.4% excl. 1 scientific names
      PASS  A6  Wikidata coverage              57,231 referenced, 0 dangling Β· union 98.0%
      PASS  A7  Wikipedia coverage             10,412 / 10,412 asserted = 100.0% Β· 70,224 / 90,481 incl. candidates = 77.6%
      PASS  A8  Bierce is full and attached    997 entries, 100.0% attached Β· 93.0% already in the index
      PASS  A9  links back everywhere          365,037 / 365,037 = 100.0%
      PASS  A10 images                         233 / 322 = 72.4%
    
      MATERIALIZE
      PASS  M1  parity, every source           0 gaps over 344,635 records
      PASS  M2  idempotent, offline            row counts identical over 344,290 records, all 6 sources
      PASS  M3  atomic writes                  proven by test
      PASS  M4  trimmed raw                    14.8 MB β†’ 3.9 MB = 73.7% smaller
    
      RESOLVE
      PASS  R1  WordNet edges resolved         1,047,918 / 1,047,918 = 100.0%
      PASS  R2  Wiktionary edges resolved      114,827 / 130,519 = 88.0%
      PASS  R3  chains render                  cat: WordNet feline > carnivore > placental > mammal, Wiktionary broader 7 Β· dog: WordNet domestic animal > animal > organism > living thing, Wiktionary broader 12
    
      LINK
      PASS  L1  link rate                      49.2% of 612 reachable Β· raw 37.2% Β· any 74.2%
        Β·   L2  conflicts surfaced             9 lexemes with two concepts >= 0.7
        Β·   L3  taxonomy reaches the scope root no wikidata_root
      PASS  L4  disambiguation handled         205 / 205 = 100.0% of nominal lemmas
    
      EXPERIENCE
      PASS  X1  every word has a page          200 / 200 random index lexemes render Β· 155 of them bare
      PASS  X2  search is fast                 p95 62 ms over 20 probes Β· median 19 ms Β· slowest 125 ms
      PASS  X3  forms and variants resolve     4 / 4 probes land: monkeys, cats, geese, spat
    
      PAGES
      PASS  U1  six pages exist                6 / 6 routes
      PASS  U2  the flagship words             cat 8 cards / 2 tiers Β· dog 8 cards / 2 tiers Β· oyster 8 cards / 2 tiers
      PASS  U3  provenance everywhere          43 / 43 cards over 6 words open a record Β· 156 / 156 citations carry one Β· thing panel 5 / 5, reported
      PASS  U4  mobile                         2026-09-07: 12 pages at 375 px β€” home, the word page, its relation groups, its thing panel, the provenance drawer, fake-data mode, the evidence wall, browse, one source, imports, health, /kit
      PASS  U5  coverage is legible            6 / 6 sources agree with dd.health Β· bierce 43 Β· johnson 435 Β· wikidata 0 Β· wikipedia 612 Β· wiktionary 779 Β· wordnet 809
      PASS  U6  every card links out           53 / 53 resolve a link out = 100% (43 cards + 10 thing-panel links)
    
      EXTENSIBILITY
      PASS  E1  a new source is cheap          johnson: 1 sources row, 1 module, 1 registry line; 2 migrations
      PASS  E2  a new scope is data            animals 25,402 from 1 WordNet root (oewn-00015568-n) Β· emotions 809 from 1 WordNet root (oewn-00026390-n); 0 code changes
      PASS  E3  the community layer fits       users + examples + votes migrate and roll back cleanly
    
      OPERATIONS
      PASS  O1  the scorecard runs itself      this table
      PASS  O2  it is fast enough              (a) dumps 10m 6s Β· (b) APIs 266m 47s
      PASS  O3  clean and offline-testable     `mix precommit`: compile, format, full suite
      PASS  O4  health page                    `mix dd.health` and /health: coverage, resolution, the link histogram, candidates, conflicts, parity
    
      35 / 35 graded rows pass, 2 reported, 0 pending
    

    The three rows that are reported rather than graded

    • L2, conflicts surfaced β€” 1,418 lexemes with two concepts at β‰₯ 0.7 on animals, 9 on emotions.
      A count, not a threshold: disagreement is content, and the word page shows it as a plaque.
    • L3 on emotions β€” no wikidata_root. The scope is not under Animalia and never will be,
      so the row reports instead of grading (S5c's rule).

    What is behind it

    • mix precommit: 487 tests, 0 failures, on checked-in fixtures with the network off (O3).
    • Thirteen tables and two migrations, unchanged through eight sessions and six sources of four
      access kinds (E1).
    • Two scopes, no code β€” animals 25,402 lexemes and emotions 809, both from one WordNet root and
      a JSON file (E2).
    • The community layer written, applied, schema-diffed and rolled back to docs/sketches/, so
      the claim that it touches none of the thirteen is falsifiable (E3).
    • The two acceptance walks on the real index: ten hops from oyster and ten from joy, no dead
      end, every card carrying β†— and β“˜. Posted in full on πŸ–ΌοΈ MVP-0 UI: the minimum word-hopping interface on the Oatmeal theme β€” theme boilerplate first, use case, wireframes, fake-data modeΒ #71.

    What MVP-0 did not settle

    The culture layer is still a rolled-back sketch; P279 is recorded and never chased, so the concept
    chain is one step deep for most non-taxa (#70); Surprise me counts its population on every click;
    and the design is #66's, with #67's evidence wall behind it. ?demo=1 on any word page draws both
    of those as labelled samples, which is the handover.

    Closing this with #70 and #71. Tag: mvp-0.

  10. holden commented on Sep 7, 2026

    @holden
    MemberAuthor

    Closed. MVP-0 passes: animals 36 / 36 graded rows with parity, 1 reported, 0 pending; emotions 35 / 35, 2 reported, 0 pending, on 487 tests with the network off. The full table is in the comment above; the build history is #70 and the UI history #71. Tag: mvp-0, commit a2ef867.

    What you can actually do now, which is what Β§7 promised: type any English word or an inflected form of it and get a page β€” 1,541,669 of them. For the enriched scopes, read Bierce, Johnson, Wiktionary, WordNet and Wikipedia side by side in tier order, with the thing the word names, its chain, its kinds, its may refer to and its disagreements; hop by any relation the sources assert; click β“˜ on any card for the record it came from. Turn the network off and rebuild every derived row from raw.

    Next: #66 the design pass, #67 the evidence wall, #65 quotes. None of them changes the thirteen tables.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationenhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions