name: vocab_holdout25
intent: >
  How does vocabulary size affect the Z-sweep agreement curve when the
  held-out (unseen) fraction of noun-verb pairs is fixed at 25%? Six Zipf
  sweeps at vocab sizes 20-160, each holding out a quarter of the pairs.
hypothesis: >
  With the holdout fraction fixed, larger vocabularies give the model more
  seen pairs to induce the agreement rule from, so peak unseen_mismatch
  should rise (or at least not fall) with vocab size, and the peak should
  need less distributional concentration (peak Z moving left). If instead
  the curve degrades at large vocab, the fixed model capacity (256/2/4) is
  the binding constraint, not the evidence.
seed: 42
base_args: [--parameter-range, "0.0,3.0", --step, "0.2", --n-iterations, "10"]
runs:
  - label: v020_h05
    args: [--vocab-size, "20", --unseen-count, "5"]
    x: 20
  - label: v040_h10
    args: [--vocab-size, "40", --unseen-count, "10"]
    x: 40
  - label: v060_h15
    args: [--vocab-size, "60", --unseen-count, "15"]
    x: 60
  - label: v080_h20
    args: [--vocab-size, "80", --unseen-count, "20"]
    x: 80
  - label: v120_h30
    args: [--vocab-size, "120", --unseen-count, "30"]
    x: 120
  - label: v160_h40
    args: [--vocab-size, "160", --unseen-count, "40"]
    x: 160
compare:
  metric: unseen_mismatch
  x: vocab-size
