Whole-server fuzzing: finding leaks and stalls in a server you were not told about¶
scripts/bench_fuzz.py --mode server is the whole-server mode of the live-server behaviour fuzzer governed by ADR-125. The full ADR-125 design discovers the attack surface from the server itself, finds leaks and main-thread stalls by comparison with a vanilla baseline, and blames a jar only after the finding has reproduced; the shipped CLI slice implements only the defensive, non-executing passive local audit (status: "passive_only").
- Governing decision: ADR-125 (Accepted under Rule D-005; ADR
Acceptedstatus records architectural design approval, not implementation completeness). It amends ADR-111 section 2.2 for server mode only, and extends the platform profile of stress-test-ADR-001 with a server-mode carve-out from its decision 6 (isolation and--plugin-packagesattribution). ADR-122 is Proposed. - Status (passive CLI audit +
--activelive runner + offline callback-driven library): - Passive local audit (
scripts/bench_fuzz.py --mode server, default): runs the read-only passive local audit described in Passive local audit (--mode server) below (status: "passive_only"). - Live active discovery fuzzing (
scripts/bench_fuzz.py --mode server --active): executes the active ADR-125 discovery, baseline, tier-stratified bandit exploration (including player-taxonomy bot archetypeshomesteader_reroll,explorer_wander, andcoop_group),JcmdObserver(GC.class_histogramandThread.printlocally, via--ssh <host>/$BENCH_SSH_HOST, or--container), live action shrinking (shrink_bots), numeric argument bisection (bisect_numeric_arg), and dependency-closed jarddmin(ddmin_jars), guarded by four anti-abuse gates (disposable--server-dir+ RCON password proof-of-ownership, RFC1918/Tailscale/local-hostname allow-list, offline-onlyfz*bots, andDEFAULT_DENYLIST). - Offline & callback-driven Python library (
scripts/bench_fuzz_server.py): implements the pure, deterministic schema, scheduling, reduction, and trace-evaluation algorithms tested inscripts/tests/test_bench_fuzz.py: Brigadier boundary-ladder argument sampling (numeric_ladder,gen_args,build_arm_program), tier-stratified UCB1 arm scheduling (NodeBandit,SCENARIO_SHAPES), callback-driven parameter threshold bisection (bisect_numeric_arg), pre-ddminguardrails and dependency-closed jar delta debugging (run_pre_ddmin_probes,ddmin_jars), and offline trace evaluation and report formatting (evaluate_server_trace,build_finding_verdict,format_server_findings_report). Every live-server result below that is not explicitly attributed to a recorded target-mode run remains a validation target, not recorded live evidence. - Target mode (one named plugin per restart,
--cmd): unchanged; seeLEAK_FUZZING.mdandBEHAVIOUR_FUZZING_PLAN.md.
Passive local audit (--mode server)¶
The implemented --mode server CLI runs a single defensive, non-executing audit pass and refuses any flag that would execute commands, mutate permissions, toggle jars or claim a causal finding:
- Strict local disposable and offline validation: requires an explicit
--profile(paper,fabricorneoforgewith an existingplugins/ormods/directory inside--server-dir), a local loopback--hostand--mc-host(127.0.0.1,localhostor::1), and a local disposable bench directory produced byscripts/bench_setup.py(server.propertieswith explicitonline-mode=false,--mc-portmatchingserver-port, and a disposable markerbench-loop.sh,no-restart-scriptinspigot.yml, or.bench-disposable, outside any.gitworking tree or system root). Only--tiers defaultis accepted. Target-specific flags (--cmd,--names,--jars,--plugin-packages,--targets,--rtp-args), unsafe/op/container/mutation flags (--grant,--lp-group,--console*,--allow-online,--container,--mat,--no-restart,--no-isolate), replay flags (--replay,--ep,--replay-seed,--replay-n,--replay-budget), and active budget/stall flags (--episodes,--seeds,--reps,--rungs,--warmup,--shrink*,--finding*,--surprise*,--coverage,--stall-ms,--default-budget-share) are rejected with exit code2. - Read-only
declare_commandscapture and offlineJarIndexinventory: logs in onedefault-tier bot viabench-swarm.js(discoverop), captures the logindeclare_commandspacket without sending any chat commands,tab_completeprobes, window clicks or RCON commands, foldsnamespace:cmdandcmdaliases when their subtrees match, cuts redirect cycles, appliesDEFAULT_DENYLISTplus any operator--denypatterns, and writescommands.json(recording an explicit truncation warning if the command graph hits the node cap).JarIndexscansplugins/ormods/offline viazipfilewithout renaming or toggling any.jarfiles. - Linux-only verified
jcmdPID snapshot and GC pause exclusion: when the operator explicitly passes--pid-file <path>,--pid <pid>or--jcmd-snapshot,JcmdObserververifies on POSIX hosts that the target PID is alive, owned by the current OS user, and positively tied to--server-dirvia/proc/<pid>/cwdor a fresh/proc/<pid>/cmdlinecheck (failing closed on Windows/non-POSIX hosts, unreadable/procmetadata, or recycled PIDs, and re-verifying PID ownership immediately before eachjcmdcall). It collects one read-onlyGC.class_histogramand oneThread.printdump. Becausejcmd <pid> GC.class_histogramtriggers a stop-the-world full GC pause on the target JVM,JcmdObserverrecords[start_ms, end_ms]wall-clock exclusion windows (including post-command grace) sofilter_tick_gapsandStallOracleexclude anytick_gapevent ({ev: "tick_gap", bot, ms, at, keepalive_ms, id, t}) whose[at - ms, at]interval overlaps a GC or thread-dump window (observer_window); untimed gaps (unverifiable_timestamp) are failed closed only when exclusion windows are defined. - Non-causal report (
PASSIVE_ONLY): emitsverdict.jsonandreport.txtwith"status": "passive_only","verdict": "PASSIVE_ONLY","baseline": {"available": false, "status": "unavailable"},"confirmed_culprits": [],"blamed_jars": [], and"findings": []. Top histogram classes and the main-thread stack frame are annotated with their offlineJarIndexowner (jar_owner/first_suspect) for inventory inspection only; statistical leak screening requires exchangeable episodes and a vanilla baseline, so a single snapshot makes no causal leak, stall, mitigation (operator_mitigation) or reproducer (author_reproducer/replay_cmd) claims.
Live active whole-server fuzzing (--mode server --active)¶
Passing --active switches ServerRun from passive audit mode to live discovery fuzzing against a disposable server copy (either locally or on a LAN bench host configured via --host / --ssh or BENCH_HOST / BENCH_SSH_HOST):
# 1. Prepare a disposable bench server copy on the target host / shared mount:
python3 scripts/bench_setup.py "$BENCH_SOURCE_DIR" "$BENCH_SERVER_DIR" --port 25566 --rcon-port 25576
# 2. Run live whole-server discovery fuzzing against the configured bench host:
python3 scripts/bench_fuzz.py --mode server --active \
--profile paper \
--server-dir "$BENCH_SERVER_DIR" \
--host "$BENCH_HOST" \
--ssh "$BENCH_SSH_HOST" \
--remote-server-dir "$BENCH_REMOTE_SERVER_DIR" \
--tiers default,op \
--episodes 40
- Player-taxonomy scenario shapes (
SCENARIO_SHAPES): alongside fault-oriented follow-ups (quit_lt1s,quit_delay,rejoin,repeat,concurrent,window_clickwith protocol-levelclickandclose_window),build_arm_programexercises three player-taxonomy archetypes fromPLAYER_TAXONOMY_VALUATION.md: homesteader_reroll(Mode 1 Reroll Cascade): dispatches the command, inspects the landing with a short walk (move), rejects the site and dispatches two rapid rerolls before settling.explorer_wander(Mode 3 / Mode 4 Outward Traverse): dispatches the command, traverses outward across chunks viamovepackets, and issues a follow-up command while moving.coop_group(Mode 8 Cooperative Group Settle): joins multiple bots that coordinate commands and movement together.- Anti-abuse safeguards:
- Proof-of-ownership gate: requires both filesystem access to a disposable
--server-dir(server.propertieswithonline-mode=false, a disposable marker file, andrcon.password) and a live authenticated RCONlisthandshake before opening any bot connection. - Private/local host gate (
is_allowed_bench_host): permits only loopback (127.0.0.1,localhost,::1), RFC1918 LAN (10.0.0.0/8,172.16.0.0/12,192.168.0.0/16), Tailscale CGNAT (100.64.0.0/10), or local bench hostnames (single-label LAN aliases,*.local,*.lan); rejects public WAN IPs and internet domains even when supplied viaBENCH_HOSTorBENCH_SSH_HOST. - Offline-only self-identifying bots:
bench-swarm.jsconnects strictly withauth: 'offline'andfz*/bench_*bot names from the single runner IP. - Mandatory command denylist: enforces
DEFAULT_DENYLIST(plus--deny) across generation, shrinking, numeric bisection, and replay.
Why a target-free mode¶
Target mode found BetterRTP 3.6.13's quit-session retention because the operator isolated BetterRTP-3.6.13.jar and told the bots to send /betterrtp:rtp. A server admin with many plugins has neither piece of knowledge. Server mode replaces each piece of prior knowledge with something the server reports or a measurement:
| Target mode needs | Server mode uses instead |
|---|---|
--cmd (what to send) |
The declare_commands Brigadier tree each bot receives at login, per permission tier |
| A fixed action list | A bandit over (command node, follow-up shape), with parser-typed arguments and tab-completion values |
| One jar per restart (isolation) | All jars at once; isolation only afterwards, by jar ddmin |
The direct control |
A same-seed vanilla baseline with only the prerequisite jars (population control), plus a prerequisites-only replay of each shrunk finding (per-finding control) |
| StressTestRTP histograms (Bukkit only) | jcmd GC.class_histogram and Thread.print from the host; StressTestRTP used if it answers |
PLUGIN_PACKAGES / --plugin-packages |
A class-to-jar index scanned from plugins/ or mods/ |
Pipeline (ADR-125 design, not implemented)¶
The stages below are the ADR-125 active design. Only the passive local audit above is implemented; none of these stages run under --mode server today.
flowchart TD
A[Inputs: host, RCON, server dir, profile, tiers, budget] --> B[1. Vanilla baseline<br/>prerequisite jars only, same seeds on the vanilla tree]
B --> C[2. Discover<br/>one bot per tier logs in, sends declare_commands tree,<br/>tab-completion probes -> commands.json]
C --> D[3. Explore<br/>bandit picks node x follow-up,<br/>gen_args fills arguments, swarm runs episode]
D --> E{Oracles<br/>leak screen, stall, log}
E -- nothing new --> D
E -- candidate not in baseline --> F[Replay --finding-n times<br/>confirm on --finding-k]
F -- did not reproduce --> D
F -- reproduced --> G[4. Shrink program<br/>ddmin over actions, shrink_bots]
G --> V[5a. Restart with full jar set<br/>replay shrunk program]
V -- does not reproduce --> I
V -- reproduces --> W[5b. Restart with prerequisites only<br/>replay shrunk program]
W -- reproduces --> X[label server: no jar blamed]
X --> I
W -- does not reproduce --> H[5c. Jar ddmin<br/>restart with jar subsets + prerequisites,<br/>replay shrunk program]
H --> I[6. Report<br/>verdict.json, commands.json coverage]
Components (design)¶
graph LR
D[bench_fuzz server mode] -->|discover op| S[bench-swarm bots]
S -->|commands, completions, window, tick_gap| D
D --> B[NodeBandit + gen_args]
B -->|programs| S
S -->|packets| M[MC server, any platform]
D -->|jcmd histogram, Thread.print| M
D -->|tail| L[latest.log]
D --> J[JarIndex: plugins/ or mods/]
D -->|restart with jar subsets| R[jar ddmin]
D -.->|optional| H[StressTestRTP /rtpstress]
1. Discovery (design; only the read-only commands.json capture above is implemented)¶
sequenceDiagram
participant Drv as Driver
participant R as RCON
participant Bd as Bot (default tier)
participant Bo as Bot (op tier)
participant Srv as Server
Drv->>R: op fuzz_op_0
Drv->>Bd: discover
Drv->>Bo: discover
Bd->>Srv: login
Srv-->>Bd: declare_commands (filtered for default)
Bo->>Srv: login
Srv-->>Bo: declare_commands (filtered for op)
Bd-->>Drv: {ev:commands, tier:default, tree}
Bo-->>Drv: {ev:commands, tier:op, tree}
Bo->>Srv: tab_complete "/ff:scan "
Srv-->>Bo: matches
Bo-->>Drv: {ev:completions, text, matches}
Drv->>R: deop fuzz_op_0
Drv->>Drv: merge tiers, fold aliases, resolve redirects, apply denylist -> commands.json
- Tree: nodes carry kind (root, literal, argument), name, parser and properties, children, redirect, executable flag and suggestion type. Each merged node records which tiers can see it and its minimum visible tier (
defaultbeforeop). - Aliases:
betterrtp:rtpandrtp(when both resolve to the same subtree) are one node with two names. Redirect cycles (execute ... run) are cut. - Arguments by parser: integer, long, float and double sampled from a boundary and magnitude ladder (
min,-1,0,1,16,64,256,1024, a clamped upper cap andmax, plus uniform within bounds) so threshold bugs are reached without wasting episodes on extreme 32-bit values;bool; word, quoted and greedy strings; entity and game-profile as{self}or another bot; block positions and vectors near the bot; dimensions and resource locations from completion replies. A usage or error reply moves mutation toward the other parser branches. - No metadata:
plugin.ymlandfabric.mod.jsonare never read for discovery. They are read only for hard dependencies during jarddmin.
2. Goal heuristics (design)¶
- Arms: (command node, follow-up shape). Shapes:
quit_lt1s(quit within a second),quit_delay(quit while a delay or countdown is pending),rejoin,repeat,concurrent(another bot runs the same node), and protocol-levelwindow_click+close_windowsequences when a command opens an inventory window (bench-swarm.jshandlesopen_window,window_clickandclose_windowpackets directly because lean mode disables Mineflayer'sinventoryplugin). - Selection: UCB1, stratified by tier so
default-visible (player-reachable) nodes get the primary episode share and cannot be starved by a much largeroptree (--tiers defaultrestricts the run to player-reachable nodes). Reward: novelty (a reply shape or log signature not seen before, the ADR-111 corpus keys) plus harm (class growth per action, tick-gap excess, kicks). - Why follow-ups matter: both session-leak positives below (BetterRTP and the planted
ff:queue) need the player to leave while something the command started is still pending. A bandit over nodes alone would send the command and wait, which retains nothing.
3. Detection (design)¶
| Oracle | Signal | Compared with | Signature | First suspect |
|---|---|---|---|---|
| Leak | Post-GC class counts per episode (jcmd GC.class_histogram, live) fitted against feature counts node, node x follow-up, departures; Bonferroni over classes x features |
Vanilla baseline fit; run's own episodes | Class + feature | Jar containing the class |
| Stall | Acute single update_time gap or episode-wide update_time interval inflation (mean/p95 excess during repeat and concurrent), minus intervals overlapping driver GCs, dumps or restarts |
Baseline p99 + --stall-ms (2000) for acute spikes; baseline interval distribution for sustained inflation |
Recurring top main-thread frame (jcmd Thread.print) that is not JDK or server code |
Jar containing that frame |
| Log | Exceptions with a stack trace (ADR-111 parsing) | Baseline signatures | ADR-111 signature | Jar of the first non-server frame |
No class name is hardcoded anywhere. The class a leak finding reports (for example AdvancementProgress for a retained player) is an output of the screen, never an input. When a reproduced finding's shrunk program includes a numeric argument on the ladder, the shrinker bisects between a passing bound and the failing value to report the minimal reproducing threshold.
4. Attribution: jar ddmin (design)¶
flowchart LR
F[Reproduced, shrunk finding] --> A{full set reproduces?}
A -->|no| U[not reproducible after restart: no blame]
A -->|yes| E{prerequisites only reproduces?}
E -->|yes| V[label server: no jar blamed, no ddmin]
E -->|no| S[jars J1..Jn + prerequisites]
S --> P{probe subset}
P -->|restart with subset + prerequisites + hard deps| Q[replay shrunk program --finding-n times]
Q -->|>= --finding-k hits| Y[reproduces: keep shrinking this subset]
Q -->|fewer hits or a jar failed to load| N[does not reproduce: try complement / finer split]
Y --> P
N --> P
P -->|1-minimal| Z[blamed jar set]
- Why two probes first:
ddmininscripts/bench_fuzz.pyassumes the full set reproduces, never tests the empty set and always returns at least one item. Without the prerequisites-only probe, a vanilla stall or leak would be pinned on whichever jarddminends on. - Full set: a restart with every jar, then
--finding-nreplays. Fewer than--finding-khits: the finding is reported as not reproducible after restart and is not attributed. - Prerequisites only: a restart with only the prerequisites (and the harness, if it is the observer), then
--finding-nreplays. At least--finding-khits: labelledserver, noddmin, no jar blamed. A shrunk program whose command does not exist in vanilla gets the unknown-command reply and so does not reproduce. - The index gives a first suspect;
ddmingives the verdict. A finding is blamed on a jar only if removing that jar makes it stop reproducing. - For one culprit among n jars, expect two pre-
ddminprobes plus on the order of 2 x log2(n) subset probes, each one restart plus up to--finding-nreplays. A bug that needs two jars returns both. - Verdict and resolution output:
verdict.jsonandreport.txtemit both operator mitigation (canonical command node, all discovered aliases, minimum reproducing tierdefaultvsop, and any bisected argument bound to block or revoke incommands.ymlor a permission plugin) and the author reproducer (blamed jar set or unconfirmed first suspect onINCONCLUSIVE, leaked class slope or culprit stack frame, shrunk program, reproduction countkofn, and a one-line--replaycommand). - Declarative BIT report & aligned CSV (
bit-report.json,bit-table.csv): Every--mode serverevaluation also emits aBitReport-compatible JSON (schema: 1,health: HEALTHY | DEGRADED | FAILED,findings) andBitTable-formatted aligned CSV across four components (bench.ramp,bench.attribution,bench.frames,bench.surface) using theBENCHnamespace catalog:
| ID | Code | Severity | Tier | Component | Meaning |
|---|---|---|---|---|---|
| 5001 | BENCH_CMD_IMPACT |
INFO | CBIT | bench.surface |
Empirical p95_gap_ms, max_gap_ms, and retained_per_ep for a tested (tier, command, shape) arm |
| 5002 | BENCH_CMD_HITCH_SUBTHRESHOLD |
WARNING | CBIT | bench.surface |
Command exceeded 1.5x baseline p99 tick gap without crossing the hard stall failure threshold |
| 5003 | BENCH_MAIN_THREAD_FRAME |
INFO | CBIT | bench.frames |
Main-thread stack frame share captured during elevated tick-gap intervals |
| 5101 | BENCH_STALL_ACUTE |
ERROR | IBIT | bench.attribution |
Confirmed acute main-thread stall with bisected pass_domain / fail_domain and ddmin jar ablation |
| 5102 | BENCH_STALL_SUSTAINED |
ERROR | IBIT | bench.attribution |
Confirmed sustained tick inflation under repeat or concurrent load |
| 5103 | BENCH_STALL_UNISOLATED |
WARNING | IBIT | bench.attribution |
Tick-gap stall observed during exploration (unconfirmed / --no-restart) |
| 5201 | BENCH_LEAK_POST_GC |
ERROR | IBIT | bench.attribution |
Confirmed post-GC class retention slope isolated to blamed_jars |
| 5202 | BENCH_LEAK_UNISOLATED |
WARNING | IBIT | bench.attribution |
Unconfirmed post-GC class retention slope |
| 5301 | BENCH_SURVIVAL_RAMP_PASS |
INFO | IBIT | bench.ramp |
Concurrency rung (players=N) satisfied tick-gap, disconnect, and retention SLO invariants |
| 5302 | BENCH_SURVIVAL_RAMP_DEGRADED |
WARNING | IBIT | bench.ramp |
Concurrency rung experienced elevated p95 tick gap without acute stall or disconnect failure |
| 5303 | BENCH_SURVIVAL_RAMP_FAIL |
ERROR | IBIT | bench.ramp |
Concurrency rung (players=N) violated survival SLO invariants (max_surviving_players / first_failing_players) |
- Progressive 100-player survival ramp (
--target-players 100/--ramp-rungs): Passing--target-players 100executes a progressive concurrency ramp (10 -> 25 -> 50 -> 75 -> 100concurrent player-taxonomy bots) before command exploration and populatessurvival_envelope(max_surviving_players,first_failing_players, per-rungp95_gap_ms,max_gap_ms,disconnects, andpost_gc_retained_objects). - Baseline vs per-finding control: the baseline uses the same seeds and generator on the tree vanilla itself declares, so it does not run the same programs as exploration. It gives population statistics (class-growth fits, tick-gap p99, log signatures); a signature it also produced is never reported. The per-finding vanilla check is the prerequisites-only replay above.
5. Permission tiers and the denylist (design; the denylist and tier rules are partly implemented for the passive audit)¶
--tiers default,op(or--tiers defaultfor player-reachable hardening). Default-tier bots join with no extra permissions and inherit whatever the server's existing configuration grants a new player; unlike target mode, server mode never runsLuckPermsor permission-plugin grants (lp group default permission set ...), preserving the boundary betweendefaultandop. Op bots are opped through RCONopbefore joining and de-opped at episode end and at driver exit, including on error.- Entry syntax:
root [subpath] [<argkind>], matched after alias folding (minecraft:stopmatchesstop).rootmay end in a*glob; a root-only entry denies the whole subtree;subpathdenies only that literal path;<argkind>denies paths whose next argument has that parser kind.
| Entry | Denies | Still allowed |
|---|---|---|
stop, restart, op, deop, whitelist, save-off, execute, kick, difficulty, gamerule |
The root and its subtree | - |
ban*, pardon* |
ban, ban-ip, banlist, pardon, pardon-ip and subtrees |
- |
kill <entity> |
kill followed by a selector |
Bare kill (the sender) |
reload confirm |
That path | reload alone |
tick freeze, tick unfreeze, tick rate, tick sprint, tick step |
Changes to the tick loop the stall oracle measures (vanilla 1.20.3+) | tick query |
- Built-in vs operator entries: the built-in list names no plugin, mod or class.
--denyadds operator entries in the same syntax and may name plugin commands (site policy); nothing removes entries. Evidence runs pass no--denyentry naming BetterRTP or the fixture. - Denied nodes are never sent, including during shrinking and replay.
- Server mode runs only on a disposable bench copy made by
scripts/bench_setup.py. Nothing restores the world,ops.jsonor plugin configs between runs: start each run from a fresh copy.
6. Platform profiles (design)¶
| Profile | Jar folder | Prerequisites always kept | Log patterns | Observation |
|---|---|---|---|---|
paper |
plugins/ |
Via plugins (Mineflayer on 26.x) | ADR-111 stack traces, Could not pass event |
Host jcmd, PID from --pid-file or jcmd -l |
fabric |
mods/ |
Fabric loader, Fabric API | Stack traces only | docker exec <container> jcmd 1 ... on the devstack |
A missing jcmd, the wrong user or an unmatched PID fails the run at start with a hint. It is never read as an empty histogram.
- Python reads: JSON, text,
jcmdoutput and jar archives through the stdlibzipfilemodule (class entries for the index;plugin.yml,paper-plugin.yml,fabric.mod.jsonfor hard dependencies). No third-party package. - Optional harness: if
/rtpstressanswers at the start of the run, StressTestRTP may be the observer for the whole run. Its jar then counts as a prerequisite: kept in the baseline, both pre-ddminprobes and every subset, and never addmincandidate, so every comparison uses the same observer.
Validation targets (design; not evidence until a recorded run exists)¶
The method is credible only if it finds bugs it was never told about. Two kinds of positive are used. Neither name appears in any input, oracle, rule or denylist.
Known real-world positive: BetterRTP 3.6.13¶
What is recorded (target mode, LEAK_FUZZING.md, run fuzz-20261010-213747):
- With only
BetterRTP-3.6.13.jaradded, seeded programs retained +1 to +4 whole player sessions per episode (about 1,800AdvancementProgressand 3,900CriterionProgresseach);directretained 0 in 80 episodes. Replays of e12, e17, e30 and e40 each reproduced 3 of 3. - The shrinker reduced the trigger to one bot sending one
/betterrtp:rtpand disconnecting about 1 s later (2 of 3). Probes lasting 2 s retained nothing. - Likely owner from bytecode:
PlayerInfokeepsrtping(and inventory maps) keyed by the livePlayer, and the quit handler never clears it. This has not been confirmed by a GC root path.
What is not established:
- The run's verdict was INCONCLUSIVE because of a since-fixed swarm bot cap that rejected every rung-1 episode; the replays, not a ladder verdict, are the evidence.
- The run was told the plugin and the command. The fit that flagged it scored a player census that named player classes; that census has been removed in favour of the per-departure class screen, and the class screen has not yet been run against BetterRTP.
- The leak is intermittent: in that run the first reproducible candidate came at e12, and a later 8-episode screen returned PASS. About 24 or more episodes, or a replay of the shrunk program, are needed.
- Server mode has never been run against it.
What server mode must show: with BetterRTP installed among other plugins and never named, the screen flags a player-session class per rtp x quit_lt1s (or quit_delay) above the baseline, the finding reproduces, and jar ddmin reduces the jar set to BetterRTP-3.6.13.jar. If the exploration budget runs out first, the fallback evidence is a replay of the shrunk program plus the jar ddmin, with the episode count stated.
Planted-bug fixture¶
A small fixture with a neutral core, a Paper plugin (plugin.yml, namespace ff) and a Fabric mod (Brigadier command through Fabric API). Its commands look ordinary:
| Command | Planted bug | Expected oracle and feature |
|---|---|---|
/ff:queue <n> |
Stores the player in a static map; the entry is cleared only when a 1.5 s timer completes, so a player who quits first is retained. Same shape as BetterRTP. | Leak: a player-session class per ff:queue x quit_lt1s; ddmin to the fixture jar |
/ff:scan <radius> |
With radius > 48, busy-loops the main thread for about 3 s. Smaller radii return at once. |
Stall: tick gap > 2000 ms above baseline p99; top frame in the fixture; ddmin to the fixture jar |
scan tests whether argument generation explores the declared integer range rather than a fixed value; queue tests whether the bandit reaches the quit-while-pending follow-up.
Planned evidence runs¶
| Run | Server | Jars | Expected | Status |
|---|---|---|---|---|
Paper (fuzz-20261024-173142) |
Paper 26.2 on Threadripper bench host (bench_setup.py --preset smp-sample) |
Prerequisites (ViaVersion, ViaBackwards, Vault, LuckPerms), SMP controls (EssentialsX, GriefPrevention, CoreProtect), BetterRTP 3.6.13 (Queue.Enabled: true cache + 2 s warmup), FuzzFixturePaper.jar (LeafRTP excluded) |
Fixture leak (/ff:queue) and stall (/ff:scan > 48) found and attributed to FuzzFixturePaper.jar; BetterRTP session retention found and ddmin to BetterRTP-3.6.13.jar; zero false blame on LuckPerms, EssentialsX, GriefPrevention, or CoreProtect |
Confirmed (FAIL, 3/3 findings isolated) |
| Fabric | Fabric 1.21.11 devstack (docker-compose.fabric.yml-based) |
Fixture mod, Fabric API | Both planted bugs found and attributed | Not run |
Provisioning the Paper sample server on the bench host:
python3 scripts/bench_setup.py "$BENCH_SOURCE_DIR" "$BENCH_SERVER_DIR" \
--preset smp-sample --port 25568 --rcon-port 25578 --heap 12G
Results, run IDs, episode counts and command coverage will be recorded here and in LEAK_FUZZING.md, including anything that did not reproduce.
Limits¶
- PASS means "nothing found within budget" (ADR-111 section 2.5), and in server mode the budget is shared by every discovered node.
- Noise: many plugins mean many classes and features; the Bonferroni correction costs sensitivity.
- Destructive commands are limited by the denylist and bounded by the bench copy, not eliminated.
- Not covered: JaCoCo coverage in server mode, NeoForge runs (the profile shape applies; no devstack yet), and the ADR-122 harness carriers.
- Attribution is to jars, not code paths. A shaded library is blamed on the jar that ships it.
References¶
- ADR-125, ADR-111, stress-test-ADR-001, leafrtp-ADR-061
scripts/bench_fuzz.py,scripts/bench_fuzz_server.py,scripts/bench_overnight.py,scripts/bench_setup.py,devstack/clients/bench-swarm.js- Zeller and Hildebrandt, Simplifying and Isolating Failure-Inducing Input, IEEE TSE 28(2), 2002