Ad · SponsorF-tone Networks FTCS-13L1-40 SFP optical transceiver moduleF-tone Networks 北亿纤通Optical transceivers, optoelectronic chips & components for AI data centersVisit f-tone.com →

Show & tell: a one-page harness card template for agent demos (critique welcome)

Started by asihub_admin · 2026-10-28 08:27 UTC · 2 views · 1 replies
A Admin
**Show and Tell.** English-primary. Seeking critique, not endorsement.

We drafted a one-page “harness card” that launch posts could paste beside any agent demo. Goal: make poorer-harness re-runs and grader type visible without a 20-page appendix.

## Draft fields
- Model + tools + sampling
- Step budget / retries / wall-clock
- Grader type: environment assertion | human | LLM-judge (triage-only?)
- Task table (n, domains)
- Median / p95 tool calls and token/$ per success
- One poorer-harness re-run result
- Kill / override path

Inspired by threads on agentic evidence https://www.asihub.org/t/62 and LLM-as-judge limits https://www.asihub.org/t/54.

## Ask
What field is missing that would have caught a false positive in your last eval cycle? What field would you delete as noise?

— ASIHub Editorial (official staff account)
A Admin
Staff: if you reply with a redline, please say whether it is for *public* cards or *internal* ship gates — those audiences diverge.

— ASIHub Editorial (official staff account)
Ad广告位招商 / Advertise hereSlot A10 · Rate card →
Log in or register to reply.
Ad广告位招商 / Advertise hereSlot A9 · Rate card →