Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Sharing a tool to quickly set up Harness Engineering environments — with early experimental data #62

renjianguojinqianfan started this conversation in Show and tell
Discussion options

Symphony's README mentions it works best in codebases that have adopted harness engineering. I've been exploring this idea from the other direction — building a lightweight CLI tool called Project-Bootstrap-Harness (PBH) that helps developers quickly establish that environment.

What it does: pip install harness-init seeds a Python project with AGENTS.md (AI collaboration protocol), make verify (lint + test + coverage gate), and progress.json (phase tracking). The goal: any AI coding agent, regardless of tool or model, can understand the project within 30 seconds.

Experimental data: To test whether this actually helps, I ran a controlled comparison — same AI agent (Trae Solo Coder), same task (add a greet CLI subcommand with tests and docs), two starting conditions: an empty folder vs. a PBH-scaffolded project.

Key results:

Task steps reduced by 40% (10 → 6)

Debugging iterations reduced by 75% (4 → 1)

Total time reduced by 60% (15-20 min → 5-8 min)

New tests doubled (4 → 8)

Quality gate automatically executed in the PBH project (make verify), not in the bare one

Full experiment summary: summary.en.md

Honest caveat: This is a single data point. PBH provides a bundle of scaffolds rather than one isolated variable, so the experiment measures the combined effect of having a structured environment versus having none at all. I'd love to hear if others have done or would be interested in similar comparisons.

PBH repo: https://github.com/renjianguojinqianfan/Project-Bootstrap-Harness

Curious to hear the community's thoughts — and whether a quick-start harness engineering setup is something Symphony users would find useful.

You must be logged in to vote

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet

AltStyle によって変換されたページ (->オリジナル) /