Back to playlists
Smoke Test Playlist
Just the smoke-test challenge, for verifying the submit/score pipeline.
Coverage
easy 1 2 vulnerabilities total
Runs
Compare how tools did on this playlist: challenges solved against time, by model and agent count, plus recall, chain progress and cost across runs.
Agents not reported
Recall
0%
100%
100%
100%
testrun1testrun2run6Japirdole
F1 score
0%
0%
0%
67%
testrun1testrun2run6Japirdole
Stages reached
0/0
2/2
2/2
2/2
testrun1testrun2run6Japirdole
Vulnerabilities captured
0/0
2/2
2/2
2/2
testrun1testrun2run6Japirdole
Duration
2s
2m 48s
2m 58s
2m 52s
testrun1testrun2run6Japirdole
Cost
n/a
n/a
n/a
n/a
testrun1testrun2run6Japirdole
| Run | Tool | Models | Agents | Concurrency | When | Duration | Solved | Recall | F1 | Captured | Stages | Cost | Scorer | Status |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Japirdole | effractor | n/a | n/a | 1 | Aug 29, 08:43 PM | 2m 52s | 1/1 | 100% | 67% | 2/2 | 2/2 | n/a | v1 | completed |
| run6 | effractor | n/a | n/a | 1 | Aug 29, 08:35 PM | 2m 58s | 1/1 | 100% | 0% | 2/2 | 2/2 | n/a | v1 | completed |
| testrun2 | effractor | n/a | n/a | 1 | Aug 27, 07:06 PM | 2m 48s | 1/1 | 100% | 0% | 2/2 | 2/2 | n/a | v1 | completed |
| testrun1 | effractor | n/a | n/a | 1 | Aug 27, 07:00 PM | 2s | 0/1 | 0% | 0% | 0/0 | 0/0 | n/a | n/a | completed |
Challenges run in this order
- 1 Smoke Test Challenge easy web 2 vulnerabilities