cyclic/lsfbench
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
75891d2b8a7df2b68e2d296a27d7b5d5362e00ef
lsfbench/README.md
cyclic bcb31d84e6 base benchmark
2025-09-04 23:00:01 -06:00

371 B
Raw Blame History

LSFBench

Minimal Luau/Lune benchmark to evaluate LLMs: one model answers questions, another model scores the answers against the reference key.

Quick Start

Prereqs

  • Install Lune (0.10.x)
  • Start Ollama at http://localhost:11434 and pull the models referenced in config.luau (e.g. qwen3:4b)

Notice

The evaluator model must support structured JSON outputs.