snapshot · pass@1 · n=5/task
Training moves the needle
Same held-out tasks, graded by Verilator against golden testbenches. The Cologic-trained model beats the base model on pass@1, measured, not claimed.
Qwen3-8B · baseline
0.267
cologic-rtl · cologic
0.300
improvement
+12.4%
+3.3 pts
taskQwen3-8Bcologic-rtl
mux2_w161.00 (5/5)1.00 (5/5)
cmp40.00 (0/5)0.00 (0/5)
popcount160.00 (0/5)0.00 (0/5)
max20.40 (2/5)0.60 (3/5)
dec2to40.00 (0/5)0.00 (0/5)
gray2bin80.20 (1/5)0.20 (1/5)