← Back to digest
HF Trending Papers

RULER turns per-prompt rubrics into SVG rewards

What's this about?

RULER derives six criteria from each request, renders candidate SVGs and asks a vision-language judge to score each criterion for RL.

Why not use one image score?

A scalar can reward superficial resemblance and invite reward hacking. A rubric separates semantic correctness, composition and style, though the judge can still carry biases.

Why does this matter?

Author-reported preprint; 13 HF upvotes.
  1. It needs neither paired SVGs nor human preference labels.
  2. Reported rubric scores rise from 0.432/0.395 to 0.693/0.683.
  3. Visual quality still needs evaluation beyond the training judge.
← OmniEdu opens education-focused models and dataCARE teaches robot policies to recover from real failure patterns →