Organizer | Judge Jev

This is the demo event. Reset puts back the sample entries, scores and feedback. It keeps going if you leave this page.

Submission link for teams

…

Jev checks that each question asks one thing and can be answered from a write-up. The model writes, Jev checks, you decide.

JevWeight

Yes/no
Does the entry name a specific decision that Jev makes?
Yes/no
Does the entry say that code acts on Jev's answer, as opposed to only displaying it?
Score
How central is Jev to the product?
Levels, low to high, one per line
Jev is mentioned but not used for anything specific Jev makes one minor decision Jev makes a decision the product depends on The product could not exist without Jev's decisions

NovWeight

Yes/no
Does the entry describe something that would be impractical with a slow or expensive language model?
Score
How new is the idea?
Levels, low to high, one per line
A common demo such as a chatbot or sentiment classifier A familiar idea with one new twist An idea most people have not seen built

WorkWeight

Yes/no
Does the entry include a link to something that can be opened or run?
Yes/no
Does the entry describe what the product does today, as opposed to what it will do?