pull down to refresh

May help to look at https://github.com/dottxt-ai/outlines - which works rather straightforward. With that, you could probably use a smaller model like gemma-3n or even jan-v3-4B-it to simply return a verdict.

128 sats \ 1 reply \ @k00b OP 28 Jan

hotdog or not hotdog, assmilking or not assmilking, is approximately good enough for what I'll need initially so I could start small.

afaict most of the trouble with this stuff is the non-model parts. still, this thread has already proven useful and the thread is young as they say.

reply
model(your_prompt, Literal["OK", "HOTDOG", "ASSMILKER"], max_tokens=20)
reply