stochastictrebuchet

  • 0 Posts
  • 5 Comments
Joined 2 years ago
cake
Cake day: June 12th, 2023

help-circle
  • ML engineer here. My intuition says you won’t get better accuracy than with sentence template matching, provided your matching rules are free of contradictions. Of course, the downside is you need to remember (and teach others) the precise phrasing to trigger a certain intent. Refining your matching rules is probably a good task for a coding agent.

    Back in the pre-LLM days, we used simpler statistical models for intent classification. These were way smaller and could easily run on CPU. Check out random forests or SVMs that take bags of words as input. You need enough examples though to train them on.

    With an LLM you can reframe the problem as getting the model to generate the right ‘tool’ call. Most intents are a form of relation extraction: there’s an ‘action’ (verb) and one or more participants (subject, object, etc.). You could imagine a single tool definition (call it ‘SpeakerIntent’) that outputs the intent type (from an enum) as well as the arguments involved. Then you can link that to the final intent with some post-processing. There’s a 100M version of gemma3 that’s apparently not bad at tool calling.




  • Belgian here. Their wording is confusing and I’ve been trying to figure out how much of it is meaningful.

    They tacked on a precondition to them recognizing Palestine: Hamas must give up power. I don’t see that condition being met faster than Israel can flatten what remains of Gaza and force its population out – which in turn only creates more suffering and anger for the militant recruit pipeline.

    The sanctions mostly concern boycotts on products produced in occupied regions. Fuck that – boycott all trade with Israel.

    Our rightwing prime minister is on record saying that the whole debate was annoyingly motivated by ‘morality’ and that he’s glad the government (an uneasy coalition) can move on to more important matters. Downright shameful.

    Come protest this Sunday in Brussels. Last one was attended by 100k demonstrators. Was a fun afternoon. More info at 11.be