kersplomp

Ah if only I had self control

It’s probably not true if that makes you feel better. futurism is usually fast and loose with the articles 🤷‍♀️

you seem to be under the wrong impression that “random dice roll” == “random dice roll from a uniform distribution”.

Almost all dice are uniformly random. Unless you’re using weighted dice? Which, seeing how defensive you get when wrong, might actually make sense 🤔

Knowledge isn’t a competition. Nobody cares about any of this. We will all die and be forgotten. You’re on an internet forum with a bunch of people who have no idea who you are and who could care less about your knowledge of statistics.

Respectfully blocked. I have better things to do with my time.

Apologies for the late reply, but it turns out I can’t let that sit. Sorry for the rant, but I work in RL and saying “it’s just dice rolls” is insulting to my entire line of work. :(

A probability distribution is not the same as random dice roll. Dice rolls are uniformly and independently random, whereas the probability distributions for LLMs are conditional on the context and the model’s learned parameters. Additionally, all modern LLMs use top K and p sampling–which filters the probability distribution to only high confidence words–so the probability of it choosing to say random garbage is exactly zero.

The issues with LLMs have nothing to do with their sampling from random distributions. That’s just a minor part of their training, and some LLMs don’t even do random sampling since they use tree search. The issues with LLMs are the result of people trying to teach it intelligence using behavior cloning on a corpus of human words and images. Words can’t encode wisdom, only knowledge. Wisdom can only be gained through lived experience.

How well do you think you would perform if you were born into a cave, forced to read a thousand dictionaries in order with no context, and then your only interaction with the outside world was a single question from a single human, and then you died? If you ask me, the LLMs are doing suprisingly well given their “lived experiences”.

Is decomp.dev supposed to be down?

Pretty much daily, but I don’t have much control on what I hyperfocus on. Sometimes I get lucky and do all my work for the week in a sitting. Other times I spend the whole day writing a single email 😓

PSA: Don’t buy a gaming laptop. They are trash. The plastic case will melt, the wifi card will come loose, the battery will die within minutes. A steam deck is truly your best option.

And never ever buy alienware. Screw them in particular.

Really cool idea, but the site seems a bit biased for the chinese models, or is otherwise set up weird. I’m not able to reproduce how consistently bad the others are in web dev arena, which generally accepted as the gold standard for testing AI web dev ability.

that’s a massive oversimplification