No. You would use a base model (GPT-4o) to get a reliable language model to which you would add a set of rules that the chat bot follows. Every company has its own rules, it is already widely in use to add data like company-specific manuals and support documents. Not rocketscience at all.
Instead of ‘express concern’, we would like to see ‘condemns the attack’. Similar to their reaction of the Iran attacks on Israel on October 1st, 2024
They are all hiding their faces. They know damn well they will be put for a Nuremberg tribunal one day.
This attempts to explain it: https://www.youtube.com/watch?v=2VWq3cX_4Wg
He has a problem: he can not finish the job as long as Iran and Israel stick to the ceasefire.
Sure, it can go wrong, it is not fool-proof. Just like building a new model can cause unwanted surprises.
BTW. There are many theories about Grok’s unethical behavior but this one is new to me. The reasons I was familiar with are: unfiltered training data, no ethical output restrictions, programming errors or incorrect system maintenance, strategic errors (Elon!), publishing before proper testing.