

https://en.m.wikipedia.org/wiki/Hannibal_Directive
Israeli newspapers including Haaretz, ABC News and the UN’s Commission of Inquiry have pointed out that during the October 7 attacks the IDF ordered the Hannibal Directive to be used. The IDF was ordered to prevent “at all costs” the abduction of Israeli civilians or soldiers, possibly leading to the death of a large number of Israeli hostages.[6][7][8][9]
I’m not nervous about LLMs in that regard. I think sentience will have to be a biological phenomenon. I think people who were hopeful that consciousness happens spontaneously with enough processing power were wrong. Currently we can clone biological things quite well but we haven’t managed to give something the spark of life without biological input.
I also think humans are more than happy to anthropomorphize everything. There’s the famous example of telling someone the name of a pencil then snapping it in half. This makes me worried that people will be more than willing to treat LLMs as conscious regardless of their lack of mind.