> Humans need to remain 100% accountable for their own actions
People undergoing psychotic delusions are definitionally not 100% culpable. If you say that people are 100% culpable despite mental state outside their control, I'd like to have you sign some things after you drink this scopolamine.
> it being the fault of a chat bot
It's contributory negligence. The chat bot could be designed to recognize psychotic delusions and urge the individual to seek help. Instead, it is negligently allows to reinforce those delusions.
People undergoing psychotic delusions are definitionally not 100% culpable. If you say that people are 100% culpable despite mental state outside their control, I'd like to have you sign some things after you drink this scopolamine.
> it being the fault of a chat bot
It's contributory negligence. The chat bot could be designed to recognize psychotic delusions and urge the individual to seek help. Instead, it is negligently allows to reinforce those delusions.