It will specifically talk in a context where the human cannot tell if it’s hallucinating or not.

LLMs are always hallucinating. That’s how they function. It pulls something that’s probably coherent from literal random noise and techbros pretend it was “thinking”, then when the result is something undesirable, they act like it made a “mistake”. Don’t buy into their bullshit.