gemini has been fraught with issues. couldn’t get it to show white people for a while, even if you were asking for vikings. but this particular exchange recently has stirred up some controversy
now a lot of times when you see something like this, it’s because someone is “breaking” the model with malicious prompts, or it’s otherwise not what they claim. but we have the log on this one https://gemini.google.com/share/6d141b742a13
i thought this case is remarkable because a lot of this kind of thing has thought to have been ironed out. and it’s not entirely clear to me why the model chose this response at that time. because they do make choices; they are not “random”