Re: Amazon’s sexist AI
"Trouble is these days its career suicide to do any research that might be seen to produce sexist (or racist) results."
Except that....
"The irony of it all is that of course the machine learning has not a clue what black or white, male or female etc means, its just throwing out matches that reflect society as it really is. So if one considers this is a problem, then the need is to change society, not the AI."
More precisely, these AI "learning" algorithms are taught using data containing existing human biases and end up locking them in a "computer says no" way (where people accept the result unquestioningly, because "computers are never wrong".)
It doesn't matter that illegal drug use is the same among poor black and rich white people - with enforcement, prosecution and conviction rates all being biased against poor black people, the AI perpetuates that kind of enforcement.
What these AI results actually show is the inherent biases of what's feeding into them and therefore in this case the inherent biases of the existing selection processes used by HR dimwits.
Once you realise that all these AI stores are a result of "garbage in, garbage out", you also realise there's a lot more to these stories than initially meets the eye. It's all very well pointing and laughing at how the stupid computer is producing sexist/racist results but the harsh reality is that the stupid computer is merely doing exactly what is _already_ being done, just somewhat faster and without someone looking at things along the way, then saying "hmm, that seems a little _too_ biased, we'd better fudge things a bit so we don't get accused of rascism/sexism"
(IE: it's peeling off the veneer and exposing the ugly reality of the assumptions of the selection processes)