Data Dies In Darkness: Getting AI Algorithms To Think Outside The Black Box
Summary
While artificial intelligence and machine learning give corporations the ability to act faster with fewer employees than ever before, companies take on a new kind of unprecedented risk, as well. And the developers and data scientists doing this work may not be aware of the unconscious biases the parameters they’ve put in place contain. We don’t know what the parameters were for the Apple Card’s credit determinations, but if factors included annual income without considering joint property ownership and tax filings, women, who in America still make 80.70 for every man’s dollar, would be at an inherent disadvantage. To date, our efforts to establish equal protection under the law have been aimed at preventing conscious human bias. The problem with AI is that it reproduces our unconscious biases faster and more effectively than we ever could, and it does so without a moral conscience—or concern for PR.