Considerations for AI Product Acquisition
It’s a bit like buying a car (sort of).
A recent article in the Columbia Law Review entitled AI Systems as State Actors contained this stunning and important quote from authors Kate Crawford and Jason Schultz:
..When challenged, many state governments have disclaimed any knowledge or ability to understand, explain or remedy problems created by AI systems that they have procured from third parties. The general position has been ‘we cannot be responsible for something we don’t understand.’ This means that algorithmic systems are contributing to the process of government decision-making without any mechanisms of accountability or liability.
My first reaction to this quote was horror, but once I got a grip, my initial concerns were only slightly mollified. While the article was published in 2019, it nonetheless raises a valid and timely point: Where does liability fall when reliance on an AI-powered system causes harm? The short answer is “everywhere,” but that’s not really a useful answer.