At Research magazine, I look at a dark scenario: "
Are Killer Robots the Next Black Swan?" Excerpt:
No less a scientific name than Stephen Hawking has been raising alarms about out-of-control AI. In a recent opinion piece, Hawking and several scientist co-authors warned: “One can imagine such technology outsmarting financial markets, out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand. Whereas the short-term impact of AI depends on who controls it, the long-term impact depends on whether it can be controlled at all.”
In an era of grandmaster-beating chess programs and driverless-car prototypes, it is no surprise that anxieties about where such technology is heading have gained traction. Nor is it a surprise that critics target the tech sector and the Pentagon (especially the Defense Advanced Research Projects Agency, DARPA) for working on increasingly powerful systems that may one day outsmart, outrank or outlive us all. (A UN meeting in Geneva in May convened experts to discuss emerging “lethal autonomous weapons.”)
What might be surprising is the idea that Wall Street could give rise to dangerous AI—not in the obvious sense that financial institutions raise capital for the tech sector, but in that financial technology itself might be the matrix for the rise of the machines. That is the gist of one emerging line of thinking about the dangers of smart computers.
Whole thing
here. Some related writing by me is
here.
