Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines there would then unquestionably be an 'intelligence explosion,' and the intelligence of man would be left far behind. They'd deliberately chosen this strategy because they had bought the intelligence explosion argument made by the British mathematician Irving Good back in 1965: "Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Although its cognitive abilities still lagged far behind those of humans in many areas, for example, social skills, the Omegas had pushed hard to make it extraordinary at one particular task: programming AI systems. The Al they had built, nicknamed Prometheus, kept getting more capable. But they were all in, 100%, for much the same reason that many of the world's top physicists joined the Manhattan Project to develop nuclear weapons: they were convinced that if they didn't do it first, someone less idealistic would. He reminded them that their plan was extremely dangerous, and that if powerful governments found out, they would do virtually anything-including kidnapping-to shut them down or, preferably, to steal their code. Their charismatic CEO had handpicked them not only for being brilliant researchers, but also for ambition, idealism and a strong commitment to helping humanity. What they didn't realize was that the Omegas had carefully crafted their image to hide a secret: they were extremely close to pulling off the most audacious plan in human history. They happily indulged them, however, because they liked the prestige that the cutting-edge work of the Omegas gave their company, and they also appreciated the improved algorithms that the Omegas occasionally gave them. Most other employees viewed "the Omegas," as they affectionately called them, as a bunch of pie-in-the-sky dreamers, perpetually decades away from their goal. Whereas the rest of the enterprise brought in the money to keep things going, by various commercial applications of narrow Al, the Omega Team pushed ahead in their quest for what had always been the CEO's dream: building general artificial intelligence. The Omega Team was the soul of the company.
0 kommentar(er)
