From 600+ conversations with the world’s leading thinkers.
For the first time as a species, we're truly in the dark about what's around the corner. In the past, the human brain could synthesize information and anticipate the future. But now, in an era where computational intelligence dominates innovation, no human can accurately forecast what lies ahead.
After each strike the drone would be updated with information about the actual destruction caused. If it did more damage than expected, then it could use this information to restrict its choice of weapon in future engagements.
We haven't really had a technology like AI in the history of technological development – the closest analogy would be the movable type printing press, which came to the fore at the beginning of the enlightenment, some five hundred years ago.
These are technologies that are autonomous in many, many ways. They are independent in many, many ways – they have free will. They can replicate. And that makes a difference because then we teach them how to learn, but we have no idea what they will do with that ability to learn and develop intelligence.
If our future is to count as a utopia, we cannot allow a massive oppressed class of hyper-sentient, uncomfortable digital beings. We want it to be good for all kinds of minds.
We cannot think about technology in confrontational terms. There is no race against the machines, there is no fight, no war. We have to end this long, historical confrontational narrative.
In the past, the human brain could synthesize information and anticipate the future. But now, in an era where computational intelligence dominates innovation, no human can accurately forecast what lies ahead. For the first time as a species, we're truly in the dark about what's around the corner.
If you tried to achieve that purely through informal methods—where hallucination is a persistent risk—getting to the same level of consistent correctness would likely require a lot more research effort and resources.
There's a delicate balance between making sure our values are encoded in these technologies as they come out- and not constraining them so much that we lose the technological race to other nations who don't hold our values.
At some point, if this kind of technological progress continues, it would seem that our descendants will become entirely digital: uploads or artificial intellects implemented on computers.
We're not really creating a specific artefact—we're setting a direction for a process. There's no upper limit to that process; we're simply saying we'll create something capable of becoming smarter and smarter.
After each strike the drone would be updated with information about the actual destruction caused. It would note any damage to nearby buildings and would subsequently receive information from other sources, such as soldiers in the area, fixed cameras on the ground and other aircraft. Using this information, it could compare the level of destruction it expected with what actually happened.