AI won’t destroy the planet but it may cause problems

Written by on June 27, 2016 in Guest Blog with 0 Comments

Artificial intelligence concept illustrationWe hear a lot these days about artificial intelligence (AI) these days, but in the telecoms world, the term is thrown about rather casually, as though it’s simply a really advanced algorithm tool to make Siri more useful.

AI is typically discussed in the context of big data, the IoT and augmented/virtual reality apps. The upcoming ITU Telecom World in Bangkok, the Leadership Summit and Forum – which features a digital economy theme – lumps it in with other topics such as smart sustainable cities, the role of taxation in driving connectivity, fostering SMEs and digital financial services.

In the IT world, AI is taken more seriously – and treated with far more caution, albeit perhaps too much caution. Famously, Elon Musk once described it as “potentially more dangerous than nukes”, while people like Bill Gates, Stephen Hawking and Nick Bostrum have expressed concerns that AI poses serious dangers if it’s developed with no regard for the potential risks.

But when you look at the actual progress of AI, the risks are less about (say) Skynet declaring war on humanity and more about the practical realities of software agents or Roombas making decisions, and the ability of humans to correct wrong decisions – or even to teach machines when they’ve made bad decisions.

To that end, researchers from Google AI, Musk-led startup OpenAI, Stanford University and UC Berkeley have released a paper addressing the risks that are more grounded in the reality of how AI will be used in the coming years – such as smart cleaning robots.

Google Research’s Chris Olah explains in this blog post:

While possible safety risks have received a lot of public attention, most previous discussion has been very hypothetical and speculative. We believe it’s essential to ground concerns in real machine learning research, and to start developing practical approaches for engineering AI systems that operate safely and reliably.

The paper touches on five main problems that researchers should focus on, using the example of an AI-enabled cleaning robot:

  • Avoiding Negative Side Effects: How can we ensure that an AI system will not disturb its environment in negative ways while pursuing its goals, e.g. a cleaning robot knocking over a vase because it can clean faster by doing so?
  • Avoiding Reward Hacking: How can we avoid gaming of the reward function? For example, we don’t want this cleaning robot simply covering over messes with materials it can’t see through.
  • Scalable Oversight: How can we efficiently ensure that a given AI system respects aspects of the objective that are too expensive to be frequently evaluated during training? For example, if an AI system gets human feedback as it performs a task, it needs to use that feedback efficiently because asking too often would be annoying.
  • Safe Exploration: How do we ensure that an AI system doesn’t make exploratory moves with very negative repercussions? For example, maybe a cleaning robot should experiment with mopping strategies, but clearly it shouldn’t try putting a wet mop in an electrical outlet.
  • Robustness to Distributional Shift: How do we ensure that an AI system recognizes, and behaves robustly, when it’s in an environment very different from its training environment? For example, heuristics learned for a factory workfloor may not be safe enough for an office.

The paper is available here.

See also: this article from Wired, which offers some extra color on possible mishaps that won’t destroy the planet but would cause problems.

This article was first published on

Tags: , ,

About the Author

About the Author: John is editor of Disruptive.Asia and was previously managing editor at Telecom Asia. He has been covering the Asia-Pacific telecoms industry since 1996. He has two degrees in telecommunications and has worked for six years in the US radio industry in various technical and advisory capacities, covering radio and satellite equipment maintenance, studio networking, news writing and production, the latter of which earned him several regional and national awards. .


If you enjoyed this article, subscribe now to receive more just like it.

Subscribe via RSS Feed

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: