Making superintelligent A.I. is a really hard challenge.

创造出一个超级智慧体确实是个很大挑战。

Could you two really have some sort of superintelligent child?

你俩真会生出那种智商超群吗?

So imagine we hit upon a design of superintelligent AI that has no safety concerns.

想象我们正好做出了一个没有任何安全隐患超级人工智能。

I bet there are those of you who doubt that superintelligent AI is possible, much less inevitable.

我打赌你们中有些人还会怀疑超级人工智能是否可能实现，认为我是在小题大做。

Right? So imagine if we just built a superintelligent AI that was no smarter than your average team of researchers at Stanford or MIT.

那么，现在让我们来想象一下我们刚建好一个超级人工智能机器，大概和斯坦福或是麻省理工学院研究员平均水平差不多吧。

The point here is that we should not be confident in our ability to keep a superintelligent genie locked up in its bottle forever.

所以我们不能 对我们能够永远控制一个超级智能体能力 表示过度自信。

Maybe a single, superintelligent civilization has indeed taken over the galaxy and has imposed strict radio silence because it's paranoid of any potential competitors.

可能一个非常有智能文明已经占领了整个银河系，并且故意把辐射波屏蔽了，因为它们害怕潜在竞争对手。

A superintelligent AI is by definition very good at attaining its goals, so the most important thing for us to do is to ensure that its goals are aligned with ours.

超级智能很善于完成它目标，所以对我们来说，最重要是确保它目标和我们一致。

The deeper problem is that building superintelligent AI on its own seems likely to be easier than building superintelligent AI and having the completed neuroscience that allows us to seamlessly integrate our minds with it.

仅仅制造出超级人工智能机器可能要比既制造超级人工智能，又让其拥有能让我们思想和超级人工智能无缝对接完整神经科学系统要简单很多。