Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an ‘intelligence explosion,’ and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make.
When discussing complex systems like brains and other societies, it is easy to oversimplify: I call this Occam’s lobotomy.
The older we become, the more important it is to use what we know rather
than learn more.
The subjectivist states his judgements, whereas the objectivist sweeps them under the carpet by calling assumptions knowledge, and he basks in the glorious objectivity of science.
There may be occasions when it is best to behave irrationally, but whether there are should be decided rationally.