Chapter 647: : When AI is smarter than humans...]

A genius remembers "Love♂Go ÷ Xiao?Speak→Net" in one second, and provide you with wonderful novel reading.
...
"The most common answer is science and technology. This is indeed correct. Science and technology are the great achievements accumulated in our human history."
"The current technological development is very rapid. This is the direct reason. This is why we humans are so productive now, but we want to explore the ultimate reason in the future."
"There is a gap of 250,000 generations between us and our ancestors. During this period, we went from picking up rocks on the ground as weapons to using atomic energy to create destructive super bombs. Now we know that such a complicated mechanism takes a long time to evolve. Obtained, these huge changes depend on the small changes in the human brain. The brains of chimpanzees and humans are not very different, but humans have won. We are outside and they are in the zoo!"
"Therefore, I came to the conclusion that in the future, any significant changes in the thinking matrix will have a huge difference in results."
Ren Hong took a sip of water, then paused and continued:
"Some of my colleagues think that we or humans will soon invent technology that can completely change the human mindset, that is, super artificial intelligence, or super AI or super intelligence."
"The artificial intelligence that we humans now grasp is to put a certain instruction into a box. In this process, we need programmers to convert knowledge into runnable programs. For this purpose, we will establish a professional system, PHP , C++ and other computer languages."
"They are very blunt, you can't extend their function, basically you can only get what you put in, nothing more."
"Although today our artificial intelligence technology is developing rapidly and becoming more mature, it still hasn't achieved the same ability as humans, with a strong cross-domain compound comprehensive nature of learning."
"So we are now facing a question: How long will it take for humans to have this powerful ability for artificial intelligence?"
"Matrix Technology has also conducted a questionnaire survey of the world's top artificial intelligence experts to collect their opinions. One of the questions is: In which year do you think humans will create artificial intelligence that reaches the human level?"
"We define the artificial intelligence in this questionnaire as the ability to complete any task as well as an adult. An adult will be good at different tasks, etc., so that the ability of the artificial intelligence will no longer be only Limited to a single field."
"The middle number of the answer to this question is now, the middle of the 21st century. It seems that it will take some time now, and no one knows the exact time, but I think it should be soon."
"...We know that the signal transmission speed of neurons in axons is up to 100 meters per second, but in computers, the signals travel at the speed of light. In addition to the size limit, the human brain is only the size of the head. You can’t expand it twice, but the computer can be expanded many times. It can be as big as a box, a room, or even a building. This point can never be ignored.

"So super AI may be lurking in it, just like atomic energy lurking in history until it was awakened in 1945."
"In this century, humans may awaken the wisdom of super AI, and we will see a big explosion of wisdom. When people are thinking about what is smart and what is stupid, especially when we talk about power rights."
"For example, chimpanzees are very strong, and the same size is equivalent to two healthy men. However, the key between the two depends more on what humans can do, rather than what chimpanzees can do."
"So, when the super AI appears, the fate of mankind may depend on what this super intelligence wants to do."
"Imagine that super intelligence may be the last invention that humans need to create. Super intelligence is smarter than humans and better at creating than we are. It will also do so in a very short time, which means it will be a shortened one. future."
"Imagine all the crazy technology we have ever imagined, maybe humans can complete and realize it within a certain period of time, such as ending aging, immortality, colonization of the universe..."
"Such elements that seem to exist only in the science fiction world but at the same time conform to the laws of physics. Super intelligence has a way to develop these things and is faster and more efficient than humans. We humans need 1,000 years to complete an invention. Super AI may It only takes an hour, or even less, this is the shortened future."
"If there is a super intelligent body with such a mature technology now, its power will be unimaginable for humans. Normally it can get anything it wants. The future of our humanity will be dictated by the preferences of this super AI. dominate."
"Then the question is, what is its preference?"
"This issue is very difficult and serious. To make progress in this field, for example, there is a way to think that we must avoid personalizing super AI, blocking or sparse, there is a taste of different opinions."
"This question is ironic, because every news report or topic related to the future of artificial intelligence, including our ongoing topics, may be posted on the Hollywood science fiction movie "Terminator" in the news tomorrow. Labels, robots against humans (shrugs and laughs)."
"So, I personally think that we should use a more abstract way to express this problem, rather than the narrative of Hollywood movies, robots stand up against humans, wars, etc., this is too one-sided. [Love ↑ go to △ small ↓ said △ net WwW.AiQu】"
"We should think of super AI abstractly as an optimization process, a process like the optimization of programs by programmers."
"Super AI or super intelligence is a very powerful optimization process. It is very good at using resources to achieve the ultimate goal. This means that there is no necessary connection between having high intelligence and having a useful goal for humans. "
"If you don’t understand this sentence well, let’s give a few examples: If the task we assign to artificial intelligence is to make people laugh, our current home machine assistants and other robots may perform funny and funny performances. Typical behavior of weak artificial intelligence."
"And when the artificial intelligence assigned to this task is a super intelligent body, super AI, it will realize that there is a better way to achieve this effect or complete the task: it may control the world, and in all humans Inserting electrodes into facial muscles makes humans laugh constantly."
"For another example, the task of this super AI is to protect the safety of the owner, so it will choose a better method. It will imprison the owner at home and prevent it from going out to better protect the owner's safety. There may still be danger at home. Yes, it will also consider various factors that may threaten and cause mission failure, and erase them one by one, eliminate all factors that are malicious to the owner, and even control the world. All these actions are for the mission not to fail. , It will achieve the most extreme optimal choice and put into action to achieve the goal of task completion."
"For another example, suppose we give this super AI the task goal is to solve an extremely difficult mathematical problem, it will realize that there is a more effective way to complete the task goal, that is, the entire world, the entire earth, and even more exaggerated scales. Become a supercomputer, so that its computing power will be more powerful, and it will be easier to complete the task. And it will realize that this method will not be recognized by us, humans will stop it, and humans are in this mode. Potential threats. For this reason, it will solve all obstacles for the ultimate goal, including humans, and any affairs, such as planning some sub-level plans to eliminate humans."
"Of course, these are exaggerated descriptions. We can't go wrong with this kind of thing, but the main point represented by the above three exaggerated examples is very important, that is: if you create a very powerful optimization Program to achieve the maximum goal, you must ensure that your goals in your sense and everything you care about are accurate. If you create a powerful optimization process and give it a wrong or inaccurate goal, The consequences may be like the example above."
"Someone might say that if a'computer' starts to insert electrodes on the face, we can turn off the computer. In fact, this is definitely not an easy task. If we rely on this system, such as Internet, do you know where the switch of the Internet is?"
"So there must be a reason. We humans are smart. We can meet threats and try to avoid them. For the same reason, let alone super AI that is smarter than us, it will only do better than us."
"On this issue, we should not be confident that we can control everything."
"Then simplistic expression of this problem, for example, we put artificial intelligence into a small box to create an insurance software environment, such as a virtual reality simulator that it cannot escape."
"But, we really have full confidence and grasp that it is impossible to find a loophole, a loophole that can allow him to escape?"
"Even we human hackers can find network vulnerabilities all the time."
"I might say that I am not very confident that Super AI will find loopholes and escape. So we decided to disconnect from the Internet to create a gap insulation, but I have to repeat that human hackers can socialize again and again. The project spans this gap."
"For example, when I am talking now, I am sure that an employee here asks him to surrender his account details at a certain time. The reason is to the person in the computer information department. It can also be other examples. If you It is this artificial intelligence, you can imagine using electrodes wrapped around your body to create a radio wave to communicate."
"Or you can pretend that something went wrong. At this time, programmers will open you to see what went wrong, they will find the source code, and in the process you can gain control. Or you can plan Draw out a very attractive blueprint for science and technology. When we realize it, there will be some secret side effects that you have planned as artificial intelligence to achieve your obscure purposes. There are countless examples."
"Therefore, any attempt to control a super AI is extremely ridiculous. We cannot express overconfidence that we can control a super intelligence forever. It will break free of control one day, and after that, it Will he be a benevolent god?"
"I personally think that the realization of artificial intelligence personification is an inevitable problem, so I think we need to understand a little bit more, that is, if we create a super AI, even if it is not restricted by us. It should still be nothing to us. It should be on our side, and it should have the same values ​​as ours."
"So are you optimistic that this problem can be solved effectively?"
"We don’t need to write down all the things we care about for super AI, or even turn these things into computer language, because this is a task that will never be completed. Instead, the artificial intelligence we created uses its own wisdom Learning our values ​​can inspire it to pursue our values, or to do things we would agree with, to solve valuable problems."
"This is not impossible, but possible. The result can benefit humans a lot, but it will not happen automatically. Its values ​​need to be guided."
"The initial conditions of the big bang of wisdom need to be correctly established from the most primitive stage of values."
"If we want everything not to be deviated from our expectations, the values ​​of artificial intelligence and our values ​​complement each other not only in familiar situations, such as when we can easily check its behavior, but also in all artificial In the unprecedented situation that intelligence may encounter, in the future without boundaries, our values ​​are still complementary, and there are many esoteric problems that need to be solved: such as how it makes decisions, how to solve logical uncertainties and many similar problems ."
"This task seems a bit difficult, but it's not as difficult as creating a super intelligent body, is it?"
"It is indeed quite difficult (the laughter spread throughout the audience again)!"
"What we are worried about ~EbookFREE.me~ If creating a super AI is indeed a big challenge, creating a safe super AI is a bigger challenge. The risk is that if the first problem is solved, There is no way to solve the second problem of ensuring safety, so I think we should come up with a solution that does not deviate from our values ​​so that we can use it when we need it."
"Now, maybe we can't solve the second security problem, because there are some factors that you need to understand, and you need to apply the details of the actual architecture to effectively implement it."
"If we can solve this problem, when we enter the real super-intelligence era, it will be more smoothly. This is something very worth trying for us."
"And I can imagine that if all goes well, hundreds, thousands or millions of years later when our descendants look back on our century, they might say that our ancestors, our generation, have done the most The important thing is to make the most correct decision."
"Thank you!"
………(To be continued.) Mobile users, please browse and read for a better reading experience.