Robot Visions - Robot Visions Part 21
Library

Robot Visions Part 21

"My dear Byerley, I see that you instinctively follow that great error - that the Machine knows all. Let me cite you a case from my personal experience. The cotton industry engages experienced buyers who purchase cotton. Their procedure is to pull a tuft of cotton out of a random bale of a lot. They will look at that tuft and feel it, tease it out, listen to the crackling perhaps as they do so, touch it with their tongue, and through this procedure they will determine the class of cotton the bales represent. There are about a dozen such classes. As a result of their decisions, purchases are made at certain prices; blends are made in certain proportions. - Now these buyers cannot yet be replaced by the Machine."

"Why not? Surely the data involved is not too complicated for it?"

"Probably not. But what data is this you refer to? No textile chemist knows exactly what it is that the buyer tests when he feels a tuft of cotton. Presumably there's the average length of the threads, their feel, the extent and nature of their slickness, the way they hang together, and so on. - Several dozen items, subconsciously weighed, out of years of experience. But the quantitative nature of these tests is not known; maybe even the very nature of some of them is not known. So we have nothing to feed the Machine. Nor can the buyers explain their own judgment. They can only say, 'Well, look at it. Can't you tell it's class-such-and-such?' "

"I see."

"There are innumerable cases like that. The Machine is only a tool after all, which can help humanity progress faster by taking some of the burdens of calculations and interpretations off its back. The task of the human brain remains what it has always been, that of discovering new data to be analyzed, and of devising new concepts to be tested. A pity the Society for Humanity won't understand that."

"They are against the Machine?"

"They would be against mathematics or against the art of writing if they had lived at the appropriate time. These reactionaries of the Society claim the Machine robs man of his soul. I notice that capable men are still at a premium in our society; we still need the man who is intelligent enough to think of the proper questions to ask. Perhaps if we could find enough of such, these dislocations you worry about, Coordinator, wouldn't occur."

Earth (Including the uninhabited continent, Antarctica) a. Area: 54,000,000 square miles (land surface) b. Population: 3,300,000,000 c. Capital: New York The fire behind the quartz was weary now, and sputtered its reluctant way to death.

The Co-ordinator was somber, his mood matching the sinking flame.

"They all minimize the state of affairs." His voice was low. "Is it not easy to imagine that they all laugh at me? And yet Vincent Silver said the Machines cannot be out of order, and I must believe him. Hiram Mackenzie says they cannot be fed false data, and I must believe him. But the Machines are going wrong, somehow, and I must believe that, too; and so there is still an alternative left."

He glanced sidewise at Susan Calvin, who, with closed eyes, for a moment seemed asleep.

"What is that?" she asked, prompt to her cue, nevertheless.

"Why, that correct data is indeed given, and correct answers are indeed received, but that they are then ignored. There is no way the Machine can enforce obedience to its dictates."

"Madame Szegeczowska hinted as much, with reference to Northerners in general, it seems to me."

"So she did."

"And what purpose is served by disobeying the Machine? Let's consider motivations."

"It's obvious to me, and should be to you. It is a matter of rocking the boat, deliberately. There can be no serious conflicts on Earth, in which one group or another can seize more power than it has for what it thinks is its own good despite the harm to Mankind as a whole, while the Machines rule. If popular faith in the Machines can be destroyed to the point where they are abandoned, it will be the law of the jungle again. - And not one of the four Regions can be freed of the suspicion of wanting just that.

"The East has half of humanity within its borders, and the Tropics more than half of Earth's resources. Each can feel itself the natural rulers of all Earth, and each has a history of humiliation by the North, for which it can be human enough to wish a senseless revenge. Europe has a tradition of greatness, on the other hand. It once did rule the Earth, and there is nothing so eternally adhesive as the memory of power.

"Yet, in another way, it's hard to believe. Both the East and the Tropics are in a state of enormous expansion within their own borders. Both are climbing incredibly. They cannot have the spare energy for military adventures. And Europe can have nothing but its dreams. It is a cipher, militarily."

"So, Stephen," said Susan, "you leave the North."

"Yes," said Byerley, energetically, "I do. The North is now the strongest, and has been for nearly a century, or its component parts have been. But it is losing relatively, now. The Tropic Regions may take their place in the forefront of civilization for the first time since the Pharaohs, and there are Northerners who fear that.

"The 'Society for Humanity' is a Northern organization, primarily, you know, and they make no secret of not wanting the Machines. - Susan, they are few in numbers, but it is an association of powerful men. Heads of factories; directors of industries and agricultural combines who hate to be what they call 'the Machine's office-boy' belong to it. Men with ambition belong to it. Men who feel themselves strong enough to decide for themselves what is best for themselves, and not just to be told what is best for others."

"In short, just those men who, by together refusing to accept the decisions of the Machine, can, in a short time, turn the world topsy-turvy; just those belong to the Society.

"Susan, it hangs together. Five of the Directors of World Steel are members, and World Steel suffers from overproduction. Consolidated Cinnabar, which mined mercury at Almaden, was a Northern concern. Its books are still being investigated, but one, at least, of the men concerned was a member. Francisco Villafranca, who, single-handed, delayed the Mexican Canal for two months, was a member, we know already - and so was Rama Vrasayana, I was not at all surprised to find out."

Susan said, quietly, "These men, I might point out, have all done badly"

"But naturally," interjected Byerley. "To disobey the Machine's analyses is to follow a non-optimal path. Results are poorer than they might be. It's the price they pay. They will have it rough now but in the confusion that will eventually follow"

"Just what do you plan doing, Stephen?"

"There is obviously no time to lose. I am going to have the Society outlawed, every member removed from any responsible post. And all executive and technical positions, henceforward, can be filled only by applicants signing a non-Society oath. It will mean a certain surrender of basic civil liberties, but I am sure the Congress"

"It won't work!"

"What! - Why not?"

"I will make a prediction. If you try any such thing, you will find yourself hampered at every turn. You will find it impossible to carry out. You will find your every move in that direction will result in trouble."

Byerley was taken aback, "Why do you say that? I was rather hoping for your approval in this matter."

"You can't have it as long as your actions are based on a false premise. You admit the Machine can't be wrong, and can't be fed wrong data. I will now show you that it cannot be disobeyed, either, as you think is being done by the Society."

"That I don't see at all."

"Then listen. Every action by any executive which does not follow the exact directions of the Machine he is working with becomes part of the data for the next problem. The Machine, therefore, knows that the executive has a certain tendency to disobey. He can incorporate that tendency into that data, - even quantitatively, that is, judging exactly how much and in what direction disobedience would occur. Its next answers would be just sufficiently biased so that after the executive concerned disobeyed, he would have automatically corrected those answers to optimal directions. The Machine knows, Stephen!"

"You can't be sure of all this. You are guessing."

"It is a guess based on a lifetime's experience with robots. You had better rely on such a guess, Stephen."

"But then what is left? The Machines themselves are correct and the premises they work on are correct. That we have agreed upon. Now you say that it cannot be disobeyed. Then what is wrong?"

"You have answered yourself. Nothing is wrong! Think about the Machines for a while, Stephen. They are robots, and they follow the First Law. But the Machines work not for any single human being, but for all humanity, so that the First Law becomes: 'No Machine may harm humanity; or, through inaction, allow humanity to come to harm.'

"Very well, then, Stephen, what harms humanity? Economic dislocations most of all, from whatever cause. Wouldn't you say so?"

"I would."

"And what is most likely in the future to cause economic dislocations? Answer that, Stephen."

"I should say," replied Byerley, unwillingly, "the destruction of the Machines."

"And so should I say, and so should the Machines say. Their first care, therefore, is to preserve themselves, for us. And so they are quietly taking care of the only elements left that threaten them. It is not the 'Society for Humanity' which is shaking the boat so that the Machines may be destroyed. You have been looking at the reverse of the picture. Say rather that the Machine is shaking the boat-very slightly-just enough to shake loose those few which cling to the side for purposes the Machines consider harmful to Humanity.

"So Vrasayana loses his factory and gets another job where he can do no harm - he is not badly hurt, he is not rendered incapable of earning a living, for the Machine cannot harm a human being more than minimally, and that only to save a greater number. Consolidated Cinnabar loses control at Almaden. Villafranca is no longer a civil engineer in charge of an important project. And the directors of World Steel are losing their grip on the industry - or will."

"But you don't really know all this," insisted Byerley, distractedly. "How can we possibly take a chance on your being right?"

"You must. Do you remember the Machine's own statement when you presented the problem to him? It was: 'The matter admits of no explanation.' The Machine did not say there was no explanation, or that it could determine no explanation. It simply was not going to admit any explanation. In other words, it would be harmful to humanity to have the explanation known, and that's why we can only guess - and keep on guessing."

"But how can the explanation do us harm? Assume that you are right, Susan."

"Why, Stephen, if I am right, it means that the Machine is conducting our future for us not only simply in direct answer to our direct questions, but in general answer to the world situation and to human psychology as a whole. And to know that may make us unhappy and may hurt our pride. The Machine cannot, must not, make us unhappy.

"Stephen, how do we know what the ultimate good of Humanity will entail? We haven't at our disposal the infinite factors that the Machine has at its! Perhaps, to give you a not unfamiliar example, our entire technical civilization has created more unhappiness and misery than it has removed. Perhaps an agrarian or pastoral civilization, with less culture and less people would be better. If so, the Machines must move in that direction, preferably without telling us, since in our ignorant prejudices we only know that what we are used to, is good - and we would then fight change. Or perhaps a complete urbanization, or a completely caste-ridden society, or complete anarchy, is the answer. We don't know. Only the Machines know, and they are going there and taking us with them."

"But you are telling me, Susan, that the 'Society for Humanity' is right; and that Mankind has lost its own say in its future."

"It never had any, really. It was always at the mercy of economic and sociological forces it did not understand - at the whims of climate, and the fortunes of war. Now the Machines understand them; and no one can stop them, since the Machines will deal with them as they are dealing with the Society, - having, as they do, the greatest of weapons at their disposal, the absolute control of our economy."

"How horrible!"

"Perhaps how wonderful! Think, that for all time, all conflicts are finally evitable. Only the Machines, from now on, are inevitable!"

And the fire behind the quartz went out and only a curl of smoke was left to indicate its place.

Feminine Intuition

For the first time in the history of United States Robots and Mechanical Men Corporation, a robot had been destroyed through accident on Earth itself.

No one was to blame. The air vehicle had been demolished in mid-air and an unbelieving investigating committee was wondering whether they really dared announce the evidence that it had been hit by a meteorite. Nothing else could have been fast enough to prevent automatic avoidance; nothing else could have done the damage short of a nuclear blast and that was out of the question.

Tie that in with a report of a flash in the night sky just before the vehicle had exploded-and from Flagstaff Observatory, not from an amateur-and the location of a sizable and distinctly meteoric bit of iron freshly gouged into the ground a mile from the site and what other conclusion could be arrived at?

Still, nothing like that had ever happened before and calculations of the odds against it yielded monstrous figures. Yet even colossal improbabilities can happen sometimes.

At the offices of United States Robots, the hows and whys of it were secondary. The real point was that a robot had been destroyed.

That, in itself, was distressing.

The fact that JN-5 had been a prototype, the first, after four earlier attempts, to have been placed in the field, was even more distressing.

The fact that JN-5 was a radically new type of robot, quite different from anything ever built before, was abysmally distressing.

The fact that JN-5 had apparently accomplished something before its destruction that was incalculably important and that that accomplishment might now be forever gone, placed the distress utterly beyond words.

It seemed scarcely worth mentioning that, along with the robot, the Chief Robopsychologist of United States Robots had also died.

Clinton Madarian had joined the firm ten years before. For five of those years, he had worked uncomplainingly under the grumpy supervision of Susan Calvin.

Madarian's brilliance was quite obvious and Susan Calvin had quietly promoted him over the heads of older men. She wouldn't, in any case, have deigned to give her reasons for this to Research Director Peter Bogert, but as it happened, no reasons were needed. Or, rather, they were obvious.

Madarian was utterly the reverse of the renowned Dr. Calvin in several very noticeable ways. He was not quite as overweight as his distinct double chin made him appear to be, but even so he was overpowering in his presence, where Susan had gone nearly unnoticed. Madarian's massive face, his shock of glistening red-brown hair, his ruddy complexion and booming voice, his loud laugh, and most of all, his irrepressible self-confidence and his eager way of announcing his successes, made everyone else in the room feel there was a shortage of space.

When Susan Calvin finally retired (refusing, in advance, any cooperation with respect to any testimonial dinner that might be planned in her honor, with so firm a manner that no announcement of the retirement was even made to the news services) Madarian took her place.

He had been in his new post exactly one day when he initiated the JN project.

It had meant the largest commitment of funds to one project that United States Robots had ever had to weigh, but that was something which Madarian dismissed with a genial wave of the hand.

"Worth every penny of it, Peter," he said. "And I expect you to convince the Board of Directors of that."

"Give me reasons," said Bogert, wondering if Madarian would. Susan Calvin had never given reasons.

But Madarian said, "Sure," and settled himself easily into the large armchair in the Director's office.

Bogert watched the other with something that was almost awe. His own once-black hair was almost white now and within the decade he would follow Susan into retirement. That would mean the end of the original team that had built United States Robots into a globe-girdling firm that was a rival of the national governments in complexity and importance. Somehow neither he nor those who had gone before him ever quite grasped the enormous expansion of the firm.

But this was a new generation. The new men were at ease with the Colossus" They lacked the touch of wonder that would have them tiptoeing in disbelief. So they moved ahead, and that was good.

Madarian said, "I propose to begin the construction of robots without constraint."

"Without the Three Laws? Surely-"

"No, Peter. Are those the only constraints you can think of? Hell, you contributed to the design of the early positronic brains. Do I have to tell you that, quite aside from the Three Laws, there isn't a pathway in those brains that isn't carefully designed and fixed? We have robots planned for specific tasks, implanted with specific abilities."

"And you propose-"

"That at every level below the Three Laws, the paths be made open-ended. It's not difficult."

Bogert said dryly, "It's not difficult, indeed. Useless things are never difficult. The difficult thing is fixing the paths and making the robot useful."

"But why is that difficult? Fixing the paths requires a great deal of effort because the Principle of Uncertainty is important in particles the mass of positrons and the uncertainty effect must be minimized. Yet why must it? If we arrange to have the Principle just sufficiently prominent to allow the crossing of paths unpredictably-"

"We have an unpredictable robot."

"We have a creative robot," said Madarian, with a trace of impatience. "Peter, if there's anything a human brain has that a robotic brain has never had, it's the trace of unpredictability that comes from the effects of uncertainty at the subatomic level. I admit that this effect has never been demonstrated experimentally within the nervous system, but without that the human brain is not superior to the robotic brain in principle."

"And you think that if you introduce the effect into the robotic brain, the human brain will become not superior to the robotic brain in principle."

"That, " said Madarian, "is exactly what I believe." They went on for a long time after that.

The Board of Directors clearly had no intention of being easily convinced.

Scott Robertson, the largest shareholder in the firm, said, "It's hard enough to manage the robot industry as it is, with public hostility to robots forever on the verge of breaking out into the open. If the public gets the idea that robots will be uncontrolled...Oh, don't tell me about the Three Laws. The average man won't believe the Three Laws will protect him if he as much as hears the word 'uncontrolled.' "

"Then don't use it, " said Madarian. "Call the robot-call it 'intuitive.' "

"An intuitive robot, " someone muttered. "A girl robot?" A smile made its way about the conference table.

Madarian seized on that. "All right. A girl robot. Our robots are sexless, of course, and so will this one be, but we always act as though they're males. We give them male pet names and call them he and him. Now this one, if we consider the nature of the mathematical structuring of the brain which I have proposed, would fall into the JN-coordinate system. The first robot would be JN-1, and I've assumed that it would be called John-10....I'm afraid that is the level of originality of the average roboticist. But why not call it Jane-1, damn it? If the public has to be let in on what we're doing, we're constructing a feminine robot with intuition."

Robertson shook his head, "What difference would that make? What you're saying is that you plan to remove the last barrier which, in principle, keeps the robotic brain inferior to the human brain. What do you suppose the public reaction will be to that?"

"Do you plan to make that public?" said Madarian. He thought a bit and then said, "Look. One thing the general public believes is that women are not as intelligent as men."

There was an instant apprehensive look on the face of more than one man at the table and a quick look up and down as though Susan Calvin were still in her accustomed seat.

Madarian said, "If we announce a female robot, it doesn't matter what she is. The public will automatically assume she is mentally backward. We just publicize the robot as Jane-1 and we don't have to say another word. We're safe."

"Actually," said Peter Bogert quietly, "there's more to it than that. Madarian and I have gone over the mathematics carefully and the JN series, whether John or Jane, would be quite safe. They would be less complex and intellectually capable, in an orthodox sense, than many another series we have designed and constructed. There would only be the one added factor of, well, let's get into the habit of calling it 'intuition.' "