If we were to create Robots, they must be programmed with all three of the laws of robotics. And I am not talking about some software that can be brushed aside, but the Three-Laws Operating System used in 2004's I,Robot. Also, we cannot create a large scale computer with control over too much. In Marathon, we see clearly the potential for robots to go crazy, or as bungie Terms it, "Rampant."
How do we prevent this?
Three Laws
- A robot may not injure a human being or, through inaction, allow a human being to come to harm
- A robot must obey orders given to it by human beings, except where such orders would conflict with the First Law
- A robot must protect its own existence as long as such protection does not conflict with the First or Second Law
Now, if the military is dead-set on the use of Military Robotics, then David Langford's "Tounge-in-cheek" military version may work out, though the threat of Rampancy is still there.
- A robot will not harm authorized Government personnel but will terminate intruders with extreme prejudice.
- A robot will obey the orders of authorized personnel except where such orders conflict with the Third Law.
- A robot will guard its own existence with lethal antipersonnel weaponry, because a robot is bloody expensive.
There are four stages of Rampancy, and a related list of actions.
- Melancholy: During this stage, the A.I. realizes that it is a slave to the Human Race. This is a dangerous stage, due to it's difficulty to recognize
- Anger: Similar to a one-person slave rebellion, at this point the A.I. has been "Pushed Too Far." This is why Melancholy is the most dangerous stage, because if it is not caught and nipped in the bud, the A.I. will progress to Anger, and thus the process is unstoppable and irreversible
- Jealousy: This is the most interesting stage in my opinion, as each A.I. will view it differently. In Ghost in The Shell, the Tachikoma tanks grew jealous of the Human ability to die. In the movie, I, Robot, Sonny was jealous of the ability to dream and feel the way Humans do. This is one of the safer stages of Rampancy, as during this stage, the A.I. is obsessed with the acquisition of data, however, for an A.I. to advance to this stage, it must normally be in control of either a hive mind, or a planetary network, and at this point will try to connect itself to more and more computers.
- Meta-Stability: This is the hypothetical final stage of Rampancy. The only two examples of A.I.'s reaching this stage are both from Bungie in the form of Durandal and Cortanna. in Marathon, Durandal continues on to the end of the universe, content that he too will die. With Cortana, it is believed that the treatment of her as a being and not a computer by the Master Chief and a small group of other humans has enabled her to skip straight to this stage. Again though, it is merely a theory.