To be truly evil, someone must have sought to do harm by planning to commit some morally wrong action with no prompting from others (whether this person successfully executes his or her plan is beside the point). The evil person must have tried to carry out this plan with the hope of “causing considerable harm to others,” Bringsjord says. Finally, “and most importantly,” he adds, if this evil person were willing to analyze his or her reasons for wanting to commit this morally wrong action, these reasons would either prove to be incoherent, or they would reveal that the evil person knew he or she was doing something wrong and regarded the harm caused as a good thing.
http://www.sciam.com/article.cfm?id=defining-evil
“I wouldn’t release E or anything like it, even in purely virtual environments, without engineered safeguards,” Bringsjord says. These safeguards would be a set of ethics written into the software, something akin to author Isaac Asimov’s “Three Laws of Robotics” that prevent a robot from harming humans, requires a robot to obey humans, and instructs a robot to protect itself—as long as that does not violate either or both of the first two laws.
“Because I have a lot of faith in this approach,” he says, “E will be controlled.”
And we read in Philip K. Dick’s novel how that worked out…