The US government once ran a simulation where they rewarded an AI for destroying enemies, but it began destroying anything because it would get rewarded. In the simulation, the colonel in charge of the AI told it to stop, so it destroyed the colonel because he was halting its progress. Afterwards, they made a radio tower tell it to stop destroying everything, so they destroyed the radio tower and the government shut down the simulation.
