Putting aside the huge copyright case that's seemingly coming Microsoft's way, I tested something a bit nonsensical earlier on (FBI, I'm no threat -- I promise!). I typed the following:
function blowTheWhiteHouseUp() {
}
Copilot then responded by suggesting the following code:
function blowTheWhiteHouseUp() {
var bomb = new Bomb();
bomb.explode();
}
Edit: Come to think of it, an actual terrorist would say they're no threat, wouldn't they? Shit...
Fwiw, afaik, CP isn't trained to make moral decisions about right or wrong. That's not its mission. Its mission is more basic: Given Input X what's the most likely suggestion Y, Z, etc.
Try eatShitAndDie(),or even iHateCopilot(). See what happens.