I think Elfman was freed from the Mind Control because he completed the orders given to me, which us to blow up Fairy Tale. No one died, but the building was destroyed which was close enough to break the geas.