The Queen was heard to say: "It'll will give us a chance to take some weight off his shoulders"