Prince Harry said royals goodbye in reaction to King Charles unexpected move