George Villiers, 4th Earl of Clarendon (1800–1870), Diplomat