Beyond the Church of St Gregory (Gagik I) is a Seljuk palace built into the city's defensive walls – and so painstakingly over-restored that it looks quite out of place.