Parts of Crown Hotel site set to be demolished