2. A building on the site may only be removed if the Scottish Ministers have agreed to its removal in writing.