If it appears to the Secretary of State that the preservation of a building in a conservation area is important for maintaining the character or appearance of that area, he may direct that section 49 shall apply to it as it applies to listed buildings.