Controversial quarry project will go ahead