As for whether it has a detrimental effect over the long term, the thing most quoted from surgeons is the importance of operating on a stenotic valve before the left ventricle enlarges too much and before the heart muscle "bulks up" too much. If either of these take effect, once the valve is replaced, the heart may not be able to remodel back to its normal size. This residual enlargement or muscle thickness may cause the heart to not be able to pump at normal efficiency, restricting the patient's abilities for the rest of their life.
This is why many members here favor the opinion that it is better to operate a little bit too early than to wait until too late.