Put a proper multimeter on the battery. If you're charging any more than ~14 - 14.5V, then you could damage sensitive components.
Personally, I am partial to having alternators and starters rebuilt instead of replacing. In my town, there are a few "old school" rebuild shops that actually take...