Once that protective layer is removed, the color will bleach out from light exposure, while it will wear down faster because it isn’t as abrasion-resistant as the top coat. Primer is designed to adhere to the metal and provide a surface for the paint. If it’s exposed, it will draw in moisture, further accelerating paint damage.