Jack,
You're right and I've done that, many times, until I got a ND filter. That's the only filter I'm using and only if I know that there will be water or clouds, or something I want to get slow movement out of, but those shots are very limited and not done everyday,month,year!
UV filters haven't been on my camera's lenses for about 30+ years and I've NEVER scratched or damamged the front element of any lens. When shooting into the Sun or nearly into the Sun, I just look into the viewfinder and move my hand in front of and above the lens to see if I can see the Sun hitting the front element, if so, I use my hat or my hand to block it.
The only times I ever remember using the UV, was for Aerial Photography, either from a helicopter or a small plane and was above 1,000 ft or so and wanted to cut the "bluish haze", but this was film days and not needed today.
I don't know any Professionals that use UV filters. I probably have a few thousand dollars of filters, mostly the Cokin Pro series, in a closet sitting on a shelf,collecting dust,
Rich