Yeah, my Apple Watch does this. You can also uninstall all the apps and disable all the notifications to make it dumb so it only plays music.

I know a few folks who bought the older models or the new Apple Watch SE solely for this purpose.

Is it more expensive than an iPod? Yup.

Does it work amazing when running? Also, yup.