Most versatile would be a HTPC. You can even get a housing that makes it looks like a VCR or some such box.
The others you mention do have their limitations (such as what media files you can play (not all are supported and some don't play well) and navigation can be clumsy to say the least.
All depends on what media file formats you want to use and if you want to do anything else. If it's just to listen to music, watch (popular) .avi format videos and look at JPGs, what you listed is fine. If not, look at a HTPC.