Multimedia videos comes in many different formats, and not all those formats are playable by Windows mediaplayer.
I personally recommend VLC Mediaplayer as a great addition if not substitute which will cater for most of your multimedia needs.
You can find the software on http://www.videolan.org/vlc/
You can also find a review of VLC on http://tinyurl.com/39svue