With the latest Windows Media Player should have no problem playing flv files, in case you can not then please install the ffdshow DirectShow codecs or the playflv plugin.

Note: if you get warnings when trying to play a flv file with Windows Media Player simply click OK and your video should start playing.