In Vista, Windows Explorer no longer shows thumbnails of HTML files. This functionality has simply been removed.
This little addon for Windows Explorer will show thumbnails for HTML, MHTL and URL files.

Screenshot

Install: run register.bat with admin rights, unregister.bat to uninstall
Last Update: 5 March, 2008