You need to authorize the HTML Viewer to be able to view files.
It will also be installed to your drive.

Go to "Drive" -> "Manage Apps" and set HTML Viewer as default app for HTML files.