404 Error Template

I am having an issue when setting up custom error templates. While the right templates are being rendered for 400, 401 and 403, the 404 template is completely ignored.

This previous thread suggests that it should be possible. Is there something different that I should do for 404 errors?