I think you've got it in one. As a horror film buff, the unknown is the scariest thing (ie. what your mind makes up) that has ever worked on me. Course, in film, I'd argue that the soundtrack also has a huge impact, but either way - I think you're right.