Meaning of this poem?

The poem is saying that the real ghosts that haunt us internally -- the fears, unhappy memories, etc. that live in our minds -- are far scarier than the imaginary spirits inhabiting haunted houses and other spooky places outside of us. "Host" in the final line means a large group.