No.
The experience can take place without seeing the entities.
You can experience the change in temperature, the atmospheric changes and have a knowing that something is there without seeing them. To a large extent, it is the expectation of the entities that cause you to be on the lookout for them which happens if you’ve experienced sleep paralysis and the entities before.