I am trying to find out how the spiders work when they encounter a page that has a SSI file included.

I assume that the complete page is resolved before the spiders do their work, but I have a nagging doubt that they may ignore the contents of the SSI ... or does it depend on the spider?

Does anyone have any hard facts on this topic.