Just wondering, why doesn't the google.com search engine index the vbforums.com site ?
You'd imagine thats a wealth of information that the google team would want access to...
Printable View
Just wondering, why doesn't the google.com search engine index the vbforums.com site ?
You'd imagine thats a wealth of information that the google team would want access to...
Google doesn't index dynamic URLs, i.e. ones with ? or & in the URL. There's a hack at vbulletin.org that fixes this, but it also takes up an obscene amount of bandwidth going through each thread and indexing it.
One would imagine that it would be a good idea to index stuff like this.
Well, I think it would anyway.
Yeah it would be, mainly for older threads though...
Why did it index my site then? I am using PHP and all my pages have ? in them.Quote:
Originally posted by filburt1
Google doesn't index dynamic URLs, i.e. ones with ? or & in the URL. There's a hack at vbulletin.org that fixes this, but it also takes up an obscene amount of bandwidth going through each thread and indexing it.
http://www.google.com/search?hl=en&i...UTF8&q=storurl
the first link points to
http://haztek.d2g.com/getpage.php?page=storurl
I'm just repeating what I heard at the vBulletin support forums...
Oh.
i think it doesn't index dynamic pages, pages that result due to a form submission etc..
also, prolly has to do with the "expires" http header - if the page is set to expire it won't be indexed.
vB3 should change all this.
Hey John! What's up? I haven't seen you on the boards in quite some time. Working on something big? ;) :D
Arg, you devs and your little blasted hints :pQuote:
Originally posted by John
vB3 should change all this.
Yeah, recall ya posting about that but that it requires Apache...what a shame that is, eh? :p
Heeyyyyy, we have a John!!! (Back from France already? (hint hint, nudge nudge, say no more! :p)Quote:
Originally posted by John
vB3 should change all this.
I popped over to France just after Easter, but I've been in England since then! Thank you very much! :p
oh yeah ;)Quote:
Originally posted by John
I popped over to France just after Easter, but I've been in England since then! Thank you very much! :p