PDA

Click to See Complete Forum and Search --> : Why doesn't google index vbforums.com ?

plenderj
May 29th, 2002, 09:46 AM
Just wondering, why doesn't the google.com search engine index the vbforums.com site ?
You'd imagine thats a wealth of information that the google team would want access to...
filburt1
May 29th, 2002, 10:00 AM
Google doesn't index dynamic URLs, i.e. ones with ? or & in the URL. There's a hack at vbulletin.org that fixes this, but it also takes up an obscene amount of bandwidth going through each thread and indexing it.
plenderj
May 29th, 2002, 10:03 AM
One would imagine that it would be a good idea to index stuff like this.
Well, I think it would anyway.
filburt1
May 29th, 2002, 10:46 AM
Yeah it would be, mainly for older threads though...
MidgetsBro
May 29th, 2002, 08:04 PM
Originally posted by filburt1
Google doesn't index dynamic URLs, i.e. ones with ? or & in the URL. There's a hack at vbulletin.org that fixes this, but it also takes up an obscene amount of bandwidth going through each thread and indexing it.

Why did it index my site then? I am using PHP and all my pages have ? in them.

http://www.google.com/search?hl=en&ie=UTF8&oe=UTF8&q=storurl

the first link points to

http://haztek.d2g.com/getpage.php?page=storurl
filburt1
May 29th, 2002, 08:05 PM
I'm just repeating what I heard at the vBulletin support forums...
MidgetsBro
May 29th, 2002, 09:37 PM
Oh.
thexchord
Jun 2nd, 2002, 01:32 PM
i think it doesn't index dynamic pages, pages that result due to a form submission etc..

also, prolly has to do with the "expires" http header - if the page is set to expire it won't be indexed.
John
Jun 3rd, 2002, 04:09 PM
vB3 should change all this.
MidgetsBro
Jun 3rd, 2002, 04:13 PM
Hey John! What's up? I haven't seen you on the boards in quite some time. Working on something big? ;) :D
filburt1
Jun 3rd, 2002, 06:11 PM
Originally posted by John
vB3 should change all this.

Arg, you devs and your little blasted hints :p

Yeah, recall ya posting about that but that it requires Apache...what a shame that is, eh? :p
parksie
Jun 3rd, 2002, 06:19 PM
Originally posted by John
vB3 should change all this. Heeyyyyy, we have a John!!! (Back from France already? (hint hint, nudge nudge, say no more! :p)
John
Jun 4th, 2002, 08:24 PM
I popped over to France just after Easter, but I've been in England since then! Thank you very much! :p
Pix
Jun 4th, 2002, 09:02 PM
Originally posted by John
I popped over to France just after Easter, but I've been in England since then! Thank you very much! :p

oh yeah ;)