Well... the Googlebot has finally found unixforum!!

http://www.google.com/search?hl=en&ie=UTF-...G=Google+Search

We're second on the list (as of 24 April 2003).

Unfortunately, the phrase "unix forum" didn't seem to appear on this site when it was registered, so it's only listed when you search for "unixforum" as one word!

I have put a remedy in place for this, by renaming this site from "UnixForum.co.uk" to "Unix Forum.co.uk"! This should find it's way into google in a few months hopefully :D

yay!! thats cool :D

Shame you only have 4 entries ;)

http://www.google.com/search?q=site:http:/...fe=off&filter=0

No, that shows pretty much how many pages you have in google. Its not based just on how many sites link to you, for example I have almost 7,000 entries in google which are from my site, a majority of them people wouldn't/don't link too.

strange... i wonder why i only have 4 pages listed..... any ideas?

Google won't browse sites with sessionhashes in the url for starters: http://unixforum.co.uk/index.php?s=6aa9627111b662b3c01b3ed392bfc790&act=ST&f=2&t=75&st=0&#entry302

Generally it will index pages with parameters in the URL, but the fact that every page is is generated from index.php may not be helping.

Check this out though:

http://www.google.com/search?q=site:http:/...fe=off&filter=0

FishSponge uses PHP for 100% of the site, and it also uses sessionhashes... yet it has around 200 pages listed...

you can't tell me you have 7,000 pages on your site that are not generated by PHP, surely! :D

Every single page that is user accessible is generated by PHP, however all session hashes are removed for google and there is a Text Only version, which to the viewer appears as a smile HTML page.

Most of the Fishsponge entries are HTML pages from the stats, and those PHP generate pages seem to the the "base page" with no parameters and on most of the pages no real content thats likly to attarct hits (ie no posts).

do you mean google removes the session hashes, or your site has no session hashes because of google?

as for the text-only pages, doesn't that eat up a huge amount of disk space? if the text pages are generated on the fly (as i suspect they are) then how does google list them? aren't they generated with parameters on the address line?

basically... how can i make this site have more pages registered with google?? :D

CODE

My site removes the sessionhash for google when its browsing.  All the files are generated by PHP on the fly, with the format: http://www.thesistersthree.com/archive/forumdisplay/3.html (there is a list of all threads in forumid 3 there). Google see's that as a plain HTML file, just like the user does, but it has a nice clean url instead of http://www.thesistersthree.com/forum/forumdisplay.php?forumid=3 or even worse http://www.thesistersthree.com/forum/forumdisplay.php?s=4fcddef60a 616ed962f3325a31183717&forumid=3 which google will *not* list due to the md5 hash.

Yes, this post is screwed as IB is crap and won't allow you to turn off URL parsing.

This post has been edited by NTLDR on Apr 29 2003, 04:44 PM

first of all.... IB isn't crap. it happens to be very good, and incredibly customizable and powerful in my opinion. just cos it's lacking one small feature doesn't make it simply "crap". If you wanna turn off URL parsing, put the URL in quotes.

back to topic... how does your site remove the sessionhash while people are browsing? in fact.... hang on a minute.... go to "http://www.thesistersthree.com" and click on "Forums"... it gives me "http://www.thesistersthree.com/forums/index.php? s=2a8050aa069ea2412bd7b564ee63dc75" as the URL (excluding the space)! Every topic and every post within the "forums" subdirectory of your site has the session hash appended to the URL.

You don't mean that it senses that it's the Googlebot that's browsing, and therefore removes the hashes just for that agent, do you?

Yes it detects that its google and removes the sessionhash for that session. Also all the .html files don't have a sessionhash at all or any URL parameters, even for normal users.

IB lacks many features, not just one.

ah, ok... i see what you mean.... Google has links to places like "http://www.thesistersthree.com/forums/ printthread.php?s=&threadid=2822"...where the sessionhash still exists, but is empty.

i think i'll submit an RFE to the IPB team.

Thats correct, all the main search engines have no sessionhash when visiting my site, unlike other users which have it in the URL/Cookie. However the text only pages are far more usefull to get indexed as they contain the stuff users are likly to be searching for.

Shouldn't be too hard for you to impliment.