Google search results catching up…
Some time back I complained about the Google indexing of the site after the Big Daddy upgrade. For a good while before Big Daddy, there was usually about a week delay between me posting and there being a full crawl of the posted page which was fairly impressive. Post Big-Daddy the coverage of even previously indexed articles was lousy for a good while. As recent as a week or two ago there were only 900-1100 pages (including feeds which are of arguable value for google to index (maybe I should block those to googlebot?…hmm…) Anyway, I just noticed that they’re up to 1600 pages (still including those rss feeds.) It seems spotty still, but they’ve finally got a post-big daddy article. The inurl feature is still annoyingly buggy though.
Here’s what I mean… I do a search for inurl:2006/04 site:averyjparker.com (or www.averyjparker.com – shouldn’t matter) and should just see posts from 2006/04 in the url – but…. it shows a bunch of stuff that it shouldn’t. So, some experimenting shows that if I go down another level and do inurl:2006/04/13 site:averyjparker.com I get a the expected behavior.
At least now supplemental results from the site are showing up with quoted text if it’s been crawled. For a while THAT wasn’t working correctly – so a “piece of text that I know is in an indexed page” would not show up for a while EVEN if it was indexed if the page was “supplementaled”. It’s been a frustrating ride with Google search this summer. This comes a few days after discovering that my page rank here has gone from 4 or 5 down to 0 (?!?!?) I don’t understand…. page rank goes down – indexed pages goes up. Capricious. I’ve got another site that shows pagerank of 5 and is nonexistent in a google search. (again ?!?!?!)
Anyway – it does appear as though things are getting sorted out there, for now the MSN site search is still more current and accurate. (By far).