08 July 2006

Crawler frequency

I seem to be getting obsessive about Linkie Winkie. I see that the crawler has visited me on 5 occasions, but the experiment seems to have stuttered a little, the Alexa traffic grew rapidly at the beginning of July and now seems to have dropped back.

Perhaps this is a consolidation phase before it takes a further growth spurt?

3 Comments:

Anonymous curtis.summers said...

I'm wondering what the crawler is using to find which sites to crawl. My site has yet to be crawled.

12:34 pm  
Blogger John Diffenthal said...

I'm sorry, I have no idea why the Crawler chooses some sites rather than others - I assume that it chose me out of pity!

Perhaps you need to ask Chris and Gurtie what is driving the thing.

1:11 pm  
Anonymous Darryn said...

My Site has been crawled. Anyone know what it's all about. Seem's to have something to do with Feedburner...

9:19 am  

Post a Comment

Links to this post:

Create a Link

<< Home