Crawler frequency
I seem to be getting obsessive about Linkie Winkie. I see that the crawler has visited me on 5 occasions, but the experiment seems to have stuttered a little, the Alexa traffic grew rapidly at the beginning of July and now seems to have dropped back.
Perhaps this is a consolidation phase before it takes a further growth spurt?
Perhaps this is a consolidation phase before it takes a further growth spurt?
posted by John Diffenthal at 11:24 am
3 Comments:
I'm wondering what the crawler is using to find which sites to crawl. My site has yet to be crawled.
I'm sorry, I have no idea why the Crawler chooses some sites rather than others - I assume that it chose me out of pity!
Perhaps you need to ask Chris and Gurtie what is driving the thing.
My Site has been crawled. Anyone know what it's all about. Seem's to have something to do with Feedburner...
Post a Comment
<< Home