Providing professional Web Content Management for SMEs and the Third Sector since 2003
29th Mar 2008
Since the launch of our new site on 20th March I have understandably been keeping a keen eye on our stats for bot visits. Previously Webbed IT had a single web page and therefore only had inbound links to our home page (over 3,900 according to Yahoo) so I was interested to see how long it would take the main Search Engines to begin indexing our new pages ... today we are beginning to see some results.
The main challenge our site faced with regards to search engines is that its predecessor - the single web page - had been in place with very few updates since early 2005. Whilst it had a page rank of 4/10 - presumably from the volume of backlinks - it could not have been a high priority for bots to visit for updated content.
Surprisingly Yahoo Slurp! (Yahoo's search bot) weighed in with multiple visits every day since the site launched registering multiple hits each time. Googlebot (Google's search bot) waited until the 24th to pay us a visit and only registered a couple of hits, but has been back every day since with more hits each time. And finally there's MSNBot (MSN Live's search bot) which has been a few times but in total has registered only 10 hits this month.
In looking at the above I would have expected Yahoo! to have indexed more pages than Google and MSN Live and up until a couple of days ago this was true with Yahoo! showing 1 page of our new site - Shared Hosting.
However, a quick check around the search engines today - around a week after the bots all had visited - shows that Google has indexed 10 of the new pages whilst Yahoo! is still showing old data for our home page and only 4 of the new pages. MSN Live has updated its cache of the home page, but has failed to index any further pages as of yet.
We have validated our website with each of the three search engines and on Yahoo! have submitted the RSS Feeds for our News and FrogBlog pages so will keep an eye on progress to update this post with.
2. At 18:53 PM on 2nd Apr 2008, Paul G. wrote
Update2:
Google is now showing 61 pages in its index, whilst Yahoo! is steadily increasing day on day showing 27. MSN Live is still bringing up the rear, still not having indexed anything other than the home page.
It's quickly become apparent that the Directory module needs some work to show meaningful page titles when browsing categories and directory entries. Will be interesting to see how quickly the newly indexed Directory pages will update with new page titles applied.
3. At 10:40 AM on 5th Apr 2008, Paul G. wrote
Update3:
- Google 63 pages
- Yahoo! 46 pages
- MSN Live 1 page
Still to update the Directory module, will report on that soon.
Give a person a fish and you feed them for a day; teach that person to use the Internet and they won't bother you for weeks.
1. At 09:16 AM on 1st Apr 2008, Paul G. wrote
Update:
Google still lists the same 10 pages that were added to the index on 29th March, but Yahoo! went up to 8 yesterday and lists 16 pages today - including two RSS feeds that I submitted through Yahoo!'s site manager.
MSN Live still only lists the home page of the new site.
Complain about this comment