Google recently launched a new feature which allows them to use RSS and Atom feeds to find new content on websites. With these feeds becoming more and more popular, and with Google wanting to ensure new content is indexed as quickly as possible, they have now started using new techniques which can do this quicker than traditional crawling methods.
The reason RSS and Atom feeds have become so popular is because they provide an easy way for readers to know new content is available as soon as possible. Tapping into this thinking, Google now says it may use many sources to access the content from feeds, including notification services, Reader and the direct crawling of feeds.
To ensure a website is allowing Google to crawl their RSS and Atom feeds, webmasters can test their URLs in Google Webmaster Tools using the robot.txt tester.
To find out more, visit googlewebmastercentral.blogspot.com
About the author: Jack Mclaren
PPC Executive – Jack MclarenA PPC Executive at 4Ps Marketing, Jack is responsible for account management and the day to day running and optimisation of a number of pay per click customers. He spends a great deal of time managing the company’s relationship with Facebook where 4Ps have begun to specialise, and also working on improving account performance across international and domestic markets.