Subscribe to BlogGet all of our latest industry tips by email
Recent posts
- Google introduces Knowledge Graph
- Google’s Algorithms: The 52 changes of April
- Google’s Penguin Update
- 4Ps Cookie Audit
- Near Match Types
- Google Analytics Continues to Get Social
- Discussing “Cookies” at the AOP (Association of Online Publishers)
- SERP Insights and Online Advertising
- 4Ps Marketing shortlisted for ‘Agency of the Year’ by Marketing Week
- 4Ps Marketing Planning for Personal, Client and Agency Growth in Year 5
Related Posts
BY CATEGORY
BY AUTHOR
- Aatif Basheer (1)
- Alina Katchi (11)
- Chris Hyland (31)
- Eleanor Steele (25)
- Emma Pilcher (2)
- Hannah Miller (288)
- Ibeth Santos (5)
- Jack Mclaren (38)
- James Cornwall (14)
- James Green (8)
- Kia McSween (4)
- Laura Pagani (4)
- Luke Knight (17)
- Matt Stannard (19)
- Matthew Phelan (77)
- Megan Clayton (1)
- Peter O'Neill (1)
- Rachel Kneen (172)
- Robert Laver (4)
- Serena Wong (1)
- Stephanie Villegas (45)
RSS & Atom Feeds Used to Crawl New Content
Google recently launched a new feature which allows them to use RSS and Atom feeds to find new content on websites. With these feeds becoming more and more popular, and with Google wanting to ensure new content is indexed as quickly as possible, they have now started using new techniques which can do this quicker than traditional crawling methods.
The reason RSS and Atom feeds have become so popular is because they provide an easy way for readers to know new content is available as soon as possible. Tapping into this thinking, Google now says it may use many sources to access the content from feeds, including notification services, Reader and the direct crawling of feeds.
To ensure a website is allowing Google to crawl their RSS and Atom feeds, webmasters can test their URLs in Google Webmaster Tools using the robot.txt tester.
To find out more, visit googlewebmastercentral.blogspot.com
Save on Delicious