The State of Screen Scraping

During all this recent excitement about using hAtom to generate feeds, I’d forgotten that I wrote about the concept nearly three years ago when I was getting ready to talk about syndication at Seybold SF.

While providing a purpose-built (ahem, Atom) feed remains the best answer, hAtom offers two things we didn’t have three years ago:

  1. A consistent content model: you don’t have to analyze the markup and write a custom XSLT transform (such as in my example using The Nation, or the feed for The Infinite Matrix.)
  2. A widely deployed model: It appears that Sandbox, a theme with hAtom support, will become the default template for WordPress.