Google announced a proposal to crawl AJAX-based website in the article A proposal for making AJAX crawlable of the Official Google Webmaster Central Blog. One of the ways of making an AJAX-based website crawlable is for the site to adapt the way it marks the links with fragment identifiers, and to use server-side headless browser techniques to generate HTML code based on the final state in the browser.