Steve Lawrence, C. Lee Giles. Accessibility of information on the Web. SIGART Bulletin, 11(1):32-39, 2000. [doi]
Search engines do not index sites equally, may not index new pages for months, and no engine indexes more than about 16% of the web. As the web becomes a major communications medium, the data on it must be made more accessible.