Determining Bias to Search Engines from Robots.txt

Yang Sun, Ziming Zhuang, Isaac G. Councill, C. Lee Giles. Determining Bias to Search Engines from Robots.txt. In 2007 IEEE / WIC / ACM International Conference on Web Intelligence, WI 2007, 2-5 November 2007, Silicon Valley, CA, USA, Main Conference Proceedings. pages 149-155, IEEE Computer Society, 2007. [doi]

@inproceedings{SunZCG07,
  title = {Determining Bias to Search Engines from Robots.txt},
  author = {Yang Sun and Ziming Zhuang and Isaac G. Councill and C. Lee Giles},
  year = {2007},
  doi = {10.1109/WI.2007.45},
  url = {http://dx.doi.org/10.1109/WI.2007.45},
  tags = {C++, search},
  researchr = {https://researchr.org/publication/SunZCG07},
  cites = {0},
  citedby = {0},
  pages = {149-155},
  booktitle = {2007 IEEE / WIC / ACM International Conference on Web Intelligence, WI 2007, 2-5 November 2007, Silicon Valley, CA, USA, Main Conference Proceedings},
  publisher = {IEEE Computer Society},
  isbn = {0-7695-3026-5},
}