Taein Kim, Karstan Bock, Claire Luo, Amanda Liswood, Chloe Poroslay, Emily Wenger. Scrapers Selectively Respect robots.txt Directives: Evidence From a Large-Scale Empirical Study. In Paul Barford, Aruna Balasubramanian, Alberto Dainotti, editors, Proceedings of the 2025 ACM Internet Measurement Conference, IMC 2025, Madison, WI, USA, 28-31 October 2025. pages 541-557, ACM, 2025. [doi]
Abstract is missing.