Can Performant LLMs Be Ethical? Quantifying the Impact of Web Crawling Opt-Outs accepted as Oral at COLM 2025!