Skip to content

Sunday, 8 November 2026 IST

Breaking

AI giants promise publishers new way to block some scraping

Publishers currently have to implement multiple blocking commands for every bot that crawls the web to collect data

AI giants promise publishers new way to block some scraping
AI giants promise publishers new way to block some scraping — image via The Hindu Technology feed — Credit: Storywire

Attributed summary

Publishers currently have to implement multiple blocking commands for every bot that crawls the web to collect data

Read the original report — The Hindu Technology

Storywire publishes attributed summaries for discoverability. Full reporting remains with the original publisher — we do not republish restricted full text.

Corrections