Searching for Web Crawling's Legal Boundaries

Web pages are a treasure-trove of useful information for companies that are able to capture it using Web crawling (or scraping) technology. Yet, for over 20 years, courts have struggled to draw the line between the usefulness of such information and the rights of the content owners and website operators from which that content is derived. Once a niche issue, the increased use of this technology has compounded the disputes related to it.

19 minute read June 02, 2017 at 12:05 AM
By
Joshua L. Simmons
Searching for Web Crawling's Legal Boundaries

Web pages are a treasure-trove of useful information for financial firms and software companies that are able to capture it using Web crawling (or scraping) technology.

This premium content is locked for LawJournalNewsletters subscribers only

ENJOY UNLIMITED ACCESS TO THE SINGLE SOURCE OF OBJECTIVE LEGAL ANALYSIS, PRACTICAL INSIGHTS, AND NEWS IN LawJournalNewsletters

  • Stay current on the latest information, rulings, regulations, and trends
  • Includes practical, must-have information on copyrights, royalties, AI, and more
  • Tap into expert guidance from top entertainment lawyers and experts

Already have an account? Sign In Now

For enterprise-wide or corporate access, please contact Customer Service at [email protected] or call 1-877-256-2473.

NOT FOR REPRINT

© 2026 ALM Global, LLC, All Rights Reserved. Request academic re-use from www.copyright.com. All other uses, submit a request to [email protected]. For more information visit Asset & Logo Licensing.

Continue Reading

Most firms are aiming their newest tools at the work they already do — pouring their most powerful technology into running the same tasks a little faster. But when everyone automates the same tasks at once, no one pulls ahead. That reaches the future a little faster while leaving a firm’s largest opportunity untouched — and that opportunity isn’t doing more of the existing work, but transforming how the high-value work gets done.

June 01, 2026

Artificial intelligence is rapidly embedding itself into legal workflows, but much of the conversation treats all use cases as if they carry the same level of risk, even if they do not. The more useful question is not whether AI works, but where it can be safely applied and where it cannot.

June 01, 2026