Meta Delays Contested Crawling Terms to Nov. 20 — But Changes Nothing

By Amara Osei

Meta has pushed the effective date of its updated Commercial Terms and Self-Serve Ad Terms from Oct. 30 to Nov. 20 — and changed nothing else. The crawling permission that drew complaints from publishers and advertisers remains in both agreements, according to the U.S. English previews of the documents.

A Meta spokesperson told Nieman Lab the company extended the date "to allow more time for us to explain to our partners and stakeholders what's changing and what's not." That explanation, the spokesperson said, includes how Meta uses web crawlers.

What does the delay actually change?

Not the terms themselves. Nieman Lab reported that as of Oct. 23, Meta had altered nothing in either document except the date.

The crawling paragraph still lets Meta use automated software and "create test credentials" to crawl pages associated with a business's products or services, and to periodically pull updates from them. Neither preview mentions robots.txt (the standard file websites use to signal crawler permissions).

The current Self-Serve Ad Terms, dated Aug. 22, 2025, already let Meta crawl content on an advertiser's domains for uses that include "research and training" once an ad order is placed. Meta removed explicit training language from the contested clause earlier this month, but the existing advertising terms preserve that right.

There is also a localization gap: as of Oct. 25, the UK English, German and French Commercial Terms previews still listed Oct. 30 as the effective date.

The practical stakes are simple. A business that keeps using Meta's business products after receiving notice agrees to all updates to the Commercial Terms — including the crawling permissions. The Commercial Terms cover any business use, including managing a Facebook Page.

What are regulators doing?

The Movement for an Open Web, an advocacy group whose members include advertisers and publishers, has asked the European Commission and the UK's Competition and Markets Authority (CMA) to block Meta's terms with interim measures (temporary restrictions pending a full investigation) while they investigate. Meta told Reuters it disagreed with the complaint.

After the delay, a CMA spokesperson told Nieman Lab: "We will continue to scrutinize these terms and engage with Meta and others as we consider our next steps."

The Commission told Reuters it will assess the complaint. It told Nieman Lab on Oct. 23 that it welcomes the postponement and is committed to ensuring Meta's compliance with EU law, including Article 102 TFEU (the EU abuse-of-dominance rule) and the Digital Markets Act.

One point deserves emphasis: Meta announced the delay itself. No regulator statement reported by Reuters or Nieman Lab ordered a delay or adjustment to the terms.

Can publishers force a rewrite?

WAN-IFRA (the World Association of News Publishers) asked Meta to temporarily exempt news publishers from the crawling provision and to make robots.txt binding within its terms. On Oct. 23, WAN-IFRA CEO Stig Ørskov stated: "This postponement is a welcome step, but it does not address our concerns."

The same day, the European Alliance of News Agencies called on Meta to eliminate the provision altogether and said it hoped the new deadline would create a meaningful dialogue.

Here is what the terms do not say. Meta states that webmasters may signal preferred crawling behavior through robots.txt, and it documents its various crawlers for advertising, AI model training and Meta AI search. But the new terms do not specify whether a robots.txt setting limits what a business grants by accepting them. That gap is the unresolved core of the dispute.

The revised terms take effect Nov. 20. Publishers want the crawling clause changed before then, the CMA is still weighing its next steps, and businesses now have three weeks to read the crawling paragraph and check how their robots.txt handles each Meta crawler.