Businesses using Meta’s services face a broader website content permission even if they never buy an ad. The Commercial Terms examined by Search Engine Journal on October 16 extend authorization to collect website material and use it to train Meta products to business use across its platforms. The changes are scheduled to take effect on October 30, 2026.

That brings companies managing a Facebook Page or working in Meta Business Suite within the scope of permissions previously tied to advertising. The central change is who grants access, rather than the introduction of website crawling into Meta’s agreements for the first time.

What businesses would authorize

The provision permits Meta and organizations acting on its behalf to deploy bots, web scrapers and other automated software against domains, pages and URLs associated with a business’s products or services. It also reaches addresses made available through the business’s own use of Meta products or through other users’ activity.

The permitted operations include indexing, caching, analyzing and collecting content, with periodic retrieval of updates. Meta may also create test credentials to access the relevant pages. The stated uses of collected material include product development, improvement, research, training and integrity protection.

Business activities covered by the terms include advertising, marketing messages, product listings and the use of Ads Manager or Meta Business Suite. A matching permission appears in the revised Self-Serve Ad Terms, also due to take effect on October 30. Meta treats continued commercial use after the update as acceptance; businesses that disagree are directed to stop using its products for commercial purposes.

Why publishers question the scope

Nieman Lab reported the issue on October 15 after asking three legal professionals to review the wording. They said the provision could support an argument that Meta has permission to scrape news websites and train its AI products on their content. That is a possible contractual interpretation, rather than a right confirmed by a court.

Media and intellectual property attorney Matt Topic, who represents The Intercept in its copyright case against OpenAI, advised publishers to assume the provision could be enforceable. He also cautioned that its treatment in court remains uncertain.

Meta disputes the suggestion that the update targets news content. On October 16, spokesperson Andy Stone wrote on X that the purpose was to obtain accurate information about products sold on third-party websites for advertising and content recommendations. Meta also told Nieman Lab that its approach to crawling publishers would not change.

The European Publishers Council (EPC) said it was writing to the European Commission. It is concerned that the reference to user activity could let Meta claim permission to use a news article simply because someone shares a link to it on social media.

How earlier agreements handled crawling

The Commercial Terms dated March 6, 2024 contain no separate crawling provision. However, the Self-Serve Ad Terms dated August 22, 2025 already authorize collection from advertisers’ domains, pages and URLs when an ad order is placed. Their purposes include developing advertising and other business products, research, training and integrity protection.

Related permissions also appear elsewhere. The Ad Creative Generative AI Terms dated May 6, 2024 allow crawling of advertiser-provided URLs when businesses use Meta’s generative advertising tools. The Product Catalog Terms permit periodic catalog updates from catalog URLs. The Seller Agreement, last updated May 26, 2026, already allows automated retrieval from seller-provided URLs and the creation of test credentials to help optimize listings.

Meta described the consolidation as an effort to reduce duplication: Product Catalog Terms would move into the Commercial Terms, while Ad Creative Generative AI Terms would become part of the Self-Serve Ad Terms. Its Business Help Center announcement did not specifically mention crawling or training. The broader commercial terms nevertheless attach permission to business use generally, extending beyond the earlier trigger of an advertising purchase.

Unresolved questions about crawler access

Meta points website owners to robots.txt as a way to manage crawler access. Neither revised agreement, however, explains how those instructions interact with the contractual permission. Lawyers consulted by Nieman Lab said the wording leaves room for Meta to argue that its commercial terms take precedence over blocking instructions.

Cornell law professor James Grimmelmann also raised a concern about test credentials. Creating an account could technically open content behind a registration requirement. Meta did not answer whether the mechanism would reach paid material or bypass paywalls.

Meta’s crawler documentation distinguishes several tools. Meta-ExternalAgent collects material for purposes including foundation model training and direct indexing to improve products. Meta-WebIndexer supports Meta AI search; allowing it, Meta says, helps the service cite and link to website content in its answers. Site owners can therefore disallow the former while permitting the latter.

Other crawlers have documented exceptions. Meta-ExternalFetcher may bypass robots.txt when retrieving a page at a user’s request. FacebookExternalHit, which generates link previews, may do so for security or integrity checks. Before October 30, website operators using Meta commercially have reason to review the rules for each crawler and decide whether to continue using the services. The version described in the report leaves the relationship between those technical settings and the new contractual permissions unresolved.

Businesses using Meta’s services face a broader website content permission even if they never buy an ad. The Commercial Terms examined by Search Engine Journal on October 16 extend authorization to collect website material and use it to train Meta products to business use across its platforms. The changes are scheduled to take effect on October 30, 2026.

That brings companies managing a Facebook Page or working in Meta Business Suite within the scope of permissions previously tied to advertising. The central change is who grants access, rather than the introduction of website crawling into Meta’s agreements for the first time.

What businesses would authorize

The provision permits Meta and organizations acting on its behalf to deploy bots, web scrapers and other automated software against domains, pages and URLs associated with a business’s products or services. It also reaches addresses made available through the business’s own use of Meta products or through other users’ activity.

The permitted operations include indexing, caching, analyzing and collecting content, with periodic retrieval of updates. Meta may also create test credentials to access the relevant pages. The stated uses of collected material include product development, improvement, research, training and integrity protection.

Business activities covered by the terms include advertising, marketing messages, product listings and the use of Ads Manager or Meta Business Suite. A matching permission appears in the revised Self-Serve Ad Terms, also due to take effect on October 30. Meta treats continued commercial use after the update as acceptance; businesses that disagree are directed to stop using its products for commercial purposes.

Why publishers question the scope

Nieman Lab reported the issue on October 15 after asking three legal professionals to review the wording. They said the provision could support an argument that Meta has permission to scrape news websites and train its AI products on their content. That is a possible contractual interpretation, rather than a right confirmed by a court.

Media and intellectual property attorney Matt Topic, who represents The Intercept in its copyright case against OpenAI, advised publishers to assume the provision could be enforceable. He also cautioned that its treatment in court remains uncertain.

Meta disputes the suggestion that the update targets news content. On October 16, spokesperson Andy Stone wrote on X that the purpose was to obtain accurate information about products sold on third-party websites for advertising and content recommendations. Meta also told Nieman Lab that its approach to crawling publishers would not change.

The European Publishers Council (EPC) said it was writing to the European Commission. It is concerned that the reference to user activity could let Meta claim permission to use a news article simply because someone shares a link to it on social media.

How earlier agreements handled crawling

The Commercial Terms dated March 6, 2024 contain no separate crawling provision. However, the Self-Serve Ad Terms dated August 22, 2025 already authorize collection from advertisers’ domains, pages and URLs when an ad order is placed. Their purposes include developing advertising and other business products, research, training and integrity protection.

Related permissions also appear elsewhere. The Ad Creative Generative AI Terms dated May 6, 2024 allow crawling of advertiser-provided URLs when businesses use Meta’s generative advertising tools. The Product Catalog Terms permit periodic catalog updates from catalog URLs. The Seller Agreement, last updated May 26, 2026, already allows automated retrieval from seller-provided URLs and the creation of test credentials to help optimize listings.

Meta described the consolidation as an effort to reduce duplication: Product Catalog Terms would move into the Commercial Terms, while Ad Creative Generative AI Terms would become part of the Self-Serve Ad Terms. Its Business Help Center announcement did not specifically mention crawling or training. The broader commercial terms nevertheless attach permission to business use generally, extending beyond the earlier trigger of an advertising purchase.

Unresolved questions about crawler access

Meta points website owners to robots.txt as a way to manage crawler access. Neither revised agreement, however, explains how those instructions interact with the contractual permission. Lawyers consulted by Nieman Lab said the wording leaves room for Meta to argue that its commercial terms take precedence over blocking instructions.

Cornell law professor James Grimmelmann also raised a concern about test credentials. Creating an account could technically open content behind a registration requirement. Meta did not answer whether the mechanism would reach paid material or bypass paywalls.

Meta’s crawler documentation distinguishes several tools. Meta-ExternalAgent collects material for purposes including foundation model training and direct indexing to improve products. Meta-WebIndexer supports Meta AI search; allowing it, Meta says, helps the service cite and link to website content in its answers. Site owners can therefore disallow the former while permitting the latter.

Other crawlers have documented exceptions. Meta-ExternalFetcher may bypass robots.txt when retrieving a page at a user’s request. FacebookExternalHit, which generates link previews, may do so for security or integrity checks. Before October 30, website operators using Meta commercially have reason to review the rules for each crawler and decide whether to continue using the services. The version described in the report leaves the relationship between those technical settings and the new contractual permissions unresolved.

Businesses using Meta’s services face a broader website content permission even if they never buy an ad. The Commercial Terms examined by Search Engine Journal on October 16 extend authorization to collect website material and use it to train Meta products to business use across its platforms. The changes are scheduled to take effect on October 30, 2026.

That brings companies managing a Facebook Page or working in Meta Business Suite within the scope of permissions previously tied to advertising. The central change is who grants access, rather than the introduction of website crawling into Meta’s agreements for the first time.

What businesses would authorize

The provision permits Meta and organizations acting on its behalf to deploy bots, web scrapers and other automated software against domains, pages and URLs associated with a business’s products or services. It also reaches addresses made available through the business’s own use of Meta products or through other users’ activity.

The permitted operations include indexing, caching, analyzing and collecting content, with periodic retrieval of updates. Meta may also create test credentials to access the relevant pages. The stated uses of collected material include product development, improvement, research, training and integrity protection.

Business activities covered by the terms include advertising, marketing messages, product listings and the use of Ads Manager or Meta Business Suite. A matching permission appears in the revised Self-Serve Ad Terms, also due to take effect on October 30. Meta treats continued commercial use after the update as acceptance; businesses that disagree are directed to stop using its products for commercial purposes.

Why publishers question the scope

Nieman Lab reported the issue on October 15 after asking three legal professionals to review the wording. They said the provision could support an argument that Meta has permission to scrape news websites and train its AI products on their content. That is a possible contractual interpretation, rather than a right confirmed by a court.

Media and intellectual property attorney Matt Topic, who represents The Intercept in its copyright case against OpenAI, advised publishers to assume the provision could be enforceable. He also cautioned that its treatment in court remains uncertain.

Meta disputes the suggestion that the update targets news content. On October 16, spokesperson Andy Stone wrote on X that the purpose was to obtain accurate information about products sold on third-party websites for advertising and content recommendations. Meta also told Nieman Lab that its approach to crawling publishers would not change.

The European Publishers Council (EPC) said it was writing to the European Commission. It is concerned that the reference to user activity could let Meta claim permission to use a news article simply because someone shares a link to it on social media.

How earlier agreements handled crawling

The Commercial Terms dated March 6, 2024 contain no separate crawling provision. However, the Self-Serve Ad Terms dated August 22, 2025 already authorize collection from advertisers’ domains, pages and URLs when an ad order is placed. Their purposes include developing advertising and other business products, research, training and integrity protection.

Related permissions also appear elsewhere. The Ad Creative Generative AI Terms dated May 6, 2024 allow crawling of advertiser-provided URLs when businesses use Meta’s generative advertising tools. The Product Catalog Terms permit periodic catalog updates from catalog URLs. The Seller Agreement, last updated May 26, 2026, already allows automated retrieval from seller-provided URLs and the creation of test credentials to help optimize listings.

Meta described the consolidation as an effort to reduce duplication: Product Catalog Terms would move into the Commercial Terms, while Ad Creative Generative AI Terms would become part of the Self-Serve Ad Terms. Its Business Help Center announcement did not specifically mention crawling or training. The broader commercial terms nevertheless attach permission to business use generally, extending beyond the earlier trigger of an advertising purchase.

Unresolved questions about crawler access

Meta points website owners to robots.txt as a way to manage crawler access. Neither revised agreement, however, explains how those instructions interact with the contractual permission. Lawyers consulted by Nieman Lab said the wording leaves room for Meta to argue that its commercial terms take precedence over blocking instructions.

Cornell law professor James Grimmelmann also raised a concern about test credentials. Creating an account could technically open content behind a registration requirement. Meta did not answer whether the mechanism would reach paid material or bypass paywalls.

Meta’s crawler documentation distinguishes several tools. Meta-ExternalAgent collects material for purposes including foundation model training and direct indexing to improve products. Meta-WebIndexer supports Meta AI search; allowing it, Meta says, helps the service cite and link to website content in its answers. Site owners can therefore disallow the former while permitting the latter.

Other crawlers have documented exceptions. Meta-ExternalFetcher may bypass robots.txt when retrieving a page at a user’s request. FacebookExternalHit, which generates link previews, may do so for security or integrity checks. Before October 30, website operators using Meta commercially have reason to review the rules for each crawler and decide whether to continue using the services. The version described in the report leaves the relationship between those technical settings and the new contractual permissions unresolved.

Businesses using Meta’s services face a broader website content permission even if they never buy an ad. The Commercial Terms examined by Search Engine Journal on October 16 extend authorization to collect website material and use it to train Meta products to business use across its platforms. The changes are scheduled to take effect on October 30, 2026.

That brings companies managing a Facebook Page or working in Meta Business Suite within the scope of permissions previously tied to advertising. The central change is who grants access, rather than the introduction of website crawling into Meta’s agreements for the first time.

What businesses would authorize

The provision permits Meta and organizations acting on its behalf to deploy bots, web scrapers and other automated software against domains, pages and URLs associated with a business’s products or services. It also reaches addresses made available through the business’s own use of Meta products or through other users’ activity.

The permitted operations include indexing, caching, analyzing and collecting content, with periodic retrieval of updates. Meta may also create test credentials to access the relevant pages. The stated uses of collected material include product development, improvement, research, training and integrity protection.

Business activities covered by the terms include advertising, marketing messages, product listings and the use of Ads Manager or Meta Business Suite. A matching permission appears in the revised Self-Serve Ad Terms, also due to take effect on October 30. Meta treats continued commercial use after the update as acceptance; businesses that disagree are directed to stop using its products for commercial purposes.

Why publishers question the scope

Nieman Lab reported the issue on October 15 after asking three legal professionals to review the wording. They said the provision could support an argument that Meta has permission to scrape news websites and train its AI products on their content. That is a possible contractual interpretation, rather than a right confirmed by a court.

Media and intellectual property attorney Matt Topic, who represents The Intercept in its copyright case against OpenAI, advised publishers to assume the provision could be enforceable. He also cautioned that its treatment in court remains uncertain.

Meta disputes the suggestion that the update targets news content. On October 16, spokesperson Andy Stone wrote on X that the purpose was to obtain accurate information about products sold on third-party websites for advertising and content recommendations. Meta also told Nieman Lab that its approach to crawling publishers would not change.

The European Publishers Council (EPC) said it was writing to the European Commission. It is concerned that the reference to user activity could let Meta claim permission to use a news article simply because someone shares a link to it on social media.

How earlier agreements handled crawling

The Commercial Terms dated March 6, 2024 contain no separate crawling provision. However, the Self-Serve Ad Terms dated August 22, 2025 already authorize collection from advertisers’ domains, pages and URLs when an ad order is placed. Their purposes include developing advertising and other business products, research, training and integrity protection.

Related permissions also appear elsewhere. The Ad Creative Generative AI Terms dated May 6, 2024 allow crawling of advertiser-provided URLs when businesses use Meta’s generative advertising tools. The Product Catalog Terms permit periodic catalog updates from catalog URLs. The Seller Agreement, last updated May 26, 2026, already allows automated retrieval from seller-provided URLs and the creation of test credentials to help optimize listings.

Meta described the consolidation as an effort to reduce duplication: Product Catalog Terms would move into the Commercial Terms, while Ad Creative Generative AI Terms would become part of the Self-Serve Ad Terms. Its Business Help Center announcement did not specifically mention crawling or training. The broader commercial terms nevertheless attach permission to business use generally, extending beyond the earlier trigger of an advertising purchase.

Unresolved questions about crawler access

Meta points website owners to robots.txt as a way to manage crawler access. Neither revised agreement, however, explains how those instructions interact with the contractual permission. Lawyers consulted by Nieman Lab said the wording leaves room for Meta to argue that its commercial terms take precedence over blocking instructions.

Cornell law professor James Grimmelmann also raised a concern about test credentials. Creating an account could technically open content behind a registration requirement. Meta did not answer whether the mechanism would reach paid material or bypass paywalls.

Meta’s crawler documentation distinguishes several tools. Meta-ExternalAgent collects material for purposes including foundation model training and direct indexing to improve products. Meta-WebIndexer supports Meta AI search; allowing it, Meta says, helps the service cite and link to website content in its answers. Site owners can therefore disallow the former while permitting the latter.

Other crawlers have documented exceptions. Meta-ExternalFetcher may bypass robots.txt when retrieving a page at a user’s request. FacebookExternalHit, which generates link previews, may do so for security or integrity checks. Before October 30, website operators using Meta commercially have reason to review the rules for each crawler and decide whether to continue using the services. The version described in the report leaves the relationship between those technical settings and the new contractual permissions unresolved.