htmlLimitedBots

ThehtmlLimitedBots config allows you to specify a list of user agents that should receive blocking metadata instead ofstreaming metadata.

importtype { NextConfig }from'next'constconfig:NextConfig= {  htmlLimitedBots: /MySpecialBot|MyAnotherSpecialBot|SimpleCrawler/,}exportdefault config

Default list

Next.js includes a default list of HTML limited bots, including:

• Google crawlers (e.g. Mediapartners-Google, AdsBot-Google, Google-PageRenderer)
• Bingbot
• Twitterbot
• Slackbot

See the full listhere.

Specifying ahtmlLimitedBots config will override the Next.js' default list. However, this is advanced behavior, and the default should be sufficient for most cases.

constconfig:NextConfig= {  htmlLimitedBots: /MySpecialBot|MyAnotherSpecialBot|SimpleCrawler/,}exportdefault config

Disabling

To fully disable streaming metadata:

importtype { NextConfig }from'next'constconfig:NextConfig= {  htmlLimitedBots: /.*/,}exportdefault config

Version History