Robots.txt

5-15 minIntermediate

HubSpot allows full editing of robots.txt usage.

Medium Recommended

File Manager

Editing the file content.

1

Edit Content

1

Settings > Website > Pages

2

Click 'SEO & Crawlers' tab

3

Edit 'Robots.txt' content

4

Click Save

Verification Checklist

  • Visit url/robots.txt