Create a sitemap from website scraping (small websites)

[VIDEO]

1. Open the CustomGPT sitemap tool and paste your website URL into the URL field.

📘

Note:

Make sure the website you want to scrape is publicly accessible. The tool cannot access private or restricted sites.

2. Click Generate Sitemap to start the process.

3. Check your email inbox for the sitemap link sent by the tool.

4. Click the link in the email to open the sitemap.

5. Copy the sitemap URL.

To continue with a larger website, see the Create a sitemap from website crawling guide.

You can use the new sitemap to start a brand new agent or add it to an existing agent.