How To Create A Sitemap From Website Crawling

This guide will teach you how to use content from across your sites to train your custom AI agent.

Step 1: Find your target website

target website


Make sure this site is publicly accessible or the tool won't be able to access the information.

Step 2: Generate your sitemap

This tool will crawl your website and build the proper sitemap to train your chatbot.

a) Paste your website link (Including http or https).

b) Choose the Maximum number of pages.

This tells the tool how many pages from your site you want it to access.

Sitemap tool

c) Add the Email Address for Result Delivery.

We will email the finished sitemap to the email that you provided.

Sitemap tool

d) Click on "Generate Sitemap".

Sitemap tool

Step 3: Add the new sitemap to the Data section of your project

You can use the new sitemap to start a brand new project or add it to an existing project.


Congratulations! You have successfully created your Sitemap βœ”