How To Create A Sitemap From Website Crawling
This guide will teach you how to use content from across your sites to train your custom chatbot.
Step 1: Find your target website
![](https://files.readme.io/25226bf-Screen_Shot_2023-09-19_at_3.30.33_PM.png)
Make sure this site is publicly accessible or the tool won't be able to access the information.
Step 2: Generate your sitemap
This tool will crawl your website and build the proper sitemap to train your chatbot.
a) Paste your website link (Including http or https).
![](https://files.readme.io/9b8891a-Screen_Shot_2023-09-19_at_3.33.54_PM.png)
b) Choose the Maximum number of pages.
This tells the tool how many pages from your site you want it to access.
![](https://files.readme.io/19b5d80-Screen_Shot_2023-09-19_at_3.34.11_PM.png)
c) Add the Email Address for Result Delivery.
We will email the finished sitemap to the email that you provided.
![](https://files.readme.io/c6d6e72-Screen_Shot_2023-09-19_at_3.34.37_PM.png)
d) Click on "Generate Sitemap".
![](https://files.readme.io/578b539-Screen_Shot_2023-09-19_at_3.39.38_PM.png)
Step 3: Add the new sitemap to the Data
section of your project
Data
section of your projectYou can use the new sitemap to start a brand new project or add it to an existing project.
Congratulations! You have successfully created your Sitemap โ
Updated 4 months ago