How To Create A Sitemap From Website Crawling
This guide will teach you how to use content from across your sites to train your custom AI agent.
Step 1: Find your target website
![target website](https://files.readme.io/6efb84b-target_website.png)
Make sure this site is publicly accessible or the tool won't be able to access the information.
Step 2: Generate your sitemap
This tool will crawl your website and build the proper sitemap to train your chatbot.
a) Paste your website link (Including http or https).
![](https://files.readme.io/741959f-Sitemap_tool_website_link.png)
b) Choose the Maximum number of pages.
This tells the tool how many pages from your site you want it to access.
![Sitemap tool](https://files.readme.io/b874da8-Sitemap_tool_No._of_pages.png)
c) Add the Email Address for Result Delivery.
We will email the finished sitemap to the email that you provided.
![Sitemap tool](https://files.readme.io/30b850d-Sitemap_Tool_Email.png)
d) Click on "Generate Sitemap".
![Sitemap tool](https://files.readme.io/c151a62-Sitemap_tool_Generate_button.png)
Step 3: Add the new sitemap to the Data
section of your project
Data
section of your projectYou can use the new sitemap to start a brand new project or add it to an existing project.
Congratulations! You have successfully created your Sitemap โ
Updated 4 months ago