How CustomGPT.ai Builds AI Agent from My Website?

Step 1: Create a New Project

a) Log in to your CustomGPT.ai account.

b) Click on 'Create Project' in the dashboard.

c) Choose 'Website' as your content source.

Step 2: Provide Your Website’s Domain

a) "Enter a URL or a sitemap" in the provided field.

b) Click on "Create" to start building your AI Agent using the detected pages from the website

Step 3: Sitemap Search

a) CustomGPT.ai will first attempt to find a sitemap for the domain you provided. If a sitemap is found, CustomGPT.ai will crawl the pages listed on the sitemap, indexing the content for your AI agent.

Step 4: If No Sitemap is Found

a) If a sitemap is not found, CustomGPT.ai will:

• Attempt to find all links on your website's main page and crawl them.
• Find links on the new pages discovered and crawl those as well.
• Continue this process until it reaches your per-project page limit or no new links are found.

🚧

If no links are found, CustomGPT.ai will crawl and index just the single page you provided.

Same-Domain Crawling Only:

a) In the case sitemap was not present, CustomGPT.ai will only crawl links we find that remain within the same domain. For example: If your domain is https://customgpt.ai, links like https://google.com or even https://docs.customgpt.ai will not be crawled.

👍

Congratulations! You’ve successfully created an AI agent from your website content using CustomGPT.ai!