Sitemap Training

overview sitemap training allows the ai to learn knowledge from an entire website using a sitemap xml file instead of manually adding individual urls, the system reads the sitemap and automatically crawls all the webpage links listed inside it this helps index large websites efficiently and make the content searchable for ai responses what you will learn in this section, you will learn how to train the ai using a sitemap xml file automatically crawl all urls listed in the sitemap configure regex rules to exclude specific pages start the indexing process for website knowledge configuration walkthrough follow the video below to understand how to configure sitemap training and index website content 📹 sitemap training setup video the video explains how to add a sitemap url configure processing options apply regex rules start the indexing process step by step configuration docid\ skcqv gz6 uzol8ezf90c 📚 next steps once the sitemap indexing status shows ready to search , configure the agent workflow so the ai can retrieve knowledge from the indexed website content ➡️ continue with docid\ g jippcsr0vjwz4richmf for agents