Sitemap and Robots File Management

These two files can lead to a higher number of pages indexed by search engines, and ensuring that only the pages and sections you want to be included in the search engine results are included. The parameters for each of these important files can be managed through the SEOversite application. The pages can be updated per URL or as a bullk operation.

Modify rules for the crawling of your website by search engines through this easy-to-use manager.

Sitemaps.xml

The Sitemap file is the search engines roadmap to your website structure. Sitemaps.xml files are produced automatically by SEOversite. This file is produced according to the XML schema set in the protocol and used by most search engines. The file shows fields used by website according to a strict structure including the required and optional fields, which are:

Sitemap Protocol

urlset - Encapsulates the file and references the current protocol standard.
url - Parent tag for each URL entry. The remaining tags are children of this tag.
loc - URL of the page.
lastmod - The date of last modification of the file.
changefreq - How frequently the page is likely to change.
priority - The priority of this URL relative to other URLs on your site.


The last parameters within the file, change frequency and search priority, are able to be modified through SEOversite. For each URL you can update the how frequently the page is likely to be modified and the priority of the page relative to the others within the website. What this means is you can tell the search engines when to come back and recrawl your page if it updated on a daily, weekly or other time period.  Increasing the search priority will make that page more likely to be returned by the search engines when compared to the other pages within your website. This is useful for a marketing campaign or bit of important news you want to get more attention than the rest of your website.

Robots.txt

This file is the anti-sitemaps file. This is a text file that sits on your website root and is used to let search engines know NOT to crawl a certain section of page within your website. This is often used for member areas or sections you don't want crawled by the search engines for some other reason. This file is automatically produced and managed within SEOversite.

NoFollow tags

Other tags including follow and nofollow are also managed through our simple interface. Take a look a the search engine rules manager above.