. . .
not followed during Re-index, only main URL is indexed (option 1). It is not a bug, it is a feature. If 'Follow sitemap.xml' is activated in Admin settings, links will only be followed if: - 'last modified' date in sitemap.xml is newer than Sphiders 'last indexed' date. - New link that is not yet known in Sphiders link table. The main URL will
. . .
is not yet known in Sphiders link table. The main URL will always be indexed, because status and content of the sitemap file is required for further decision what necessarily has to be indexed. Because only relevant pages will be indexed, this approach significant reduces the time required for index and re-index. Links are not followed during