. . . If a .htaccess file is used in order to redirect requests, or to 'produce' seo friendly link names, it might be helpful to enable the checkbox 'Allow other hosts in same domain' in Admin settings, section 'Spider settings'. Additionally it might become necessary also to activate: 'Spider can leave domain' in Sites view / Options / Edit / . . .