. . .
2.8 Prevent indexin 3e80 g of known malware and pishing pages This feature is a service, provided by google that enables applications to check Internet URLs against google's constantly updated lists of suspected phishing and malware pages. Sphider-plus is using version 1 of this service by verifying each URL to be indexed on line.
. . .
not need to update any database and will receive the results of the verification at the most actual level from the google database. As delivered by a web service, this option is not available for Intranet and all 'localhost' applications. To be activated in Admin backend, this service additionally requires an individual key. To be signed up at
. . .
suffixed for files to be indexed, according to the type of media. 4.13 Canonical <link> tag As defined by google, Microsoft and Yahoo! in February 2009, also Sphider-plus will follow the instruction of a rel="canonical" link. You may simply add this <link> tag to specify your preferred page version: <link rel="canonical"
. . .
harvester, bots and known evil user-agents (about 1.000 UAs) - Block all queries sent by Meta search engines like google, MSN, Amazon, etc. (about 4.000 IPs) - Block all queries sent by known spammer (about 190.000 IPs) Each option needs to be activated separately in admin backend. The lists holding the bad bots, as well as the Meta search
. . .
indexed (date and time) - Main URLs (domains) on top - By URL names - By file suffix - Only top 2 per URL (like google) - Most Popular Links on top - Promoted domains on top - Pages holding a catchword on top - Single result per page (ignoring arguments in URL) The current selection of 'order for result listing' is visible for the users as