Sphider-plus

2.8 Prevent indexin 3e80 g of known malware and pishing pages This feature is a service, provided by Google that enables applications to check Internet URLs against Google's constantly updated lists of suspected phishing and malware pages. Sphider-plus is using version 1 of this service by verifying each URL to be indexed on line. . . .
. . .
not need to update any database and will receive the results of the verification at the most actual level from the Google database. As delivered by a web service, this option is not available for Intranet and all 'localhost' applications. To be activated in Admin backend, this service additionally requires an individual key. To be signed up at . . .
. . .
suffixed for files to be indexed, according to the type of media. 4.13 Canonical <link> tag As defined by Google, Microsoft and Yahoo! in February 2009, also Sphider-plus will follow the instruction of a rel="canonical" link. You may simply add this <link> tag to specify your preferred page version: <link rel="canonical" . . .
. . .
harvester, bots and known evil user-agents (about 1.000 UAs) - Block all queries sent by Meta search engines like Google, MSN, Amazon, etc. (about 4.000 IPs) - Block all queries sent by known spammer (about 190.000 IPs) Each option needs to be activated separately in admin backend. The lists holding the bad bots, as well as the Meta search . . .
. . .
indexed (date and time) - Main URLs (domains) on top - By URL names - By file suffix - Only top 2 per URL (like Google) - Most Popular Links on top - Promoted domains on top - Pages holding a catchword on top - Single result per page (ignoring arguments in URL) The current selection of 'order for result listing' is visible for the users as . . .
. . .
In order not to confuse the user, for the 3 methods - By URL names and then weight - Only top 2 per URL (like Google) - Most Popular Links on top the output of relevance (weight % ) is suppressed in result listing. For the method 'By URL names' an additional setting is available called: 'Define number of results shown per domain in result . . .
. . .
shown per domain in result listing' Using this option, the result listing will present an output similar to 'Like Google', but the count of links added to the main domain is selectable. Instead 'Like Google' will always present one additional link beyond the main domain. For the 'Most Popular Links on top ' method, Sphider-plus uses the before . . .
. . .
queries sent by harvester, bots and known evil user-agents - Block all queries sent by Meta search engines like Google, MSN, Amazon, etc. - Block all queries sent by known spammer (IPs) that persist in abusing forums and blogs with their scams, ripoffs, exploits and other annoyances - Block all queries, which could cause an XSS attack, shell . . .
. . .
- Queries sent by harvester, bots and known evil user-agents (UAS). - Queries sent by Meta search engines like Google, MSN, Amazon, etc. (IPs). - Queries sent by known spammer (IPs) that persist in abusing forums and blogs with their scams. - Queries, which could cause an XSS attack, shell execution, tag inclusion, - SQL injection, directory . . .

IPs’. Updated list of black ips. Bug fixed in ‘Periodical auto indexer’. Bug fixed in result listing for ‘Like Google (2 per URL). Some small bugs fixed. Involved folders and files that have been modified / added for this release: /addurl.php /admin/admin.php /admin/admin_header.php /admin/auth.php /admin/admin_header.php . . .
. . .
in admin backend, the advanced part of the search form is suppressed now. Bug fixed in result presentation 'Like Google (Top 2 per URL)'. Bug fixed in search form for category selection. Bug fixed in option 'Do not index comment parts '. Some small bugs fixed. Involved files that have been modified / added for this release: /admin/admin.php . . .
. . .
the 'search' button. Improved user statistics in admin backend: Now delivering all available Geo info, including Google map for IP location. Improved detection of Operating System. Updated data file for GeoIP. Updated black list for Meta search engines. Updated jQuery framework. Bug fixed in function 'Index media'. Bug fixed in 'Multithreaded . . .
. . .
listing. Bug fixed while indexing <! sphider_noindex > Bug fixed in result listing, while sorted 'Like Google'. Debug info removed from index procedure. MySQLi error messages now are correctly assigned to the according SQL queries. Involved files that have been modified / added for this release: /admin/admin.php /admin/auto_index.php . . .
. . .
index procedure New feature: Prevent indexing of known malware and pishing pages. This feature is supplied by a Google web service to prevent indexing of pages that contain malware or phishing content. For details please notice the chapter: Prevent indexing of known malware and pishing pages New feature: If the blacklist is met too often, . . .
. . .
values like 500 or 1000. New option to be set in Admin backend: Block all queries sent by Meta search engines like Google, MSN, Amazon, etc. For details see chapter: "Prevent queries from Meta search engines and crawler known to be evil." New option to be set in Admin backend: Block all queries sent by crawler known to be evil. For details see . . .
. . .
the admin folder is freed again for IP independent access. New feature: Result listings 'By URL names' and 'Like Google' are sorted in alphabetic order now. New feature: The words specified in common list (to be ignored during index procedure) are no longer interpreted case sensitive. Consequently words like 'Sphider' and 'sphider' need not to . . .
. . .
that prevented domain search for localhost applications Bug fixed to prevent invalid character size for ‘Like Google’ result listing Bug fixed in database 'Backup & Restore' function. Some additional small bugs removed. Involved files that have been modified / added for this release: /addurl.php /search.php /search_ini.php /admin/admin.php . . .
. . .
support for Japanese coded sites (charset: SHIFT_JIS, EUC-JP and UTF-8). Template design 'Pure' reduced to 'like Google'. Improved search algorithm: significantly reduced search time. Improved support for Greek language: 1. Transliterate queries with Latin characters into their Greek equivalents. Will for example transform query input alla to . . .

been indexed on the Internet. Prevent indexing of known malware and pishing pages This feature is supplied by a Google web service, to prevent indexing of pages, suspected to contain malware or phishing content. 11 different modes of sorting the text results Admin selectable: -By relevance (weight % ) -By hit counts in full text -Most popular . . .
. . .
full text -Most popular links on top -By indexdate -By URL names -By file suffix -Main URL (domain) on top -Like Google (Top 2 per URL) - Promoted domain on top - Links holding promoted catchwords on top. 5 different modes of sorting the media results Admin selectable: -By title(alphabetic) -By file suffix -By image size -By 'Last queried' -By . . .

index procedure New feature: Prevent indexing of known malware and pishing pages. This feature is supplied by a Google web service to prevent indexing of pages that contain malware or phishing content. For details please notice the chapter: Prevent indexing of known malware and pishing pages New feature: If the blacklist is met too often, . . .

in admin backend, the advanced part of the search form is suppressed now. Bug fixed in result presentation 'Like Google (Top 2 per URL)'. Bug fixed in search form for category selection. Bug fixed in option 'Do not index comment parts '. Some small bugs fixed. Involved files that have been modified / added for this release: /admin/admin.php . . .