Sphider-plus

conversion. - Bug fixed in 'Phrase' search. - Some small bugs fixed. - Involved folders and files that have been modified / added for this release: /admin/admin.php /admin/configset.php /admin/messages.php /admin/spiderfuncs.php /include/commonfuncs.php /include/search_10.php /include/searchfuncs.php /include/common/black_ips_priv.txt Top . . .
. . .
is available in different sections of full text) - Some small bugs fixed - Involved folders and files that have been modified / added for this release: /admin/admin.php /admin/configset.php /admin/sphider.php /admin/spiderfuncs.php /converter/ pdf / . . . as new subfolder together with all its subfolders and scripts /include/searchfuncs.php . . .
. . .
fixed if duplicate values are found in arrays. - Some more small bugs fixed Involved folders and files that have been modified / added for this release: /admin/auth.php /admin/configset.php /admin/spiderfuncs.php /include/commonfuncs.php /include/searchfuncs.php /include/search_40.php /include/suggest.php Top [ Former version ] Version: 4.2023c . . .
. . .
more small bugs fixed. Updated Serbian language file. Thanks to Zoran Tasić. Involved folders and files that have been modified / added for this release: /admin/admin.php /admin/admin_header.php /admin/configset.php /admin/spiderfuncs.php /include/commonfuncs,php /include/search_10.php /include/search_40.php /languages/sr-language.php Top [ . . .
. . .
fixed in Settings option: Do not index UNICODE symbols and Emoji characters. Involved folders and files that have been modified / added for this release: /addurl.php /admin/admin.php /admin/admin_header.php /admin/auto_index.php /admin/configset.php /admin/spiderfuncs.php /admin/url_backup.php /admin/getid3/getid3.lib.php . . .
. . .
fixed. Improved PHP error handling for warnings, deprecated, notices etc. Involved folders and files that have been modified / added for this release: As nearly all scripts were altered, it commanded to do a complete fresh installation for this version. Please follow the instructions as described in chapter 'New Installation' Top [ Former . . .
. . .
IPs and suffixes to be ignored during index procedure. Some small bugs fixed Involved folders and files that have been modified / added for this release: /admin/admin.php /admin/configset.php /include/click_counter.php /include/commonfuncs.php /include/media_counter.php /include/search_10.php /include/common/black_ips_priv.txt . . .
. . .
'Search' for sites, keywords, links, and categories. Some small bugs fixed. Involved folders and files that have been modified / added for this release: /.htaccess /php.ini /admin/admin.php /admin/auto_index.php /admin/index_media.php /admin/admin_search.php /admin/install_tables.php /admin/php.ini /converter/pdf_reader.php . . .
. . .
Bug fixed in detection of ‘mariaDB’ database. Some small bugs fixed. Involved folders and files that have been modified / added for this release: /admin/admin.php /admin/configset.php /admin/db_activate.php /admin/db_main.php /admin/install_tables.php /admin/spiderfuncs.php /include/commonfuncs.php /include/searchfuncs.php Top [ Former . . .

all the pages linked from it etc. Re-index: By selecting this mod, indexing is forced even if the page already has been indexed. Re-index only detects changes of the pages to be re-indexed. Modifications in Admin settings are not recognized. Erase Re-index: By selecting this mod, indexing is forced even if the page already has been indexed. . . .
. . .
last indexed, can leave domain, title, description, - URL Must include, URL must Not include. If settings have been modified in Admin section this mod should be selected to update the database. Spider can leave domain: By default, Sphider never leaves a given domain, so that links from domain.com pointing to domain2.com are not followed. By . . .
. . .
database. -eall Erase database and afterwards re-index all. -new Index all new URLs in database which had not jet been indexed. -erase Erase the content of the database. -erased Index all meanwhile erased sites. -preferred <level> Index with respect to preference level. -preall Set 'Last indexed' date and time to 0000. -u <url> Set . . .
. . .
different methods as described below. 3.2.1 Index only the new Index all new URLs in database which had not jet been indexed <-new> Simply start several threads and add individual IDs to the option parameter like php spider.php -new1 php spider.php -new2 etc. The IDs will be added to the name of the corresponding log files like: . . .
. . .
as described above 3.2.3 Index erased sites Index all meanwhile erased sites will index only those sites that had been individually or bulk erased. Multithreaded indexing could be invoked by starting several threads and adding individual IDs to the option parameter like: php spider.php -erased1 php spider.php -erased2 etc. The IDs will be added . . .
. . .
rel= nofollow > is ignored. Also if the nofollow flag is set in the header of a site, this link will not been followed. This directive could be temporary overwritten site specific for the next index procedure by the advanced option: Temporary ignore 'nofollow' directive 4.4 Ignoring parts of a page Sphider-plus includes an option to . . .
. . .
logging data. Requesting fresh data from the JavaScript file 'real_ping.js' , all new logging data will always been placed into <div id='realLogContainer' /> So, better not to press the 'Reload' button of your browser. The current <div /> might be already empty. /admin/real_ping.js Script that transfers requests from HTML client . . .
. . .
tables for database x' is an independent procedure, which has to be invoked by the Admin after the database has been allocated. Chapter Enhancing functionality of multiple database support will describe the reason for these two independent steps. If the database is allocated and the tables are installed, the message ' Database x settings are . . .
. . .
one or several of the currently available databases. If multiple sets of tables are available, because they have been created for a database before, you will be able to activate any of these table sets by selecting the corresponding prefix. The selection will be presented below the 'Store all selections' button for all databases containing more . . .

tables for database x' is an independent procedure, which has to be invoked by the Admin after the database has been allocated. If you don't get running this step 5, there is no database connection available for Sphider-plus containing the name of database, user name, password and database host. If the application should work with only one . . .
. . .
Top Updating from 4.x to 4.y 4.2021a : In order to become compatible with PHP 8.x, nearly all scripts have been modified. As also database has been altered, Spider plus needs to be installed completely new for full functionality of this release. Please perform a fresh installation like described in chapter 'New Installation'. 4.2021b : In . . .
. . .
to your database, the Admin access authorization. Be aware that the file 'userstyle.css' in all templates has been altered in this new Sphider-plus version. The additional line is something like: .submitBox { background: #fff; text-align: center; width:50% ; border:1px solid #070; border-radius: 10px; box-shadow: 10px 10px 3px #777; } Add . . .
. . .
to update to this version please follow the instructions as defined for version 4.2021b 4.2022c : As database has been altered, Spider plus needs to be installed completely new for full functionality of this release. Please perform a fresh installation like described in chapter 'New Installation'. Afterwards obligatory enter into the admin . . .
. . .
any of the 'Save' buttons. So you will get access to the new options of this version. 4.2022d : As database has been altered, Spider plus needs to be installed completely new for full functionality of this release. Please perform a fresh installation like described in chapter 'New Installation'. Afterwards obligatory enter into the admin . . .
. . .
please follow the instructions as defined for version 4.2021b 4.2023a : As nearly all scripts and database has been altered, Spider plus needs to be installed completely new for full functionality of this release. Please perform a fresh installation like described in chapter 'New Installation' Afterwards obligatory enter into the admin . . .
. . .
please follow the instructions as defined for version 4.2021b 4.2024a : As nearly all scripts and database has been altered, Spider plus needs to be installed completely new for full functionality of this release. Please perform a fresh installation like described in chapter 'New Installation' Please keep in mind that the update instructions . . .

Debugged version of v.2.6 Build up with Sphider: v.1.3.5 In front of version 2.6 the following modifications have been added: New Admin setting: Protect the /admin/ folder by means of a .htaccess file. If activated, and if the .htaccess file is not yet available, the script will automatically detect the IP of the admin and create your .htaccess . . .
. . .
ignored during index / re-index'. Bug fixed in 'Use blacklist to prevent index of pages'. Involved files that have been modified / added for this debug release: /search.php /search_ini.php /admin/admin.php /admin/configset.php /admin/spider.php /admin/spiderfuncs.php /admin/url_backup.php . . .
. . .
date: March 08, 2011 Build up with Sphider: v.1.3.5 In front of Sphider-plus version 2.5 the following items have been added / modified: New feature: Result output is available now also as an XML file. If requested in search.php script, the results will be presented as XML file in /xml/ For details see the documentation chapter: XML result . . .
. . .
Bug fixed in database 'Backup & Restore' function. Some additional small bugs removed. Involved files that have been modified / added for this release: /addurl.php /search.php /search_ini.php /admin/admin.php /admin/admin_header.php /admin/admin_footer.php /admin/auth.php /admin/configset.php /admin/db_main.php /admin/GeoIP.dat . . .

] Version v.2.1 Release date: September 03, 2009 In front of Sphider-plus version 2.0 the following items have been added / modified: New item in Admin settings: Perform a segmentation of Chinese and Korean text during index / re-index procedure. Will divide phrases like 帽子和服装 into the base words 帽子 and 和 and 服装 , so that all will become . . .
. . .
is undetectable, because it is not HTML standard conform or missing HTML tag, the index procedure will no longer been interrupted. Preferred charset as defined in Admin settings will be used for the involved link. Improved index / re-index procedure: If Sphider-plus is relocated by http 301 or 302, links found at the relocated site will also be . . .
. . .
to cooperate with PHP 5.3.x Error corrected de-language file. Thanks to Carl D. Erling Involved files that have been modified / added for this release: Nearly all, because of PHP 5.3 compatibility. In order to enable the two new items: - For new sites, as per default, the spider-depth is set to 'full'. - URLs will be accepted for a length of . . .

date: October 18, 2011 Build up with Sphider: v.1.3.5 In front of version 2.6 the following modifications have been added: New indexing feature: Re-indexing could be performed periodically. Once started, this mode will automatically re-index all sites periodically. The time interval is Admin selectable for 3 hours, 12 hours, 1 day, 1 week or . . .
. . .
links, category relationships and other dependencies, like registrations in temporary and pending tables, had been already observed before. Improved Admin search function: Searching for 'Sites', the result listing now will present also the 'Options' button to select Edit, Re-Index, Erase & Re-index, Erase, Delete, Pages, Browse and . . .
. . .
in option "Ignoring parts of a page by <;div id='abc'>;" for multiple nested divs. Involved files that have been modified / added for this release: /addurl.php /search_ini.php /admin/admin.php /admin/admin_header.php /admin/admin_search.php /admin/auto_index.php /admin/db_common.php /admin/configset.php /admin/index_media.php . . .

[ About Sphider-plus] More than 400 new features (additional mods, functions, template designs and debugging) have been added to the original Sphider. For details about all the improvements and changes, please read the Documentation section. [ Main features ] Item Description UTF-8 and UTF-16 support Indexation and search procedure for Chinese, . . .
. . .
will present a web shot as part of the text result listing. Created during index procedure for all URLs, which had been indexed on the Internet. Prevent indexing of known malware and pishing pages This feature is supplied by a Google web service, to prevent indexing of pages, suspected to contain malware or phishing content. 11 different modes of . . .

by Ando Saabas. In front of original Sphider additional mods, functions, template designs and debugging have been performed. For details about all changes, please notice the chapter Change Log The names of Sphider-plus folders and scripts are often the same like those of original Sphider. But the scripts are not interchangeable between . . .
. . .
are not interchangeable between Sphider and Sphider-plus. In front of original Sphider several messages have been added in the language files. You are invited to translate your native language and then to share the files with the community. Also mods, improvements and of course bug fixes are very welcome for future releases of Sphider-plus. . . .

version ] Version v.2.0 Release date: May 27, 2009 In front of Sphider-plus version 1.9 the following items have been added / modified: Multiple database support for up to 5 independent databases (expandable). Individual activation of one database for: - Admin - Search user - Suggest URL For more details, please notice chapter Multiple database . . .
. . .
in search results (if multiple occurrence is available on a page)" was activated. Involved files that have been modified / added for this release: Nearly all scripts. Attention: This release requires a fresh installation of all scripts and a blank MySQL database. An update from former Sphider-plus versions or an upgrade from original . . .

November 30, 2010 Build up with Sphider: v.1.3.5 In front of Sphider-plus version 2.4 the following items have been added / modified: New feature: Bound database. This option will delete all keyword relationships, exceeding a definable amount of query results. Beside the result cache, this option will significantly speed up the search . . .
. . .
important results, presented on the different result pages. Some small bugs eliminated. Involved files that have been modified / added for this release: /addurl.php /search.php /admin/admin.php /admin/admin_footer.php /admin/auth.php /admin/configset.php /admin/index_media.php /admin/install_tables.php /admin/spider.php /admin/spiderfuncs.php . . .