ITCooky Recipes

Lets cooky it yammy things!

Test of the search engines Sphinx and Manticore for the phpBB3 forum!

дата November 15, 2019

Once again, I saved my forum from freezes by installing a search through Sphinx and was satisfied with everything, but here in the English version of the articleLets install a super fast search engine Sphinx in to phpBB3 forum! they asked me – Why not Manticore?

Manticore, a monster with a lion’s body, human head and scorpion tail, apparently symbolizes the torment of the developers of this engine! But, as I understand it, it is Sphinx itself, its first open source version (which I managed to install Sphinx 2.2.11-release Jul 19, 2016), which the creators left it, and the Manticores picked it up and they continued to develop it! All the advantages are described here:manticoresearch.com/manticore-vs-sphinx/ the main thing for me is that, unlike Sphinx2, it continues to improve.

I take the MySQL base of my forum and run it in a virtual machine. These are the characteristics of the database:

2,000,000 posts and this is a big problem for phpBB3 native search engines!

Install Manticora
I follow the instructions docs.manticoresearch.com/latest/html/installation.html#

yum install mysql-libs postgresql-libs expat unixODBC
yum install http://repo.manticoresearch.com/manticore-repo.noarch.rpm

look if a new repository has appeared
yum repolist
error

http://repo.manticoresearch.com/repository/manticoresearch/release/centos/6/i386/repodata/repomd.xml: [Errno 14] PYCURL ERROR 22 - "The requested URL returned error: 404 Not Found"

Wow It doesn’t work, not immediately, but I understood why, I have 32-bit CentOS 6 and Manticore is only for 64-bit!
This repository has broken the entire installation in CentOS 6. I have to repaire it:
cd /etc/yum.repos.d/
rm repo.manticoresearch.com_manticore-repo.noarch.rpm.repo
rm manticore.repo
yum clean all

…I went to install 64-bit CentOS, but now it purely scientific interest, for my VPS with 2 GB of memory, naturally with 32-bit Centos, naturally Manticore is useless!

Install Manticora en CentOS 7 64bit
yum install mysql-libs postgresql-libs expat unixODBC
yum install http://repo.manticoresearch.com/manticore-repo.noarch.rpm
yum install manticore

Hey what are you doing!

Erasing    : sphinx-2.2.11-1.rhel7.x86_64  

Ok!

Manticore completely replaced the Sphinx
searchd --config /etc/sphinx/sphinx.conf
show

Manticore 3.2.0 e526a01@191017 release
Copyright (c) 2001-2016, Andrew Aksyonoff
Copyright (c) 2008-2016, Sphinx Technologies Inc (http://sphinxsearch.com)
Copyright (c) 2017-2019, Manticore Software LTD (http://manticoresearch.com)

using config file '/etc/sphinx/sphinx.conf' (7314 chars)...
WARNING: key 'docinfo' was permanently removed from configuration. Refer to documentation for details.
FATAL: failed to lock pid file '/usr/www/sphinx/searchd.pid': Resource temporarily unavailable (searchd already running?)
shutdown complete

Sphinx has already been configured in phpBB3, so you don’t need to configure anything!
I clean the folders
/usr/www/sphinx/
/usr/www/sphinx/log/

The folders themselves remain

I start the main indexing with the time measurement (at the end and at the beginning it gives time)
date&&indexer --config /etc/sphinx/sphinx.conf index_phpbb_819ad66b94720731_main&&date
I did the same with the sphinx in this configuration, the base size 3.28 GiB with 2083415 posts and the time is
Sphinx: 2:49 min
Manticore: 2:40 min

We also need to do
indexer --config /etc/sphinx/sphinx.conf index_phpbb_819ad66b94720731_delta
restart and run the Sphinx uh … I mean the Manticora, the command is the same!
reboot
searchd --config /etc/sphinx/sphinx.conf

I do not add it to automatic loading here, for the test it is not necessary!

In the forum I start debugging, I make requests and see how long it takes to generate the page.

*VPS – a real VPS, base already grew a bit, at the time of the test there were 170 users in the forum in 5 minutes: CentOS 6.10 32bit, 50 Gb SSD, CPU 2 × 2 GHz, 2048 mb
*VM – CentOS 7.7 64bit, CPU 2, 2048 mb

Conclusion: For now I choose the old Sphinx 2
1) There is a 32-bit version for CentOS
2) Apparently, Manticore and Sphinx have the same speed, but it is strange that they have not far exceeded a real forum in a 5 word search!


One Response to “Test of the search engines Sphinx and Manticore for the phpBB3 forum!”

  1. I’ve checked with the developers – Manticore can be compiled in a 32 bit architecture, it’s just that we do not provide the builds as mostly nobody is using 32 bit architectures anymore (and nobody asked). But it should work fine if you build it yourself (except for the limits that come with the 32 bits – 4GB max for .sps/.spb and others). In case you decide to build here’s how to – https://docs.manticoresearch.com/latest/html/installation.html#compiling-manticore-from-source

Leave a Reply to Sergey Nikolaev Cancel reply

Your email address will not be published. Required fields are marked *