[Maria-discuss] MariaDB and TLB misses / Large Pages
Hello all, is there a reliable cookbook / checklist to implement Large Tables on a SuSE SLES 12 SP1 Linux distribution? I find there there is a lot of old/inaccurate/dodgy information on my search machine travels. The test setup is as follows- Everything enabled for Large Pages as per various online Fora. 128GB RAM 72GB InnoDB buffer size, eight instances. MariaDB is DB is defined in a 52GB RAM disk. (This is a test to tie down TLB and Lx cache misses and high CPU next activity) Any pointers/hints most welcome. Regards, JC John Cassidy Obere Bühlstrasse 21 8700 Küsnacht (ZH) Switzerland / Suisse / Schweiz Mobile: +49 152 58961601 (Germany) Mobile: +352 621 577 149 (Luxembourg) Mobile: +41 78 769 17 97 (CH) Landline: +41 44 509 1957 Mobile email: mobile@jdcassidy.eu http://www.jdcassidy.eu "Aut viam inveniam aut faciam" - Hannibal.
The MySQL Manual gives good pointers about TLB settings that should apply to MariaDB as well: https://dev.mysql.com/doc/refman/5.6/en/large-page-support.html Le jeu. 20 oct. 2016 à 20:33, J. Cassidy <sean@jdcassidy.eu> a écrit :
Hello all,
is there a reliable cookbook / checklist to implement Large Tables on a SuSE SLES 12 SP1 Linux distribution?
I find there there is a lot of old/inaccurate/dodgy information on my search machine travels.
The test setup is as follows-
Everything enabled for Large Pages as per various online Fora.
128GB RAM
72GB InnoDB buffer size, eight instances.
MariaDB is DB is defined in a 52GB RAM disk. (This is a test to tie down TLB and Lx cache misses and high CPU next activity)
Any pointers/hints most welcome.
Regards,
JC
John Cassidy
Obere Bühlstrasse 21 8700 Küsnacht (ZH) Switzerland / Suisse / Schweiz
Mobile: +49 152 58961601 <+49%201525%208961601> (Germany) Mobile: +352 621 577 149 <+352%20621%20577%20149> (Luxembourg) Mobile: +41 78 769 17 97 <+41%2078%20769%2017%2097> (CH) Landline: +41 44 509 1957 <+41%2044%20509%2019%2057> Mobile email: mobile@jdcassidy.eu
"Aut viam inveniam aut faciam" - Hannibal._______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
Am 21.10.2016 um 18:16 schrieb Guillaume Lefranc:
The MySQL Manual gives good pointers about TLB settings that should apply to MariaDB as well: https://dev.mysql.com/doc/refman/5.6/en/large-page-support.html
we had that long in use on MySQL adn with unchanged settings MariaDB logged that it failed and it is falling back to conventional allocation besides that *this* way of large pages (/proc/sys/vm/hugetlb_shm_group) is horrible for a ton of reasons * more than one application - they all need to share a group * very difficult to calculate (/proc/sys/vm/nr_hugepages) * if it's too low and dataset grosws it will fail later silently * if it's too large you waste memory and end in OOM at worst that's really not a considerable solution in 2016
Le jeu. 20 oct. 2016 à 20:33, J. Cassidy <sean@jdcassidy.eu <mailto:sean@jdcassidy.eu>> a écrit :
Hello all,
is there a reliable cookbook / checklist to implement Large Tables on a SuSE SLES 12 SP1 Linux distribution?
I find there there is a lot of old/inaccurate/dodgy information on my search machine travels.
The test setup is as follows-
Everything enabled for Large Pages as per various online Fora.
128GB RAM
72GB InnoDB buffer size, eight instances.
MariaDB is DB is defined in a 52GB RAM disk. (This is a test to tie down TLB and Lx cache misses and high CPU next activity)
Any pointers/hints most welcome.
participants (3)
-
Guillaume Lefranc -
J. Cassidy -
Reindl Harald