- discuss - lists.mariadb.org

[Maria-discuss] Need input on crashes on 3rd mariaDB server
by Jeroen Andriessen 30 Jul '14

30 Jul '14

Hi all, We’re currently using a system with three clustered maria-db masters. We are experiencing occasional (once every three weeks or so) crashes of one of the server, namely our third server, which we use as a dedicated donor for the other two. The crashes point to a BF-BF X lock conflict in the same table. I was wondering how to proceed with identifying and localising the problem and counteracting it. We have already tried to rebuild the database in question from an earlier mysql dump, to no effect. Any input is welcome, thanks. —— BF-BF X lock conflict RECORD LOCKS space id 36361 page no 10 n bits 264 index `***REDACTED***` of table `***REDACTED***`.`***REDACTED***` trx id D860A49 lock_mode X locks rec but not gap 140724 6:10:53 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see http://kb.askmonty.org/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 5.5.38-MariaDB-wsrep-log key_buffer_size=134217728 read_buffer_size=131072 max_used_connections=7 max_threads=1002 thread_count=20 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2329723 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0x7f57b3412000 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f5c1a16b940 thread_stack 0x48000 (my_addr_resolve failure: fork) /usr/sbin/mysqld(my_print_stacktrace+0x2b) [0xa95bab] /usr/sbin/mysqld(handle_fatal_signal+0x398) [0x6ebc58] /lib64/libpthread.so.0() [0x34e7e0f710] /lib64/libc.so.6(gsignal+0x35) [0x34e7632925] /lib64/libc.so.6(abort+0x175) [0x34e7634105] /usr/sbin/mysqld() [0x50e940] /usr/sbin/mysqld() [0x92c0ff] /usr/sbin/mysqld() [0x931799] /usr/sbin/mysqld() [0x932566] /usr/sbin/mysqld() [0x968a65] /usr/sbin/mysqld() [0x85fe3b] /usr/sbin/mysqld() [0x863ada] /usr/sbin/mysqld() [0x8642de] /usr/sbin/mysqld() [0x84e571] /usr/sbin/mysqld() [0x8337b2] /usr/sbin/mysqld(handler::ha_delete_row(unsigned char const*)+0xb0) [0x6f3640] /usr/sbin/mysqld(Delete_rows_log_event::do_exec_row(Relay_log_info const*)+0x10d) [0x7a41dd] /usr/sbin/mysqld(Rows_log_event::do_apply_event(Relay_log_info const*)+0x26a) [0x798e2a] /usr/sbin/mysqld(wsrep_apply_cb(void*, void const*, unsigned long, unsigned int, wsrep_trx_meta const*)+0x598) [0x69f988] /usr/lib64/galera/libgalera_smm.so(galera::TrxHandle::apply(void*, wsrep_cb_status (*)(void*, void const*, unsigned long, unsigned int, wsrep_trx_meta const*), wsrep_trx_meta const&) const+0xb1) [0x7f5c197462c1] /usr/lib64/galera/libgalera_smm.so(+0x1aaf95) [0x7f5c1977df95] /usr/lib64/galera/libgalera_smm.so(galera::ReplicatorSMM::apply_trx(void*, galera::TrxHandle*)+0x283) [0x7f5c1977ee03] /usr/lib64/galera/libgalera_smm.so(galera::ReplicatorSMM::process_trx(void*, galera::TrxHandle*)+0x45) [0x7f5c1977f6f5] /usr/lib64/galera/libgalera_smm.so(galera::GcsActionSource::dispatch(void*, gcs_action const&, bool&)+0x2c9) [0x7f5c1975c349] /usr/lib64/galera/libgalera_smm.so(galera::GcsActionSource::process(void*, bool&)+0x63) [0x7f5c1975c823] /usr/lib64/galera/libgalera_smm.so(galera::ReplicatorSMM::async_recv(void*)+0x93) [0x7f5c1977b3f3] /usr/lib64/galera/libgalera_smm.so(galera_recv+0x23) [0x7f5c19790743] /usr/sbin/mysqld() [0x6a037f] /usr/sbin/mysqld(start_wsrep_THD+0x365) [0x527415] /lib64/libpthread.so.0() [0x34e7e079d1] /lib64/libc.so.6(clone+0x6d) [0x34e76e8b5d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x0): is an invalid pointer Connection ID (thread ID): 17 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=off The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 140724 06:10:53 mysqld_safe Number of processes running now: 0 140724 06:10:53 mysqld_safe WSREP: not restarting wsrep node automatically 140724 06:10:53 mysqld_safe mysqld from pid file /var/lib/mysql/***hostnameredacted***.pid ended

1 0

[Maria-discuss] cross-compiling mariadb-galera
by Sylvain Raybaud 25 Jul '14

25 Jul '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Dear MariaDB community, I've got a question regarding the cross-compilation of MariaDB. More specifically I'm trying to create a buildroot package for MariaDB Galera cluster. I added mariadb-galera to buildroot/package/Config.in and created a folder buildroot/package/mariadb-galera containing the following files (normal buildroot procedure): buildroot/package/mariadb-galera/Config.in buildroot/package/mariadb-galera/mariadb-galera.mk mariadb-galera.mk contains, among other things: MARIADB_GALERA_CONF_OPT = -DCMAKE_CROSSCOMPILING=1 -DWITH_WSREP=ON - -DWITH_INNODB_DISALLOW_WRITES=1 I'm building for Raspberry Pi. I'm using version 10.0.12. The build fails with: CMake Error at storage/xtradb/CMakeLists.txt:434 (MESSAGE): Percona XtraDB is not supported on this platform This error is trigger in storage/xtradb/CMakeLists.txt when XTRADB_OK is not set; it seems to me that XTRADB_OK is set in either one of the following cases: 1) CMAKE_CROSSCOMPILING is NOT set and some tests are successful (thus setting HAVE_IB_GCC_ATOMIC_BUILTINS) or 2) We're compiling for MSVC or CMAKE_SYSTEM_NAME is "SunOS" and some other conditions are met. Since I'm not compiling for MSVC or SunOS and I'm crosscompiling indeed, XTRADB_OK is not set and the error is triggered. Here I'm stuck. I've got the feeling that as such one cannot cross-compile xtradb because XTRADB_OK will never be set; or maybe with proper options passed to cmake the tests would be made elsewhere and HAVE_IB_GCC_ATOMIC_BUILTINS would be set beforehand? Or maybe I should patch this CMakeLists.txt? Or maybe I should just compile without xtradb altogether, if that's possible? Any guidance would be appreciated. Cheers, Sylvain Raybaud PS: I was not sure whether to post this on -discuss or -devel so I opted for the most general list. Don't hesitate to ask me to repost elsewhere if you feel this would be more appropriate. - -- Sylvain Raybaud www.green-communications.fr -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJT0hcjAAoJEEkkwl4JtJ9yJx8P/3tGWbYBK+WFAmG0qWH8AJkI UjwNkNBri+p7GwaaHl/cnNrerTaNSFsRrusUvwr9UwSjn2xZgsYd+v/I97tMzORi sjLFYt7JM42/Hm3PmMshpr+B+8CX3oZ9NQa/vy6sJ4jZrYZ/GsjsFMB14HD8FG0I qbySRVxssrixl856ZVPae9W1aVK06oEAiANAQhZ/+ZJOdIMKB+32rXfdDHJR8jGA pseZG74xoZfjWkNQ0D4qmZfkJpeAk1wR1mAU1QE5nFSauvjqGEgYzzUokh3Tp/2/ zyl+dMgu6eG3rl+zrF8Pf6cDoLr2cM6SjlTq4ggMVITLl0CT6x2r9xJQVe8XdqrM LDAhjeHhzKrPbq3AmKKX3UBTj+01v/VdSp3ro73I4ruu8g6XSqF+2DQAOqLZ4qDH 66KZLewagdsuekwCx07jDHRFg840lKchUhXxtuu8GLb1KFIgdbYa4th2rP1U+idf NFHYmOMVyOE20hYa1F4mOI0bAYHThY3oqr4SxnqVYVl6+Rxu9OfBEEfkTi1i4wTz S807RR4N7LC7SbiNxaU3DULycZIDysaOv6f5xoJf8VvUBCis0cwahYzqUj1B97p9 fAYmEhmS7W/YS0R56dhi2S7v//VNbdpLhmpIXPhmwHjvBeyBoEskXovHcdu1wgSQ 58S1ykhVWcHgNpXvZa55 =OFL8 -----END PGP SIGNATURE-----

1 0

[Maria-discuss] race conditions after SIGTERM
by Reindl Harald 24 Jul '14

24 Jul '14

how can that script lead to a race condition where files are not fully written to disk? that never happens if the systemd-unit for the replication instance has "ExecStopPost=/usr/bin/sleep 1" and waits a while my only explaination is that mysqld returns after the SIGTERM from systemd before all data are completly written in some racy situations and so rsynced incompletly to the datadir of the other instance _________________________________________________________ #!/bin/bash systemctl stop replication.service systemctl stop mysqld.service rsync $RSYNC_PARAMS /mysql_replication/ /mysql_data/ systemctl start replication.service systemctl start mysqld.service _________________________________________________________ [Unit] Description=MariaDB Replication [Service] Type=simple PIDFile=/run/mysqld/mysqld_replication.pid ExecStart=/usr/libexec/mysqld --defaults-file=/etc/my-replication.cnf --pid-file=/run/mysqld/mysqld_replication.pid --socket=/var/lib/mysql/mysql_replication.sock --open-files-limit=30000 --basedir=/usr --user=mysql Environment="LANG=en_GB.UTF-8" Restart=always RestartSec=1 _________________________________________________________ 140724 12:22:59 [Note] /usr/libexec/mysqld: Shutdown complete 140724 12:23:01 [Note] Plugin 'InnoDB' is disabled. Cannot find checkpoint record at LSN (1,0x35767) 140724 12:23:01 [ERROR] mysqld: Aria recovery failed. Please run aria_chk -r on all Aria tables and delete all aria_log.######## files 140724 12:23:01 [ERROR] Plugin 'Aria' init function returned error. 140724 12:23:01 [ERROR] Plugin 'Aria' registration as a STORAGE ENGINE failed. 140724 12:23:01 [Note] Plugin 'FEDERATED' is disabled. 140724 12:23:01 [Note] Plugin 'FEEDBACK' is disabled. 140724 12:23:01 [ERROR] Aria engine is not enabled or did not start. The Aria engine must be enabled to continue as mysqld was configured with --with-aria-tmp-tables 140724 12:23:01 [ERROR] Aborting 140724 12:23:01 [Note] /usr/libexec/mysqld: Shutdown complete 140724 12:23:03 [Note] Plugin 'InnoDB' is disabled. Cannot find checkpoint record at LSN (1,0x35767)

1 0

[Maria-discuss] New Question: ST_Transform missing?
by AskMonty KB 24 Jul '14

24 Jul '14

Hello, A new question has been asked in "MariaDB community" by ronna: -------------------------------- Hi there, I just started using MariaDB. Mainly because of the support for GIS. But now I am trying to reproject some geometric objects and I find out there is no ST_Transform function? How can this be? I need it ;-) Is there another function for it? Or will there be support for it soon? I am now using 10.0.11 Thanks for the reply. Ron. -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/st_transform-missing/

1 0

[Maria-discuss] MariaDB 10.1 as drop in replacement for mysql55-server-5.5.38-1.ius.el5
by Eero Volotinen 23 Jul '14

23 Jul '14

Hi List, Is it possible to use MariaDB 10.1 as drop-in replacement for mysql55-server-5.5.38-1.ius.el5? like: rpm -e mysql55.. files and then just use yum to install mariadb without reinstalling databases content? br, -- Eero

1 0

[Maria-discuss] Aria engine
by Roberto Spadim 22 Jul '14

22 Jul '14

Hi guys Why aria engine is a beta/alpha engine? -- Roberto Spadim SPAEmpresarial Eng. Automação e Controle

2 4

[Maria-discuss] Galera cluster with asynchronous slave
by Johnny Antonsen 21 Jul '14

21 Jul '14

Hi! First off let show you what we are trying to achieve, as a picture says more than a thousand words. galera I'm currently working on a high-availability project where we want to use MariaDB 10 and Galera as the backend. Running this system as it is with Haproxy and keepalived works great. We are able to write to the VIP that is being moved between each node and haproxy takes care of redirecting the server with least connections. The problem comes when we want to do a standard master/slave replication from the cluster to an external slave. The slave is set up to connect to the VIP (or I have also been testing with connecting directly to the haproxied ip), and Using_gtid is set to Slave_pos. However, after some time, once the connection changes to a different node through haproxy, the following error occurs: Got fatal error 1236 from master when reading data from binary log: 'Error: connecting slave requested to start from GTID 3-1-422, which is not in the master's binlog' And the Slave_IO_State shows that it's no longer in sync. I have run SELECT @@GLOBAL.gtid_slave_pos; to check what the current GTID for each node is, and they all return: 1-1-2145, however, sometimes if I add a lot of data, that value is different on some nodes, which is why I think the slave gets confused. On the slave, when activating using_gtid=slave_pos, the following gtid_IO_pos appear: 1-1-2464,2-3-420,3-1-422 From what I have read, this should be somewhat correct, as the first value is the server id. However, in the config I have specified that node 1 has server id 1, node 2 has id 2 and so on, and that the same goes for gtid_domain_id. Is this the correct setup or do the nodes need to have the same server-id or gtid_domain_id? Surely there must be a good way to solve this? Is the system not built to handle an asynchronous slave replicating from one random node? Hope I can get some good feedback on this. Just as a side-note, I'm fairly new to mariadb and galera cluster, so be gentle :) With best regards Johnny Antonsen

3 5

[Maria-discuss] MariaDB 10.0 + Master/Slave + spontanous Got fatal error 1236
by Erik Wasser 18 Jul '14

18 Jul '14

Hello *, I'm doing a master/slave setup in 2 OpenVZ hosts both with debian 7 and MariaDB 10.0 from the offical repository. The problem is that the slave sometimes bails out with the following error message: Got fatal error 1236 from master when reading data from binary log: 'binlog truncated in the middle of event; consider out of disk space on master; the first event 'mysql-bin.000073' at 33590521, the last event read from 'mysql-bin.000073' at 39362449, the last byte read from 'mysql-bin.000073' at 39362560.' Okay, no problem I start the replication with "START SLAVE" but the next error occurs within 5 minutes or so: Got fatal error 1236 from master when reading data from binary log: 'binlog truncated in the middle of event; consider out of disk space on master; the first event 'mysql-bin.000073' at 39362449, the last event read from 'mysql-bin.000073' at 48667806, the last byte read from 'mysql-bin.000073' at 48668672.' Sometimes it runs so for a week sometimes it fails 3 times within 15 minutes. It seems that the slave read some data and but the master havn't finished writing the data to the binlog. That should be impossible. So after starting the slave again everything is fine again. I can start the replication again with "START SLAVE" and everything is fine again for some times until the error appears again. And it's not that I'm running out of disc space I'm running here out of ideas. B-) Some other info: [mysqld] ... binlog-ignore-db = mysql binlog-ignore-db = test server_id = 10 log_bin = mysql-bin read_only = yes sync_binlog = 1 binlog_format = MIXED expire_logs_days = 14 max_allowed_packet = 1047527424 Any other "esoteric" ideas? -- Greetings... Erik Wasser

1 0

Re: [Maria-discuss] Increasing InnoDB page size in 10.1
by Tim Callaghan 15 Jul '14

15 Jul '14

Thanks, that is helpful. It would be good to capture this (and any other technical advantages) in the KB page itself. On Tue, Jul 15, 2014 at 3:44 AM, Jan Lindström <jan.lindstrom(a)skysql.com> wrote: > Hi, > > We had a customer request to increase the page size for uncompressed pages > to allow more blob fields in a table. This request is satisfied by this > implementation. While I was doing this enhancement, I did try to increase > the page size for compressed pages also but this proved too hard for time > constraints I had. I did try to discuss about the problems with only person > I know who really knows how compressed pages storage format is implemented > (Marko Mäkelä) but unfortunately, I did not get it to work with limited > help I received. As soon as I have again time, I will revisit this issue > and see what I can do. > > R: Jan > > > On Mon, Jul 14, 2014 at 4:07 PM, Tim Callaghan <tmcallaghan(a)gmail.com> > wrote: > >> I'm curious as to the reasoning behind this feature. I assumed it was to >> get better compression, but the kb page >> <https://mariadb.com/kb/en/mariadb/mariadb-documentation/mariadb-storage-eng…> >> states that compression will not be supported on the new 32K and 64K page >> size. >> >> -Tim Callaghan >> >> >> _______________________________________________ >> Mailing list: https://launchpad.net/~maria-discuss >> Post to : maria-discuss(a)lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-discuss >> More help : https://help.launchpad.net/ListHelp >> >> > > > -- > > -- > > Jan Lindström, Principal Engineer > SkySQL - The MariaDB Company > > skype: jan_p_lindstrom > > www.skysql.com > <http://www.google.com/url?q=http%3A%2F%2Fwww.skysql.com%2F&sa=D&sntz=1&usg=…> > > [image: Twitter] > <http://www.google.com/url?q=http%3A%2F%2Ftwitter.com%2Fskysql&sa=D&sntz=1&u…> > [image: Blog] > <http://www.google.com/url?q=http%3A%2F%2Fwww.skysql.com%2Fblog%2F&sa=D&sntz…> > [image: Facebook] > <http://www.google.com/url?q=http%3A%2F%2Fwww.facebook.com%2Fskysql&sa=D&snt…> > [image: LinkedIn] > <http://www.google.com/url?q=http%3A%2F%2Fwww.linkedin.com%2Fcompany%2F12142…> > [image: Google+] <https://plus.google.com/117544963211695643458/posts> >

2 1

[Maria-discuss] maridb performance issue with master server replication
by Zakir Mahomedy 14 Jul '14

14 Jul '14

I been trying to trouble shoot this problem for sometime now in both mariadb and percona. I been trying to migrate from Mysql5.6 to mariadb or percona, however in our testings our business app performs terrible when multi master circular replication is on. Our setup, 2 servers same specs, running vmsphere 5.5. VMs are created and CentOs 6.5 installed. On the same hardware, same VM setups, we are running Mysql 5.6 com edition with GTID circular replication with no problems in performance. With Mariadb and Percona as soon as I start slave, the master server performs badly with our business app. If I had to run the same business app on the slave machine, while its receiving updates, no problems, but as soon as I make it a Master the performance drops. While all the binary logging stuff are on, without replication turned on by using start slave; the app performs fine as some people suggested that there might be a performance hit with sync-binlogs etc Ive started a thread about this on dba.stack which has my config files etc posted. http://dba.stackexchange.com/questions/71188/slow-writes-on-percona-server-… This is so far the only issue that is stopping us from migrating to mariadb, and its driving me nuts. Our servers are going through a vpn and is lagging 0 seconds behind master Does anyone have an idea what may be the problem. thanks zak |

1 0