- discuss - lists.mariadb.org

[Maria-discuss] Backing up tables with data at rest encryption
by Lee Bennett 01 Jun '16

01 Jun '16

Hi We are in the process of setting up data at rest encryption encryption with MariaDB 10.1.13 so we can encrypt specific table. This works without any problem however when I try and backup with Percona Xtrabackup it fails saying table appears to be corrupted: 60601 14:53:46 [01] ...done 160601 14:53:46 [01] Streaming ./mytest/customers_big.ibd [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Database page corruption detected at page 1, retrying... 160601 14:53:46 >> log scanned up to (3146117051) [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Database page corruption detected at page 1, retrying... [01] xtrabackup: Error: failed to read page after 10 retries. File ./mytest/customers_big.ibd seems to be corrupted. [01] xtrabackup: Error: xtrabackup_copy_datafile() failed. [01] xtrabackup: Error: failed to copy datafile. This says to me that Xtrabackup isn’t compatible with MariaDB encryption however the documents kind of give the impression it is: https://mariadb.com/kb/en/mariadb/data-at-rest-encryption/ <https://mariadb.com/kb/en/mariadb/data-at-rest-encryption/> Regards Lee

3 3

[Maria-discuss] Long email about a replication issue
by Rhys.Campbell＠swisscom.com 01 Jun '16

01 Jun '16

Hi All, This weekend I had to repair a replication problem on one of our clusters. I've attempted to get to the root cause but not sure where I can go from here. Replication broke on Friday night because of foreign key errors. I initially retrieved the correct row, restarted replication, which then broke again due to a different tables FK error. I fixed this and then started replication again. All was well for an hour and then it broke again with a similar issue. We called it a night and decided to address on Saturday AM as there was no immediate production impact. The next day I discovered that records were missing from a bunch of tables so I recovered the cluster using a backup. I initially recovered the slaves attached to M2 from a backup but using the binlogs from M2. This caused the slaves to break. So instead I then recovered from the binlog on M1, before pointing them back to M2. This worked fine and everything in the cluster is currently well. Clearly something is wrong with the binlogs of M2. This is the first time I have seen this issue on the cluster that has been running fine for the last year. There have been no recent changes in the version of MariaDB or the applications using the cluster. We are running version 10.0.23-MariaDB-log. We are running replication with GTIDs, semi-sync repl between masters, and we run regular pt-table-checksum jobs. slave_sql_verify_checksum is on but master_sql_verify_checksum is off. The setup is M1<->M2 (with attached slaves). M1 is the active master receiving all writes. Access is controlled through an F5 and I don't think any errant transactions have occurred on the inactive master (M2). I've checked this by grepping the binlogs for the M2 server_id. The initial associated record that broke replication was attached to a "user" table record. This user was created on Friday at 16:21PM. Replication broke around 11:30PM that night. The user record had a GTID of GTID 0-1-36823254 (recovered from M1) I've looked into the appropriate binlog from M2... The head mysqlbinlog mysql-bin.002133 | grep GTID | head #160521 5:02:32 server id 1 end_log_pos 392 CRC32 0x97a118a8 GTID 0-1-36613622 #160521 5:02:32 server id 1 end_log_pos 768 CRC32 0x1859f6fb GTID 0-1-36613623 The tail... mysqlbinlog mysql-bin.002133 | grep GTID | tail #160528 11:58:04 server id 1 end_log_pos 103889368 CRC32 0x66e7c623 GTID 0-1-36851211 #160528 11:58:04 server id 1 end_log_pos 103971892 CRC32 0xe55c4842 GTID 0-1-36851212 If I grep for the specific GTID on M2 I get nothing... mysqlbinlog mysql-bin.002133 | grep "GTID 0-1-36823254"; <- Note the GTID is between the head & tail range. If I grep for this record by email address I also get nothing. So I must conclude this record (and a bunch of others), never got to master 2. We have pretty extensive monitoring of these servers and we should have been alerted to replication lag, locking etc but we got nothing until replication broke due to the FK errors. You would expect replication to break here because of a gap in the GTIDs. This did not happen and I'm almost certain that GTID replication could not have been deactivated and the positions messed around with. I'm unsure of where to go now. Any ideas? Any thoughts are appreciated. Regards, Rhys

2 2

[Maria-discuss] MariaDB 10.1.14 with galera results in Signal 11
by Bill Mair 27 May '16

27 May '16

A new install and instance crashes when I try to start it with galera, I don't know what I'm doing wrong. I built galera from source according to the instructions here: https:// mariadb.com/kb/en/mariadb/installating-galera-from-source/ I had to use "scons strict_build_flags=0" (warnings were being flagged up as errors). # uname -a Linux alarm 4.6.0-3-ARCH #1 Fri May 20 20:21:01 MDT 2016 armv7l GNU/Linux # grep wsrep /etc/mysql/my.cnf wsrep_on=ON wsrep_provider=/usr/lib/galera/libgalera_smm.so wsrep_cluster_address=gcomm://192.168.1.91,192.168.1.92,192.168.1.93 wsrep_node_address='192.168.1.91' wsrep_node_name='node1' wsrep_cluster_name='mariadb_cluster' wsrep_sst_method=rsync wsrep_provider_options=pc.bootstrap=true # sudo -u mysql mysqld --wsrep-new-cluster 2016-05-25 22:10:31 3061874688 [Note] mysqld (mysqld 10.1.14-MariaDB) starting as process 8527 ... 2016-05-25 22:10:31 3061874688 [Note] WSREP: Read nil XID from storage engines, skipping position init 2016-05-25 22:10:31 3061874688 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2016-05-25 22:10:31 3061874688 [Note] WSREP: wsrep_load(): Galera 3.16(rXXXX) by Codership Oy <info(a)codership.com> loaded successfully. 2016-05-25 22:10:31 3061874688 [Note] WSREP: CRC-32C: using "slicing- by-8" algorithm. 2016-05-25 22:10:31 3061874688 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1 2016-05-25 22:10:31 3061874688 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 192.168.1.91; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 2147483647; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.bootstrap = true; pc.checksum = false; pc.ignore_quo 2016-05-25 22:10:31 2908746768 [Note] WSREP: Service thread queue flushed. 2016-05-25 22:10:31 3061874688 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 2016-05-25 22:10:31 3061874688 [Note] WSREP: wsrep_sst_grab() 2016-05-25 22:10:31 3061874688 [Note] WSREP: Start replication 2016-05-25 22:10:31 3061874688 [Note] WSREP: 'wsrep-new-cluster' option used, bootstrapping the cluster 2016-05-25 22:10:31 3061874688 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 2016-05-25 22:10:31 3061874688 [Note] WSREP: protonet asio version 0 2016-05-25 22:10:31 3061874688 [Note] WSREP: Using CRC-32C for message checksums. 2016-05-25 22:10:31 3061874688 [Note] WSREP: backend: asio 2016-05-25 22:10:31 3061874688 [Note] WSREP: gcomm thread scheduling priority set to other:0 2016-05-25 22:10:31 3061874688 [Note] WSREP: restore pc from disk successfully 2016-05-25 22:10:31 3061874688 [Note] WSREP: GMCast version 0 2016-05-25 22:10:31 3061874688 [Note] WSREP: (8708eb25, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2016-05-25 22:10:31 3061874688 [Note] WSREP: (8708eb25, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2016-05-25 22:10:31 3061874688 [Note] WSREP: EVS version 0 2016-05-25 22:10:31 3061874688 [Note] WSREP: gcomm: bootstrapping new group 'mariadb_cluster' 2016-05-25 22:10:31 3061874688 [Note] WSREP: start_prim is enabled, turn off pc_recovery 2016-05-25 22:10:31 3061874688 [Note] WSREP: Node 8708eb25 state prim 2016-05-25 22:10:31 3061874688 [Note] WSREP: view(view_id(PRIM,8708eb25,17) memb { 8708eb25,0 } joined { } left { } partitioned { }) 2016-05-25 22:10:31 3061874688 [Note] WSREP: save pc into disk 2016-05-25 22:10:31 3061874688 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.1.91:4567 2016-05-25 22:10:31 3061874688 [Note] WSREP: discarding pending addr proto entry 0xb652e2a0 2016-05-25 22:10:31 3061874688 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.1.92:4567 2016-05-25 22:10:31 3061874688 [Note] WSREP: discarding pending addr proto entry 0xb652e380 2016-05-25 22:10:31 3061874688 [Note] WSREP: discarding pending addr without UUID: tcp://192.168.1.93:4567 2016-05-25 22:10:31 3061874688 [Note] WSREP: discarding pending addr proto entry 0xb652e460 2016-05-25 22:10:31 3061874688 [Note] WSREP: clear restored view 2016-05-25 22:10:31 3061874688 [Note] WSREP: gcomm: connected 2016-05-25 22:10:31 3061874688 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2016-05-25 22:10:31 3061874688 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2016-05-25 22:10:31 3061874688 [Note] WSREP: Opened channel 'mariadb_cluster' 2016-05-25 22:10:31 3061874688 [Note] WSREP: Waiting for SST to complete. 2016-05-25 22:10:31 2860512272 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2016-05-25 22:10:31 2860512272 [Note] WSREP: Starting new group from scratch: 1d570213-22bd-11e6-a70b-6aae917d4541 2016-05-25 22:10:31 2860512272 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 1d574d2d-22bd-11e6-8936-86e5eb8c6c4c 2016-05-25 22:10:31 2860512272 [Note] WSREP: STATE EXCHANGE: sent state msg: 1d574d2d-22bd-11e6-8936-86e5eb8c6c4c 2016-05-25 22:10:31 2860512272 [Note] WSREP: STATE EXCHANGE: got state msg: 1d574d2d-22bd-11e6-8936-86e5eb8c6c4c from 0 (node1) 2016-05-25 22:10:31 2860512272 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 0, members = 1/1 (joined/total), act_id = 0, last_appl. = -1, protocols = 0/7/3 (gcs/repl/appl), group UUID = 1d570213-22bd-11e6-a70b-6aae917d4541 2016-05-25 22:10:31 2860512272 [Note] WSREP: Flow-control interval: [16, 16] 2016-05-25 22:10:31 2860512272 [Note] WSREP: Restored state OPEN -> JOINED (0) 160525 22:10:31 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.1.14-MariaDB key_buffer_size=0 read_buffer_size=262144 max_used_connections=0 max_threads=153 thread_count=2 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 119520 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0xb65d7008 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0xad90edc4 thread_stack 0x48400 Trying to get some variables. Some pointers may be invalid and cause the dump to abort. 2016-05-25 22:10:31 2860512272 [Note] WSREP: Member 0.0 (node1) synced with group. 2016-05-25 22:10:31 2860512272 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0) Query (0x0): Connection ID (thread ID): 1 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_mer ge_intersection=on,index_merge_sort_intersection=off,engine_condition_p ushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_k eys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,se mijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subq uery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_w ith_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cach e_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimi nation=on,extended_keys=on,exists_to_in=on The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash.

2 4

[Maria-discuss] New Question: Can't configure using BUILD/autorun.sh, missing component
by AskMonty KB 26 May '16

26 May '16

Hello, A new question has been asked in "MariaDB Documentation" by Chico008. Please answer it at http://mariadb.com/kb/en/cant-configure-using-buildautorunsh-missing-compon… as the person asking the question may not be subscribed to the mailing list. -------------------------------- Hi I'm trying to install MardiaDB on a RH7 enterprise linux server, from the mariadb source (10.1.14) when trying to configure i got this error : CMake Error at storage/tokudb/PerconaFT/cmake_modules/TokuSetupCompiler.cmake:180 (message): /usr/bin/c++ doesn't support -std=c++11 or -std=c++0x, you need one that does. I already have the latest version, can your help ? -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/cant-configure-using-buildautorunsh-missing-compon…

1 0

[Maria-discuss] need help with “show engine innodb mutex” output
by Lukas Lehner 22 May '16

22 May '16

Hi https://dba.stackexchange.com/questions/139149/howto-read-interpret-show-en… thank you very much for explanations Lukas

1 0

[Maria-discuss] Bls: ask tool mariadb auto update latest for windows
by Irwanto 21 May '16

21 May '16

nice share mr. chris Pada Minggu, 22 Mei 2016 1:30, Chris Calender <chris.calender(a)mariadb.com> menulis: Hello, I have a custom .bat script I use on Windows which I use to upgrade both MariaDB and MySQL instances. It's not a supported 'tool' by any means, but works great for me in my Windows environment. You'll see 9 variables at the beginning which you will need to set for your environment, like basedir, datadir, config file, user, pass, port, service name, the download link, and download directory. I've attached it as a .txt file. Just edit those 9 variables, rename it to upgrade.bat, and invoke it from the command line: C:/location/of/file> upgrade.bat Once you have it set up for you instance, then future upgrades really only require you changing your download link. Beware I have all of the gnuwin32 utils, which this script uses, so you would either need those (e.g., wget, cp, mv, mkdir, unzip), or you would need to convert those commands to their native Windows equivalents. I also mention any caveats at the top of the file. In a nutshell, it downloads and unzips the package you specify. Then stops the service, copies out the old, replaces with the new, copies in existing datadir and config file, and then restarts the service. At the end, it runs mysql_upgrade, and then displays the new version number for your reference. Here is some sample output from an upgrade I just ran using it last night (from MariaDB 10.1.13 to 10.1.14). You can see at the end it took ~6 minutes, most of which was the download and extraction: ... inflating: C:\mysql/ma inflating: C:\mysql/ma +-----------------+ | version() | +-----------------+ | 10.1.13-MariaDB | +-----------------+ net stop "maria101" The maria101 service is stopping. The maria101 service was stopped successfully. rm -rf "C:\mysql\mariadb-10.1.14-winx64\data\*" cp -r "C:\Program Files\MariaDB 10.1\data\*" "C:\mysql\mariadb-10.1.14-winx64\data" cp "C:\Program Files\MariaDB 10.1\data\my.ini" "C:\mysql\mariadb-10.1.14-winx64\data" mkdir "C:\mysql\maria101-backup\" mv "C:\Program Files\MariaDB 10.1\*" "C:\mysql/maria101-backup/" mv "C:\mysql\mariadb-10.1.14-winx64\*" "C:\Program Files\MariaDB 10.1/" net start "maria101" The maria101 service is starting. The maria101 service was started successfully. mysql_upgrade.exe" -uroot -pxxx -P3316 Phase 1/6: Checking and upgrading mysql database Processing databases mysql mysql.column_stats OK .... test test.mem1 OK test.tbl_name OK Phase 6/6: Running 'FLUSH PRIVILEGES' OK +-----------------+ | version() | +-----------------+ | 10.1.14-MariaDB | +-----------------+ start=20:40:40.14 end = 20:46:59.55 Hope this helps. Best wishes, Chris -- Chris Calender, M.S., Principal Support Engineer MariaDB Corporation > On 5/13/2016 7:20 PM, Irwanto wrote: >> hi, >> i have 5-15 pc as server using mariadb. >> i always copy and update latest release one by one to server. >> is there any tool to download, stop service and extract update my >> mariadb in windows. >> maybe some one know it >> >> thanks b4 >> >> >> >> _______________________________________________ >> Mailing list: https://launchpad.net/~maria-discuss >> Post to : maria-discuss(a)lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-discuss >> More help : https://help.launchpad.net/ListHelp

1 0

[Maria-discuss] New Question: Format of GRANT ALL PRIVELEGES command
by AskMonty KB 19 May '16

19 May '16

Hello, A new question has been asked in "Getting, Installing, and Upgrading MariaDB" by mark_watts_g. Please answer it at http://mariadb.com/kb/en/format-of-grant-all-priveleges-command/ as the person asking the question may not be subscribed to the mailing list. -------------------------------- What is format of this command in version 10.1.8 -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/format-of-grant-all-priveleges-command/

1 0

[Maria-discuss] Encryption
by Ghazi Btissam 16 May '16

16 May '16

Hi, -Oracle has the tablespace feature ,does MariaDb has the same feature ? -If yes how MariaDb encrypt a tablespace ? Thanks

2 1

[Maria-discuss] ask tool mariadb auto update latest for windows
by Irwanto 15 May '16

15 May '16

hi,i have 5-15 pc as server using mariadb.i always copy and update latest release one by one to server.is there any tool to download, stop service and extract update my mariadb in windows.maybe some one know it thanks b4

4 3

[Maria-discuss] New Question: how to create fake DATA inside MariaDB SQL database???
by AskMonty KB 14 May '16

14 May '16

Hello, A new question has been asked in "MariaDB Community" by cyberdome. Please answer it at http://mariadb.com/kb/en/how-to-create-fake-data-inside-mariadb-sql-databas… as the person asking the question may not be subscribed to the mailing list. -------------------------------- Hello World, I am trying to create some TEST DATA, meaning fake date for playing around with MariaDB tables and databases. I need to create some fake random data using SQL RDBMS. So, why not use Mockaroo.com , but on that website I can only do 1000 rows at one time. Which is extremely time consuming. How can I create random fake data. Tons of it. For example, Let us say I want 2 millions rows of random data with ID, NAME, ADDRESS, PHONE, EMAIL. I hope I am making sense. Any help is greatly appreciated!!!!! Thanks __________________ __________________ Linux Newbie - Information is Power! Download Linux @ http://www.fedora.redhat.com/ May the Linux force be with you! Fedora 23 - MariaDB 10.1 -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/how-to-create-fake-data-inside-mariadb-sql-databas…

1 0