- discuss - lists.mariadb.org

[Maria-discuss] DBMS vs Storage Engine Alone
by Jonathan M. Wilbur 20 Dec '22

20 Dec '22

Sorry to ask this question here, since it is not strictly MariaDB-related, but I need the knowledge of people that develop with databases: is there significant overhead to using a DBMS versus a storage engine directly? I have a project for which speed / latency is very important, and I was wondering if I could make significant performance gains by using a storage engine (such as WiredTiger, RocksDB, LevelDB, etc.) directly instead of using a DBMS (like MariaDB). More concretely, are there any studies out there on this to give me some objective numbers on this? Assume it is over a local loopback connection, so pretty much only the overhead of the networking itself would apply. Thank you in advance, - Jonathan M. Wilbur

4 3

[Maria-discuss] flush tables with read lock blocks
by Alex 13 Dec '22

13 Dec '22

Hi, I'm using mariadb-10.5.18-1.fc37.x86_64 on fedora37 set up as a master server. There are currently two or three slaves configured and operating properly. I'm trying to add another slave, and for some reason when I try to flush tables with read lock, then dump the databases to be transferred to the new slave, mysqldump just prints: -- Connecting to localhost... At first I didn't realize it, but soon the database stopped responding to all clients until I released the lock with "unlock tables". I'm following these directions: https://mariadb.com/kb/en/setting-up-replication/ What could I be doing wrong? Here are the my.cnf options that I believe could be related to my issue. Any ideas greatly appreciated. The server has 128GB of RAM. [mysqld] sql_mode=ONLY_FULL_GROUP_BY character-set-client-handshake = FALSE character-set-server = utf8mb4 collation-server = utf8mb4_unicode_ci max_connections=1000 replicate_do_db='repdb' replicate_do_db='sbclient' port = 3306 socket = /var/lib/mysql/mysql.sock skip-external-locking key_buffer_size = 256M max_allowed_packet = 512M join_buffer_size = 2M read_rnd_buffer_size = 4M myisam_sort_buffer_size = 64M query_cache_size = 400000000 query_cache_type = 1 query_cache_strip_comments = 1 relay_log_space_limit = 500M relay_log_purge = 1 log-slave-updates = 1 local_infile = OFF binlog_format = ROW max_heap_table_size = 2048M tmp_table_size = 2048M relay-log=myserver-relay-bin log_bin = /var/log/mariadb/mysql-bin.log log_warnings = 1 expire_logs_days = 2 max_binlog_size = 500M plugin_load=server_audit=server_audit.so plugin_load_add = query_response_time server_audit_events=connect,query server_audit_file_path = /var/log/mariadb/server_audit.log server_audit_file_rotate_size = 1G server_audit_file_rotations = 1 slow-query-log = 1 slow-query-log-file = /var/log/mariadb/mariadb-slow.log long_query_time = 1 log_error = /var/log/mariadb/mariadb-error.log skip-networking=0 binlog_format=mixed server-id = 590

2 2

Re: [Maria-discuss] Maria-db refuses to start
by Jogchum Reitsma 12 Dec '22

12 Dec '22

Op 08-11-2022 om 13:04 schreef Marko Mäkelä: > Hi Jogchum, > > On Tue, Nov 8, 2022 at 1:21 PM Jogchum Reitsma > <jogchum.reitsma(a)gmail.com> wrote: > [...] >> 2022-11-08 12:06:17 0 [Warning] 'innodb-file-format' was removed. It does nothing now and exists only for compatibility with old my.cnf files. >> (repeated several times) >> 2022-11-08 12:06:17 0 [ERROR] /usr/local/mariadb-10.6.10-linux-systemd-x86_64/bin/mariadbd: unknown option '--skip-locking' >> 2022-11-08 12:06:17 0 [ERROR] Aborting > Was that the end of the output? No shutdown message from InnoDB, like this? > > 2022-11-08 14:03:03 0 [Note] InnoDB: Shutdown completed; log sequence > number 2150107; transaction id 3085 > > If there was no output like that, you should remove any line that says > "skip_locking" or "skip-locking" from the configuration file and > retry. > > Marko Yes, that was indeed the end of the output. The skip-locking statement was not in /etc/my.cnf, but inmy.cnf in my home dir. Commented it out and now this complaint disappeared. But now I get #################################################################### 2022-11-08 13:37:32 0 [Note] InnoDB: Compressed tables use zlib 1.2.12 2022-11-08 13:37:32 0 [Note] InnoDB: Number of pools: 1 2022-11-08 13:37:32 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2022-11-08 13:37:32 0 [Note] InnoDB: Using Linux native AIO 2022-11-08 13:37:32 0 [Note] InnoDB: Initializing buffer pool, total size = 134217728, chunk size = 134217728 2022-11-08 13:37:32 0 [Note] InnoDB: Completed initialization of buffer pool 2022-11-08 13:37:32 0 [Note] InnoDB: 128 rollback segments are active. 2022-11-08 13:37:32 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2022-11-08 13:37:32 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2022-11-08 13:37:32 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2022-11-08 13:37:32 0 [Note] InnoDB: 10.6.10 started; log sequence number 578191791; transaction id 2935782 2022-11-08 13:37:32 0 [Note] InnoDB: Loading buffer pool(s) from /home/jogchum/mysql/ib_buffer_pool 2022-11-08 13:37:32 0 [Note] Plugin 'FEEDBACK' is disabled. 2022-11-08 13:37:32 0 [Warning] 'innodb-file-format' was removed. It does nothing now and exists only for compatibility with old my.cnf files. 2022-11-08 13:37:33 0 [Note] Server socket created on IP: '0.0.0.0'. 2022-11-08 13:37:33 0 [ERROR] Can't start server : Bind on unix socket: No such file or directory 2022-11-08 13:37:33 0 [ERROR] Do you already have another server running on socket: /var/run/mysql/mysql.sock ? 2022-11-08 13:37:33 0 [ERROR] Aborting Warning: Memory not freed: 280 ########################################################################## (again no further output). /var/run/mysql/mysql.sock odoes not exeist, and "pgrep mariadbd", "pgrep mysql" and "pgrep mysqld" show nothing, so no serer is running anymore. ss -a | grep 3306 or ss -a | grep /var/run/mysql also gives nothing, so it seems there are no processes using that port. We're getting closer it seems, but not quite there yet... regards, Jogchum

7 48

[Maria-discuss] Statistics are not being updated?
by Colin Charles 08 Dec '22

08 Dec '22

Hi, Any reason statistics stopped being updated in October? https://mariadb.org/statistics/ Would be great if this got fixed, thanks cheers, -c -- Colin Charles, http://bytebot.net/blog/ twitter: @bytebot | skype: colincharles "First they ignore you, then they laugh at you, then they fight you, then you win." -- Mohandas Gandhi

2 1

[Maria-discuss] Followup on MDEV-25625, still present in 10.5.16
by Chris Ross (cross2) 17 Nov '22

17 Nov '22

Hello all. I came across MDEV-25625 while looking for that same problem. It was closed, I think because the reporter didn’t get back to it, but I’m now seeing the same. I’ve added a comment, but I don’t know if commenting on a closed issue will notify anyone. Can anyone comment/re-open that issue? I don’t want to file a duplicate. Thank you. https://jira.mariadb.org/browse/MDEV-25625 - Chris

2 3

[Maria-discuss] subscribe
by Surya 15 Nov '22

15 Nov '22

Hello , -- Best regards, Surya mailto:surya@fastmail.in

1 0

[Maria-discuss] (no subject)
by Surya 15 Nov '22

15 Nov '22

Hello , -- Best regards, Surya mailto:surya@fastmail.in

1 0

[Maria-discuss] mariadb-10.3.37 strips "collate" from "show create table"
by Reindl Harald 10 Nov '22

10 Nov '22

mariadb-10.3.36 versus mariadb-10.3.37 in the past every field contained "collate latin1_german1_ci" and after this point-update collation is only part of the output if it's different then the tables default collation surely, i can update everything to mariadb-10.3.37 and rewrite all this tests in the hope the next point-update don't restore the old behavior but it's really a bad style --------------------------------------------------------------------------------------------------------------------- CALLER: '/autotests/custom/phpincludes_mysql.php:306': --------------------------------------------------------------------------------------------------------------------- --- old_9bb3995c3244abfff522da086526e88b5a8a81f1e7cf672d8343f20d.txt 2022-11-10 01:03:12.366665303 +0100 +++ new_53033703b16454931e7c7f62ef923229ca8183aff6f6fa017cdb44bd.txt 2022-11-10 01:03:12.366665303 +0100 @@ -1,14 +1,14 @@ create table `test_table` (`test_id` mediumint(7) unsigned not null auto_increment, -`char_char` char(200) collate latin1_german1_ci default null, +`char_char` char(200) default null, `char_date` date default null, `char_datetime` datetime default null, -`char_longtext` longtext collate latin1_german1_ci default null, -`char_mediumtext` mediumtext collate latin1_german1_ci default null, -`char_text` text collate latin1_german1_ci default null, +`char_longtext` longtext default null, +`char_mediumtext` mediumtext default null, +`char_text` text default null, `char_time` time default null, `char_timestamp` datetime default null, -`char_tinytext` tinytext collate latin1_german1_ci default null, -`char_varchar` varchar(200) collate latin1_german1_ci default null, +`char_tinytext` tinytext default null, +`char_varchar` varchar(200) default null, `number_bigint` bigint(200) unsigned default null, `number_double` double unsigned default null, `number_float` double unsigned default null,

1 0

[Maria-discuss] Maria-db refuses to start
by Jogchum Reitsma 08 Nov '22

08 Nov '22

Hi, I am on OpenSuse Tumbleweed, rolling distro. Since some snapshots of Tumbleweed my mariadb does not start at system start. I don't use the mariadb databases a lot, so I didn't notice it immediately. Hence I'm unsure when the problem occurred first time. When trying to start it manually, I got the message [ERROR] InnoDB: Upgrade after a crash is not supported. The redo log was created with MariaDB 10.5.8. Searching that message, I saw a post on https://bbs.archlinux.org/viewtopic.php?id=259364 Like me, he had a non-default location for the databases configured in /etc/my.cnf. The solution that worked for him was to change that to another location in my.cnf, starting the database (which now succeeded), and copy the existing databases to that new location. So I decided to mimic that: commented out the existing database location, entered an new one, and started the database server (as root) with systemctl start mariadb After a while, the new location is created (owned by mysql:root) and populated: l mysql_recover totaal 111048 drwx------ 6 mysql root 243 2 okt 21:33 ./ drwxr-xr-x 225 jogchum users 16384 2 okt 21:26 ../ -rw-rw---- 1 mysql mysql 417792 2 okt 21:27 aria_log.00000001 -rw-rw---- 1 mysql mysql 52 2 okt 21:27 aria_log_control -rw-rw---- 1 mysql mysql 942 2 okt 21:27 ib_buffer_pool -rw-rw---- 1 mysql mysql 12582912 2 okt 21:27 ibdata1 -rw-rw---- 1 mysql mysql 100663296 2 okt 21:27 ib_logfile0 drwx------ 2 mysql mysql 4096 2 okt 21:27 mysql/ -rw-rw---- 1 root root 14 2 okt 21:27 mysql_upgrade_info drwx------ 2 mysql mysql 28 2 okt 21:27 performance_schema/ drwx------ 2 mysql mysql 8192 2 okt 21:27 sys/ drwx------ 2 mysql mysql 28 2 okt 21:27 test/ But unlike the posting at bbs.archlinux.org just mentioned, the server crashed again, now with the following messages in journalctl: ################################################################################# journalctl -xeu mariadb.service A start job for unit mariadb.service has finished with a failure. The job identifier is 2782226 and the job result is failed. okt 02 21:20:47 linux-mkay systemd[1]: Starting MariaDB database server... Subject: A start job for unit mariadb.service has begun execution Defined-By: systemd Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel A start job for unit mariadb.service has begun execution. The job identifier is 2790830. okt 02 21:20:47 linux-mkay mysql-systemd-helper[44977]: 2022-10-02 21:20:47 0 [Note] /usr/sbin/mysqld (server 10.8.3-MariaDB) starting as process 44977 ... okt 02 21:20:48 linux-mkay systemd[1]: mariadb.service: Main process exited, code=exited, status=1/FAILURE Subject: Unit process exited Defined-By: systemd Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel An ExecStart= process belonging to unit mariadb.service has exited. The process' exit code is 'exited' and its exit status is 1. okt 02 21:20:48 linux-mkay systemd[1]: mariadb.service: Failed with result 'exit-code'. Subject: Unit failed Defined-By: systemd Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel The unit mariadb.service has entered the 'failed' state with result 'exit-code'. okt 02 21:20:48 linux-mkay systemd[1]: Failed to start MariaDB database server. Subject: A start job for unit mariadb.service has failed Defined-By: systemd Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel A start job for unit mariadb.service has finished with a failure. The job identifier is 2790830 and the job result is failed. okt 02 21:26:55 linux-mkay systemd[1]: Starting MariaDB database server... Subject: A start job for unit mariadb.service has begun execution Defined-By: systemd Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel A start job for unit mariadb.service has begun execution. The job identifier is 2792404. okt 02 21:26:55 linux-mkay mysql-systemd-helper[45372]: Creating MySQL privilege database... okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: Two all-privilege accounts were created. okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: One is root@localhost, it has no password, but you need to okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: be system 'root' user to connect. Use, for example, sudo mysql okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: The second is mysql@localhost, it has no password either, but okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: you need to be the system 'mysql' user to connect. okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: After connecting you can set the password, if you would need to be okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: able to connect as any of these users with a password and without sudo okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: See the MariaDB Knowledgebase at https://mariadb.com/kb okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: Please report any problems at https://mariadb.org/jira okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: The latest information about MariaDB is available at https://mariadb.org/. okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: Consider joining MariaDB's strong and vibrant community: okt 02 21:27:17 linux-mkay mysql-systemd-helper[45384]: https://mariadb.org/get-involved/ okt 02 21:27:17 linux-mkay mysql-systemd-helper[45468]: 2022-10-02 21:27:17 0 [Note] /usr/sbin/mysqld (server 10.8.3-MariaDB) starting as process 45468 ... okt 02 21:27:17 linux-mkay mysql-systemd-helper[45468]: 2022-10-02 21:27:17 0 [Warning] Can't create test file /home/jogchum/mysql_recover/linux-mkay.lower-test okt 02 21:27:17 linux-mkay mysql-systemd-helper[45468]: [103B blob data] okt 02 21:27:17 linux-mkay mysql-systemd-helper[45468]: 2022-10-02 21:27:17 0 [ERROR] Aborting okt 02 21:27:17 linux-mkay systemd[1]: mariadb.service: Main process exited, code=exited, status=1/FAILURE Subject: Unit process exited Defined-By: systemd Support: https://lists.freedesktop.org/mailman/listinfo/systemd-devel ############################################################################################ Anyone an idea why /home/jogchum/mysql_recover/linux-mkay.lower-test can't be created and how to solve that? Thanks in advance! regards, Jogchum

6 22

[Maria-discuss] Bug in incremental backups since MariaDB version 10.5.7 with mariabackup?
by Michael Rößler 02 Nov '22

02 Nov '22

Hi @ll, I am using mariabackup since 2 years. I wanted to upgrade from version 10.4.24 to 10.6.10 but I found out that incremental Backups does not work as expected because of size. Further investigation show that it is since version 10.5.7. Then I have found out that in the file xtrabackup_checkpoints the value for to_lsn is not changing in version 10.5.7 and 10.6.10. Using the command 'mysql -e "SHOW ENGINE INNODB STATUS\G" | egrep "Last check"' show that values are the same with that command and the value to_lsn in the file xtrabackup_checkpoints. Backup-commands used in test environment: mariabackup --extra-lsndir=/var/backup/full --backup --compress --stream=xbstream --user=root --password=root --target-dir=/var/backup/full > /var/backup/full/full.xbstream mariabackup --extra-lsndir=/var/backup/inc1 --backup --compress --stream=xbstream --user=root --password=root --incremental-basedir=/var/backup/full --target-dir=/var/backup/inc1 > /var/backup/inc1/inc1.xbstream mariabackup --extra-lsndir=/var/backup/inc2 --backup --compress --stream=xbstream --user=root --password=root --incremental-basedir=/var/backup/inc1 --target-dir=/var/backup/inc2 > /var/backup/inc2/inc2.xbstream mariabackup --extra-lsndir=/var/backup/inc3 --backup --compress --stream=xbstream --user=root --password=root --incremental-basedir=/var/backup/inc2 --target-dir=/var/backup/inc3 > /var/backup/inc3/inc3.xbstream Size of files compared between version 10.5.6 and 10.5.7: [root@mysqlsingle2 backup]# ls *10.5.6/*xbstream -lh -rw-r--r-- 1 root root 765K 2. Nov 13:03 full-10.5.6/full.xbstream -rw-r--r-- 1 root root 779K 2. Nov 13:06 inc1-10.5.6/inc1.xbstream -rw-r--r-- 1 root root 1,2M 2. Nov 13:16 inc2-10.5.6/inc2.xbstream -rw-r--r-- 1 root root 752K 2. Nov 13:17 inc3-10.5.6/inc3.xbstream [root@mysqlsingle2 backup]# ls -lh *10.5.7/*xbstream -rw-r--r-- 1 root root 763K 2. Nov 13:22 full-10.5.7/full.xbstream -rw-r--r-- 1 root root 723K 2. Nov 13:23 inc1-10.5.7/inc1.xbstream # added 2000 rows -rw-r--r-- 1 root root 2,1M 2. Nov 13:30 inc2-10.5.7/inc2.xbstream # added 20000 rows -rw-r--r-- 1 root root 2,2M 2. Nov 13:31 inc3-10.5.7/inc3.xbstream # added 2000 rows to_lsn in file xtrabackup_checkpoints: [root@mysqlsingle2 backup]# cat full*/*checkpoints | grep "to_lsn" to_lsn = 47455 # 10.5.6 to_lsn = 45118 # 10.5.7 [root@mysqlsingle2 backup]# cat inc1*/*checkpoints | grep "to_lsn" to_lsn = 487597 # 10.5.6 to_lsn = 45118 # 10.5.7 [root@mysqlsingle2 backup]# cat inc2*/*checkpoints | grep "to_lsn" to_lsn = 4572514 # 10.5.6 to_lsn = 45118 # 10.5.7 [root@mysqlsingle2 backup]# cat inc3*/*checkpoints | grep "to_lsn" to_lsn = 4995024 # 10.5.6 to_lsn = 45118 # 10.5.7 'Last checkpoint at' from command 'mysql -e "SHOW ENGINE INNODB STATUS\G" | egrep "Last check"': [root@mysqlsingle2 backup]# cat full*/*Last* Last checkpoint at 47455 Last checkpoint at 45118 [root@mysqlsingle2 backup]# cat inc1*/*Last* Last checkpoint at 487597 Last checkpoint at 45118 [root@mysqlsingle2 backup]# cat inc2*/*Last* Last checkpoint at 4572514 Last checkpoint at 45118 [root@mysqlsingle2 backup]# cat inc3*/*Last* Last checkpoint at 4995024 Last checkpoint at 45118 Kind regards Michael

1 0

[Maria-discuss] Galera with stunnel for rsync sst method
by John Fawcett 15 Oct '22

15 Oct '22

Hi Can someone point out or help with a step by step guide to setting up Galera to use stunnel for rsync sst? I was following the instructions here: https://mariadb.com/kb/en/introduction-to-state-snapshot-transfers-ssts/ and my main doubts are: 1. Does stunnel itself have to be configured and if so is it the same configuration on all galera nodes? 2. Does stunnel have to be running as a service on any of the galera nodes? 3. Does the configuration shown in the galera documentation [sst] tkey = /etc/my.cnf.d/certificates/client-key.pem tcert = /etc/my.cnf.d/certificates/client-cert.pem have to be done on all the galera nodes? 4. Do the above key and cert have to be the same (or have to be different) on all galera nodes? 5. more of a stunnel question, but following the link from the galera documentation to the stunnel documentation for certificate generation, https://www.stunnel.org/howto.html I got stuck on this command which no longer works on openssl 3.0.5.5: openssl gendh 2048 >> stunnel.pem Any idea on what has replaced it? Thanks for any help. John

1 0

[Maria-discuss] Migration path for unix_socket authentication plugin
by William Edwards 14 Oct '22

14 Oct '22

Hi, On MariaDB servers that were installed with >= MariaDB 10.4, I have one root user that was created as: MariaDB [(none)]> show create user 'root'@'localhost'; CREATE USER `root`@`localhost` IDENTIFIED VIA mysql_native_password USING 'invalid' OR unix_socket FWIW: The statements on https://mariadb.com/kb/en/authentication-from-mariadb-104/#description are reversed (`IDENTIFIED VIA unix_socket OR mysql_native_password USING 'invalid'` instead of `IDENTIFIED VIA mysql_native_password USING 'invalid' OR unix_socket`). On MariaDB servers that were installed with < MariaDB 10.4, I have 3 root users that were created as: MariaDB [(none)]> show create user 'root'@'localhost'; CREATE USER `root`@`localhost` MariaDB [(none)]> show create user 'root'@'::1'; CREATE USER `root`@`::1` MariaDB [(none)]> show create user 'root'@'127.0.0.1'; CREATE USER `root`(a)`127.0.0.1` I've upgraded all MariaDB servers that were installed with MariaDB <= 10.4 to MariaDB 10.6. I would like to update these root users, that were created when installing on < 10.4, to use UNIX socket authentication too. If I run: ALTER USER 'root'@'localhost' IDENTIFIED VIA mysql_native_password USING 'invalid' OR unix_socket ... I have a user with the same create statement as on servers that were installed with >= MariaDB 10.4: MariaDB [(none)]> show create user 'root'@'localhost'; CREATE USER `root`@`localhost` IDENTIFIED VIA mysql_native_password USING 'invalid' OR unix_socket I have 3 questions regarding this: 1. Is the ALTER USER statement above the correct migration path, to update root users created when installing on < 10.4 to use UNIX socket authentication, like root users created when installing on >= 10.4? Am I forgetting anything? 2. I presume the 'root'@'::1' and 'root'@'127.0.0.1' users were created to support TCP connections when skip_name_resolve=1. If so, they are no longer needed when using a UNIX socket. Can I safely delete these users, after updating the 'root'@'localhost' user to use UNIX socket authentication? 3. Is there a plan to automatically remove the debian-sys-maint user on future major upgrades? It still exists on servers that were installed on < 10.4. The /etc/mysql/debian.cnf file is deprecated already, so this user should be unused. FYI: All MariaDB servers were installed from the MariaDB Debian repository. Thank you! William Edwards

2 1

[Maria-discuss] Retrieve authentication plugins for user
by William Edwards 13 Oct '22

13 Oct '22

Hi, When creating an account with multiple authentication plugins, in this case 'unix_socket' OR 'mysql_native_password', the mysql.user.plugin column is set to either one. How should I retrieve *all* used authentication plugins for a given user? Example: ``` MariaDB [(none)]> CREATE USER 'testing'@'localhost' IDENTIFIED VIA unix_socket OR mysql_native_password USING 'invalid'; Query OK, 0 rows affected (0.005 sec) MariaDB [(none)]> select user,host,password,authentication_string,plugin from mysql.user where User = 'testing'; +---------+-----------+----------+-----------------------+-----------------------+ | User | Host | Password | authentication_string | plugin | +---------+-----------+----------+-----------------------+-----------------------+ | testing | localhost | invalid | invalid | mysql_native_password | +---------+-----------+----------+-----------------------+-----------------------+ 1 row in set (0.003 sec) ``` William Edwards

2 1

[Maria-discuss] What is the right way to update based on a DB change?
by ngtech1ltd＠gmail.com 03 Oct '22

03 Oct '22

Hey Everybody, I have the next scenario which I am not sure about the right way for a solution. I have a radius server that authenticate clients from multiple WIFI Access Points. I have couple systems and they need to know the current client login identifier (MAC or IP Address). It is stored in the DB and the DB is being updated on every login. I can try to give a static IP for every user and it will resolve this issue but there is an overhead for this. So what I was thinking instead is to either run a query that will fetch the latest changes or use a trigger to update another table which in turn will be read by an external software every 1-5 seconds. I believe that the right solution is to use a trigger that will update another table with the details and on the other table I will have a Processed column that will be updated when the software finished processing the row. Then in turn every 24 hours I will run a DB cleanup cron. I will try later on to share the schema. Any advice is more than welcome. Thanks, Eliezer ---- Eliezer Croitoru NgTech, Tech Support Mobile: +972-5-28704261 Email: <mailto:ngtech1ltd@gmail.com> ngtech1ltd(a)gmail.com Web: <https://ngtech.co.il/> https://ngtech.co.il/ My-Tube: <https://tube.ngtech.co.il/> https://tube.ngtech.co.il/

3 3

[Maria-discuss] LevelDB and KV best performance
by ngtech1ltd＠gmail.com 22 Aug '22

22 Aug '22

Hey, I have been using BDB and LevelDB and other KV embedded DB as an improvement for SquidGuard. I have seen the next MDEV: https://jira.mariadb.org/browse/MDEV-3841 And was wondering what is the most recommended way to store a simple KV list in MaraiDB these days. Currently MariaDB works fine for me but when I am comparing the performance of BDB to MariaDB even if am iterating a full DB file 6 times to find out if 6 different Keys are present it seems like a simple embedded DB is faster then MariaDB. I am not stating a fact since I don’t have the metrics but this is what it seems like. The DB is mainly for READ so I was thinking about an option to use a master and READ ONLY slaves to speedup the DB. The DB contains about 80 million rows so it’s not that big since the only thing I need is the KEY to match a category. Currently I am using a simple InnoDB table and the buffers are maximized to the maximum that the machine can offer. Thanks, Eliezer ---- Eliezer Croitoru NgTech, Tech Support Mobile: +972-5-28704261 Email: <mailto:ngtech1ltd@gmail.com> ngtech1ltd(a)gmail.com Web: <https://ngtech.co.il/> https://ngtech.co.il/ My-Tube: <https://tube.ngtech.co.il/> https://tube.ngtech.co.il/

1 0

[Maria-discuss] Change case with unique constraint
by Keith Edmunds 22 Aug '22

22 Aug '22

I can't change the case of a column with a unique index, example below. MariaDB [test]> show columns in kae; +-------+---------------+------+-----+---------+----------------+ | Field | Type | Null | Key | Default | Extra | +-------+---------------+------+-----+---------+----------------+ | id | int(11) | NO | PRI | NULL | auto_increment | | name | varchar(2048) | NO | UNI | NULL | | +-------+---------------+------+-----+---------+----------------+ 2 rows in set (0.001 sec) MariaDB [test]> select * from kae; +----+------+ | id | name | +----+------+ | 1 | test | +----+------+ 1 row in set (0.001 sec) MariaDB [test]> update kae set name="Test" where id=1; ERROR 1062 (23000): Duplicate entry 'Test' for key 'unique_name' MariaDB [test]>

4 3

[Maria-discuss] "Rewind" type of mechanisms?
by Sam R. 19 Aug '22

19 Aug '22

Hi! I would like to know about following topic regarding MariaDB.We would like to run DB cluster with HA (high availability). -- E.g. with MaxScale. My Q:Does MariaDB support such mechanism which would be similar to pg_rewind? Reference: PostgreSQL supports such a rewind operation.Or, are there plans to support such regarding MariaDB? ( If such would be needed / useful. ) Rewind: "A typical scenario is to bring an old primary server back online after failover as a standby that follows the new primary." Target: robustness/stability of a DB cluster. Avoiding needs to manually fix DB cluster. Best Regards Sam

3 7

[Maria-discuss] mysql_upgrade and error 'Table rebuild required. Please do "ALTER TABLE `table1` FORCE" or dump/reload to fix it!'
by Karl Levik 18 Aug '22

18 Aug '22

Hello list, After upgrading a database from 10.5 to 10.6 I get messages like below for a couple of the tables when I run mysql_upgrade: error : Table rebuild required. Please do "ALTER TABLE `table1` FORCE" or dump/reload to fix it! But at the end of the output it says: Repairing tables `database1`.`table1` FIXED `database1`.`table2` FIXED .... and so on - it lists all the tables that it previously said I needed to rebuild as "fixed". So, does that mean I don't need to do anything, or should I still run the ALTER TABLE statements? It seems I can SELECT + DELETE from and INSERT into the tables without getting any errors, so presumably I don't have to worry? Regards, Karl

1 0

[Maria-discuss] Repos empty?
by William Edwards 15 Aug '22

15 Aug '22

Hello, The Debian repos @ https://mariadb.org/download/?t=repo-config don't seem to contain any packages and no Release file anymore. Last updated yesterday at 18:41 (IDK which timezone). E.g. http://ams2.mirrors.digitalocean.com/mariadb/repo/10.3/debian/dists/buster/… (the issue isn't with this specific mirror). When choosing a repo on mariadb.org, the error "An error occured. The mirrors could not be loaded." is shown. -- With kind regards, William Edwards

2 4

[Maria-discuss] Major upgrade instructions missing for Galera
by William Edwards 10 Aug '22

10 Aug '22

Hi, The documentation at https://mariadb.com/kb/en/upgrading-galera-cluster/ is missing major upgrade instructions > MariaDB 10.4. Someone else caught this as well: https://mariadb.com/kb/en/upgrading-from-104-to-105-galera-changes/ Is this intentional? -- With kind regards, William Edwards

3 6

[Maria-discuss] ibtmp1 for internal temporary tablespaces
by William Edwards 09 Aug '22

09 Aug '22

Hi, User-created temporary tables are stored in ibtmp1. Are internal temporary tablespaces (those created by MariaDB while executing queries) too? I am unable to find the answer in the documentation[1]. Context: I'd like to store ibtmp1 in a different path using innodb_temp_data_file_path, but ONLY for user-created temporary tables. William Edwards [1]: https://mariadb.com/kb/en/innodb-temporary-tablespaces/ -- With kind regards, William Edwards

2 1

[Maria-discuss] Some questions about mariadb-dump and mariabackup
by jkmdb＠w3.org 02 Aug '22

02 Aug '22

Hi! Sorry to bother you about this but I haven't found the answers in the doc. ** mariadb-dump Could you tell me what is the difference of calling mariadb-dump on innodb tables using --skip-lock-tables --single-transaction? >From what I read these seem to be time / performace optimizations for doing innodb tables dumps but if we omit them, we would get the same data dumped, even it takes longer. Could you confirm this? ** mariabackup We have a setup that stores the binary logs under /var/log/mysql (set up with the log_bin configuration option) and the databases themselves under /var/lib/mysql Suppose I call mariabackup to make a backup of the database as follows (some options obmitted): mariabackup --backup --target-dir=my_backup_dir Could you tell me if calling mariabackup --prepare --target-dir=my_backup_dir needs access to the binary logs stored under /var/log/mysql or if mariabackup made a copy of all that it needs in my_backup_dir? ** mariabackup and incremental backups This is basically the same question as the above. If i'm making incremental backups as follows (some options obmitted): mariabackup --backup \ --target-dir=my_backup_dir/inc1 --incremental-basedir=full_backup_dir When I do the prepare for the incremental backups, does mariabackup need access to the /var/log/mysql bin logs or do the full + each incremental backup dirs has all the info needed to do the prepare? mariabackup --prepare \ --target-dir=my_backup_dir/inc1 --incremental-basedir=full_backup_dir Many thanks in advance! --josé

3 2

[Maria-discuss] MariaDB server horribly slow on start
by Cédric Counotte 01 Aug '22

01 Aug '22

Hello all. I hope I'm at the right place to ask this question. I opened a bug here: https://jira.mariadb.org/browse/MDEV-28969, however I was told to use this mailing list. We have 4 MariaDB servers in a Galera Cluster and it happens that a server has to be restarted (be it for a crash which I have to open a bug for) or maintenance. When that happens, the restarted server is causing huge slow down on the whole cluster, and it lasts for 10 to 30 minutes at the very least! And by huge, I mean huge, we end up with 500 to 800 pending queries on all servers as you can see on attached screenshots I've attached the configuration of any server for reference in case this is the source of the issue. Any way to solve this would be greatly appreciated. Regards, 3C.

8 45

[Maria-discuss] Looking for advice where to start looking at a slow query case
by ngtech1ltd＠gmail.com 26 Jul '22

26 Jul '22

Hey, I have tried to run a local service which claims to be a YouTube alike which is named AVideo(used to be PHPTube). I loaded the service with 220k+ videos from YouTube and have used MariaDB as the DB backend. The service moved slowly as the size of the videos DB growed from 100k to 150k. I got a recommendation from the developer to use MySQL which didn’t made any sense to me. I tracked the issue to the SQL queries that the service runs. Currently I am upgrading my local servers so the DB cannot be downloaded for testing however I have seen a very interesting thing. I will first put the query here: ```sql SELECT u.*, v.*, c.iconClass, c.name as category, c.clean_name as clean_category,c.description as category_description, v.created as videoCreation, v.modified as videoModified FROM videos as v LEFT JOIN categories c ON categories_id = c.id LEFT JOIN users u ON v.users_id = u.id WHERE 2=2 AND u.status = 'a' AND v.status IN ('a','k','f') ORDER BY likes DESC LIMIT 36, 12; ``` The ANALYZE FORMAT=JSON for that query is: ```json { "query_block": { "select_id": 1, "r_loops": 1, "r_total_time_ms": 9643.807074, "filesort": { "sort_key": "v.likes desc", "r_loops": 1, "r_total_time_ms": 756.223544, "r_limit": 48, "r_used_priority_queue": true, "r_output_rows": 49, "r_sort_mode": "sort_key,rowid", "temporary_table": { "table": { "table_name": "u", "access_type": "ref", "possible_keys": ["PRIMARY", "users_status_IDX"], "key": "users_status_IDX", "key_length": "1", "used_key_parts": ["status"], "ref": ["const"], "r_loops": 1, "rows": 1, "r_rows": 1, "r_table_time_ms": 0.034852389, "r_other_time_ms": 0.020715696, "filtered": 100, "r_filtered": 100, "index_condition": "u.`status` = 'a'" }, "table": { "table_name": "v", "access_type": "ref", "possible_keys": [ "fk_videos_users_idx", "video_status_idx", "videos_status_index" ], "key": "fk_videos_users_idx", "key_length": "4", "used_key_parts": ["users_id"], "ref": ["AVideo.u.id"], "r_loops": 1, "rows": 391299, "r_rows": 990067, "r_table_time_ms": 2691.791742, "r_other_time_ms": 6129.887127, "filtered": 50.00025558, "r_filtered": 100, "attached_condition": "v.`status` in ('a','k','f')" }, "table": { "table_name": "c", "access_type": "eq_ref", "possible_keys": ["PRIMARY"], "key": "PRIMARY", "key_length": "4", "used_key_parts": ["id"], "ref": ["AVideo.v.categories_id"], "r_loops": 990067, "rows": 1, "r_rows": 1, "r_table_time_ms": 0.00546745, "r_other_time_ms": 0.569425897, "filtered": 100, "r_filtered": 100 } } } } } ``` While for the next: ```sql SELECT * FROM (SELECT u.id as uid , u.user as uuser , u.name as uname , u.email as uemail , u.password as upassword , u.created as ucreated , u.modified as umodified , u.isAdmin as uisAdmin , u.status as ustatus , u.photoURL as uphotoURL , u.lastLogin as ulastLogin , u.recoverPass as urecoverPass , u.backgroundURL as ubackgroundURL , u.canStream as ucanStream , u.canUpload as ucanUpload , u.canCreateMeet as ucanCreateMeet , u.canViewChart as ucanViewChart , u.about as uabout , u.channelName as uchannelName , u.emailVerified as uemailVerified , u.analyticsCode as uanalyticsCode , u.externalOptions as uexternalOptions , u.first_name as ufirst_name , u.last_name as ulast_name , u.address as uaddress , u.zip_code as uzip_code , u.country as ucountry , u.region as uregion , u.city as ucity , u.donationLink as udonationLink , u.extra_info as uextra_info , u.phone as uphone , u.is_company as uis_company , v.*, c.iconClass, c.name as category, c.clean_name as clean_category,c.description as category_description, v.created as videoCreation, v.modified as videoModified FROM videos as v LEFT JOIN categories c ON categories_id = c.id LEFT JOIN users u ON v.users_id = u.id WHERE 2=2 AND v.status IN ('a','k','f') ORDER BY likes DESC ) a WHERE a.ustatus IN ('a') LIMIT 1000, 900; ``` The ANALYZE FORMAT=JSON is the next: ```json { "query_block": { "select_id": 1, "r_loops": 1, "r_total_time_ms": 8.047324959, "table": { "table_name": "u", "access_type": "ref", "possible_keys": ["PRIMARY", "users_status_IDX"], "key": "users_status_IDX", "key_length": "1", "used_key_parts": ["status"], "ref": ["const"], "r_loops": 1, "rows": 1, "r_rows": 1, "r_table_time_ms": 0.045761237, "r_other_time_ms": 0.0201165, "filtered": 100, "r_filtered": 100, "index_condition": "u.`status` = 'a'" }, "table": { "table_name": "v", "access_type": "ref", "possible_keys": [ "fk_videos_users_idx", "video_status_idx", "videos_status_index" ], "key": "fk_videos_users_idx", "key_length": "4", "used_key_parts": ["users_id"], "ref": ["AVideo.u.id"], "r_loops": 1, "rows": 391299, "r_rows": 1900, "r_table_time_ms": 6.939235389, "r_other_time_ms": 1.010973728, "filtered": 50.00025558, "r_filtered": 100, "attached_condition": "v.`status` in ('a','k','f')" }, "table": { "table_name": "c", "access_type": "eq_ref", "possible_keys": ["PRIMARY"], "key": "PRIMARY", "key_length": "4", "used_key_parts": ["id"], "ref": ["AVideo.v.categories_id"], "r_loops": 1900, "rows": 1, "r_rows": 1, "r_table_time_ms": 0.007669714, "r_other_time_ms": 0.001959112, "filtered": 100, "r_filtered": 100 } } } ``` And what I am trying to understand is, what's the difference? Why would the same exact query will result with this issue? Just to notice that the next query will not run at all due to fields naming conflict between u and v: ```sql SELECT * FROM (SELECT u.* , v.*, c.iconClass, c.name as category, c.clean_name as clean_category,c.description as category_description, v.created as videoCreation, v.modified as videoModified FROM videos as v LEFT JOIN categories c ON categories_id = c.id LEFT JOIN users u ON v.users_id = u.id WHERE 2=2 AND v.status IN ('a','k','f') ORDER BY likes DESC ) a WHERE a.ustatus IN ('a') LIMIT 1000, 900; ``` I am not new to the DB world that much but it's the first time I am getting my hands dirty about such an issue. I will share the full DB later on today so it could be used as a learning material. Also, are there any big public databases that can be used for learning and testing purposes? Thanks, Eliezer ---- Eliezer Croitoru NgTech, Tech Support Mobile: +972-5-28704261 Email: ngtech1ltd(a)gmail.com Web: https://ngtech.co.il/ My-Tube: https://tube.ngtech.co.il/

3 10

[Maria-discuss] mariadb-connector-cpp and multiple threads
by jason＠youtorque.com 25 Jul '22

25 Jul '22

Using the [ MariaDB C++ Connector ]( https://github.com/mariadb-corporation/mariadb-connector-cpp ) on ubuntu 20.04, and gcc compiler. During load test of a webserver application it was discovered that anytime there was more than a single concurrent connection the server would crash. This was narrowed down to the connect member of the mariadb driver. The errors that were being reported were always one of the following two: terminate called after throwing an instance of 'std::logic_error' what(): basic_string::_M_construct null not validAborted (core dumped)terminate called after throwing an instance of 'std::invalid_argument' what(): stoiAborted (core dumped) As it wouldn't be feasible to post the source of the server, I have reproduced a minimal working example that uses only standard library and mariadb/conncpp.hpp: ``` #include <mariadb/conncpp.hpp>#include <iostream>#include <thread>#include <string>sql::Driver* driver = sql::mariadb::get_driver_instance();sql::SQLString connectionUrl = "jdbc:mariadb://localhost:3306/the_database_name";sql::Properties properties = {{"user", "the_username"}, {"password", "the_password"}};int main(){ // simulate 2 concurrent connections each making 500 requests std::vector<std::function<void()>> t1cbs; std::vector<std::function<void()>> t2cbs; for(int i = 0; i < 500; i++) // if does not fail for you at 500 up the number until it does { t1cbs.push_back([&]{ std::unique_ptr<sql::Connection> conn(driver->connect(connectionUrl, properties)); std::cout << "t1:" << conn->getHostname().c_str() << std::endl; }); // comment out this block to keep the second thread from executing, and you will see // that no errors occur t2cbs.push_back([&]{ std::unique_ptr<sql::Connection> conn(driver->connect(connectionUrl, properties)); std::cout << "t2:" << conn->getHostname().c_str() << std::endl; }); } std::thread t1([&]{ for(auto& cb : t1cbs) cb(); }); std::thread t2([&]{ for(auto& cb : t2cbs) cb(); }); t1.join(); t2.join(); return 0;} ``` I'm guessing the issue is on my end as I've just started working with this particular library and have probably missed or misunderstood something. Would someone be able to point me in the right direction as far as how I might go about creating database connections from within separate threads?

2 3

Re: [Maria-discuss] mysql_upgrade fails
by Majed Zouhairy 21 Jul '22

21 Jul '22

on centos 8, upgrade form mraidb 10.3 to 10.6 fails with: sudo mysql_upgrade -u root -p Enter password: Major version upgrade detected from 10.3.17-MariaDB to 10.6.8-MariaDB. Check required! Phase 1/7: Checking and upgrading mysql database Processing databases mysql mysql.column_stats OK mysql.columns_priv OK mysql.db OK mysql.event OK mysql.func OK mysql.help_category OK mysql.help_keyword OK mysql.help_relation OK mysql.help_topic OK mysql.host OK mysql.index_stats OK mysql.plugin OK mysql.proc OK mysql.procs_priv OK mysql.proxies_priv OK mysql.roles_mapping OK mysql.servers OK mysql.table_stats OK mysql.tables_priv OK mysql.time_zone OK mysql.time_zone_leap_second OK mysql.time_zone_name OK mysql.time_zone_transition OK mysql.time_zone_transition_type OK mysql.user OK Phase 2/7: Installing used storage engines... Skipped Phase 3/7: Fixing views Phase 4/7: Running 'mysql_fix_privilege_tables' ERROR 1005 (HY000) at line 694: Can't create table `mysql`.`innodb_table_stats` (errno: 184 "Tablespace already exists") ERROR 1005 (HY000) at line 698: Can't create table `mysql`.`innodb_index_stats` (errno: 184 "Tablespace already exists") ERROR 1005 (HY000) at line 702: Can't create table `mysql`.`transaction_registry` (errno: 184 "Tablespace already exists") ERROR 1005 (HY000) at line 774: Can't create table `mysql`.`gtid_slave_pos` (errno: 184 "Tablespace already exists") FATAL ERROR: Upgrade failed ________________________________ From: Vicențiu Ciorbaru <cvicentiu(a)gmail.com> Sent: Wednesday, April 21, 2021 3:51 PM To: Majed Zouhairy <majedzouhairy(a)hotmail.com> Cc: maria-discuss(a)lists.launchpad.net <maria-discuss(a)lists.launchpad.net> Subject: Re: [Maria-discuss] mysql_upgrade fails Hi Majed, What MariaDB version is this? What is the previous version and what is the current version you are upgrading to? Is this from a linux distro, or where did you get the MariaDB binary from? If it's a distro, which one? Vicențiu On Wed, 21 Apr 2021 at 15:31, Majed Zouhairy <majedzouhairy(a)hotmail.com<mailto:majedzouhairy@hotmail.com>> wrote: in last time's upgrade and today i got: sudo mysql_upgrade -u root -p Enter password: Phase 1/7: Checking and upgrading mysql database Processing databases mysql mysql.column_stats OK mysql.columns_priv OK mysql.db OK mysql.event OK mysql.func OK mysql.help_category OK mysql.help_keyword OK mysql.help_relation OK mysql.help_topic OK mysql.host OK mysql.index_stats OK mysql.plugin OK mysql.proc OK mysql.procs_priv OK mysql.proxies_priv OK mysql.roles_mapping OK mysql.servers OK mysql.table_stats OK mysql.tables_priv OK mysql.time_zone OK mysql.time_zone_leap_second OK mysql.time_zone_name OK mysql.time_zone_transition OK mysql.time_zone_transition_type OK mysql.user OK Phase 2/7: Installing used storage engines... Skipped Phase 3/7: Fixing views Phase 4/7: Running 'mysql_fix_privilege_tables' ERROR 1813 (HY000) at line 77: Tablespace for table '`mysql`.`innodb_table_stats`' exists. Please DISCARD the tablespace before IMPORT ERROR 1813 (HY000) at line 81: Tablespace for table '`mysql`.`innodb_index_stats`' exists. Please DISCARD the tablespace before IMPORT ERROR 1813 (HY000) at line 85: Tablespace for table '`mysql`.`transaction_registry`' exists. Please DISCARD the tablespace before IMPORT ERROR 1813 (HY000) at line 153: Tablespace for table '`mysql`.`gtid_slave_pos`' exists. Please DISCARD the tablespace before IMPORT ERROR 1146 (42S02) at line 642: Table 'mysql.innodb_index_stats' doesn't exist ERROR 1243 (HY000) at line 643: Unknown prepared statement handler (stmt) given to EXECUTE ERROR 1146 (42S02) at line 645: Table 'mysql.innodb_table_stats' doesn't exist ERROR 1243 (HY000) at line 646: Unknown prepared statement handler (stmt) given to EXECUTE ERROR 1146 (42S02) at line 650: Table 'mysql.innodb_index_stats' doesn't exist ERROR 1146 (42S02) at line 654: Table 'mysql.innodb_table_stats' doesn't exist ERROR 1146 (42S02) at line 657: Table 'mysql.innodb_table_stats' doesn't exist FATAL ERROR: Upgrade failed what to do? _______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss(a)lists.launchpad.net<mailto:maria-discuss@lists.launchpad.net> Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp

3 8

[Maria-discuss] Speeding up MyRocks engine
by Jan Křístek 24 Jun '22

24 Jun '22

Hello, I have already given up on MyRocks but could someone give some hint to take back my decision?. I have a setup with a heavy insert load with potentially long records (up to a kilobyte or two). I cannot get more than about 300-400 inserts per second with MyRocks. With the Aria engine, it's reaching up to 1900 inserts/sec with the same setup. The only config changes for MyRocks are: rocksdb-override-cf-options='cf1={compression=kLZ4Compression;bottommost_compression=kLZ4Compression;}' rocksdb_allow_concurrent_memtable_write = ON rocksdb_default_cf_options=block_based_table_factory={cache_index_and_filter_blocks=1;filter_policy=bloomfilter:10:false;whole_key_filtering=1};level_compaction_dynamic_level_bytes=true;optimize_filters_for_hits=true;compaction_pri=kMinOverlappingRatio;compression=kLZ4Compression plugin-load-add=ha_rocksdb.so Both MyRocks and Aria are the same hardware, the same setup SSD with software Raid0 and LVM. With Aria I have switched on aria_group_commit to "soft" with 500 ms delay, as I understand, I might lose some data if the server is hard killed or crashes. I am willing to take the risk unless s/o suggests a major speedup for the MyRocks. I have switched TRANSACTIONAL=1 for the table. The table has partitions on both Aria and MyRocks. Thank you for any help in advance, Jan

1 0

[Maria-discuss] Change delimiter with server_audit plugin
by Philippe Maladjian 22 Jun '22

22 Jun '22

Hi there, In order to monitor a database and especially the requests that could be in error, I activated the server_audit plugin. Plugin setup: show global VARIABLES like '%server_audit%'; +-------------------------------+---------------------------------+ | Variable_name | Value | +-------------------------------+---------------------------------+ | server_audit_events | QUERY | | server_audit_excl_users | user | | server_audit_file_path | /var/log/mysql/server_audti.log | | server_audit_file_rotate_now | OFF | | server_audit_file_rotate_size | 1000000 | | server_audit_file_rotations | 9 | | server_audit_incl_users | user | | server_audit_logging | ON | | server_audit_mode | 0 | | server_audit_output_type | file | | server_audit_query_log_limit | 1024 | | server_audit_syslog_facility | LOG_USER | | server_audit_syslog_ident | mysql-server_auditing | | server_audit_syslog_info | | | server_audit_syslog_priority | LOG_ERR | +-------------------------------+---------------------------------+ My problem is that the separator between each value is the comma and bad luck it's the same separator as in the query. Example of a line: 20220622 08:35:03,sserver,user,localhost,14858,7002875,QUERY,database,'UPDATE sorderq SET `odlqty` = "6", `soqsta` = "3", `sdhnum` = "LIVHIL22062", `sddlin` = 24000 WHERE `sohnum` = "NORHIL220601" AND `soplin` = 24000 AND `soqseq` = 24000',0 [...] 20220622 08:35:03,server,user,localhost,14858,7002878,QUERY,database,'INSERT INTO sdeliveryd(`sdhnum`, `itmref`, `sddlin`, `netprinot`, `qty`, `rtnqty`, `tsicod0`, `tsicod1`, `tsicod2`, `tsicod3`, `tsicod4`, `rep1`) VALUES("LIVHIL22061", "1-11325", 26000, 0.0, "12", "0", "STA", "05", " ", " ", " ", "093")',0 It is the last field that interests me because it is the return code of the request. Now if I want to automate the error processing (last field <> 0) I simply cannot because due to the identical separator between the fields of the request and the fields of the log line, the number of columns varies and the return code never has the same position. Is it possible to change the field separator in the plugin? Thanks in advance

1 0

[Maria-discuss] debug.csr error?
by Dave Pawson 19 Jun '22

19 Jun '22

Using create table. error shown > python createRItbl.py Debug.csr Traceback (most recent call last): File "/home/dpawson/Dropbox/2022/sibc/software/mariadb/createRItbl.py", line 82, in <module> showcsr(csr) File "/home/dpawson/Dropbox/2022/sibc/software/mariadb/createRItbl.py", line 40, in showcsr for item in csr: File "/home/dpawson/.local/lib/python3.10/site-packages/mysql/connector/cursor_cext.py", line 718, in fetchone return self._fetch_row() File "/home/dpawson/.local/lib/python3.10/site-packages/mysql/connector/cursor_cext.py", line 689, in _fetch_row row = self._rows[self._next_row] TypeError: 'NoneType' object is not subscriptable Called from Python. Table= f"CREATE TABLE IF NOT EXISTS rinkincome (\ matchdate DATE ,\ session ENUM('rollup','league','club match') ,\ code ENUM {costcodes} ,\ cashOrCard ENUM('card','cash'),\ amount DECIMAL(5,2) );" where costcodes=('a','b') form. # print Table out to check syntax #print(Table) #sys.exit(0) csr.execute(Table) showcsr(csr) Nothing shown to indicate which list / structure I'm trying to iterate over? Any suggestions to chase down the fault please. Pretty new to mariadb. regards -- Dave Pawson XSLT XSL-FO FAQ. Docbook FAQ.

1 0

[Maria-discuss] Incorrect Documentation: Replicating JSON from MySQL to MariaDB
by Gordan Bobic 29 May '22

29 May '22

On this page: https://mariadb.com/kb/en/json-data-type/ it states: If you must use row-based replication and cannot change the MySQL master from JSON to TEXT, you can try to introduce an intermediate MySQL slave and change the column type from JSON to TEXT on it. Then you replicate from this intermediate slave to MariaDB. I can confirm that this does not work with MySQL 5.7. If you have a 5.7 master and you replicate to 5.7 slave, and you convert the slave's json columns to longtext, replication fails with this error: "Column X of table 'dbname.tablename' cannot be converted from type 'json' to type 'longtext'" Using longblob doesn't work either. So it seems there is currently no viable solution for replicating anything that involves JSON columns from MySQL to MariaDB.

2 2

[Maria-discuss] Custom Galera SST Method Documentation
by Gordan Bobic 27 May '22

27 May '22

Hi, I vaguely remember reading something years ago about implementing a custom SST method, but I cannot seem to find any documentation for it now. Is there any documentation on the interfaces that scripts need to implement and how to hook up said scripts into the config files?

2 2

[Maria-discuss] dpkg: mariadb-client-10.x: dependency problems, but removing anyway as you requested
by William Edwards 25 May '22

25 May '22

Hi, Using the official MariaDB repos, since MariaDB 10.4, mariadb-client-10.x is removed, then installed on 'apt upgrade': ``` Unpacking libmariadb3:amd64 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... dpkg: mariadb-client-10.7: dependency problems, but removing anyway as you requested: mariadb-server-10.7 depends on mariadb-client-10.7 (>= 1:10.7.3+maria~buster). mariadb-client depends on mariadb-client-10.7 (>= 1:10.7.4+maria~buster). (Reading database ... 87804 files and directories currently installed.) Removing mariadb-client-10.7 (1:10.7.3+maria~buster) ... Setting up mysql-common (1:10.7.4+maria~buster) ... Setting up mariadb-common (1:10.7.4+maria~buster) ... (Reading database ... 87703 files and directories currently installed.) Preparing to unpack .../00-mariadb-server-10.7_1%3a10.7.4+maria~buster_amd64.deb ... /var/lib/mysql: found previous version 10.7 Unpacking mariadb-server-10.7 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../01-mariadb-server-core-10.7_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking mariadb-server-core-10.7 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../02-mariadb-client-core-10.7_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking mariadb-client-core-10.7 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Selecting previously unselected package mariadb-client-10.7. Preparing to unpack .../03-mariadb-client-10.7_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking mariadb-client-10.7 (1:10.7.4+maria~buster) ... ``` This does not seem to be a problem, but I'd like to understand what changed between 10.3 and 10.4 that causes this. Policy output and full 'apt upgrade' transaction log: ``` root@http-msh01:~# apt upgrade Reading package lists... Done Building dependency tree Reading state information... Done Calculating upgrade... Done The following packages will be upgraded: filebeat libavcodec58 libavfilter7 libavformat58 libavutil56 libldap-2.4-2 libldap-common libmariadb-dev libmariadb-dev-compat libmariadb3 libpostproc55 libpq5 libssl-dev libssl1.1 libswresample3 libswscale5 libxml2 mariadb-client mariadb-client-10.7 mariadb-client-core-10.7 mariadb-common mariadb-server mariadb-server-10.7 mariadb-server-core-10.7 mysql-common nodejs openjdk-11-jre openjdk-11-jre-headless openssl php8.1 php8.1-bcmath php8.1-cli php8.1-common php8.1-curl php8.1-dev php8.1-fpm php8.1-gd php8.1-imap php8.1-intl php8.1-mbstring php8.1-mysql php8.1-opcache php8.1-readline php8.1-soap php8.1-sqlite3 php8.1-xml php8.1-zip sensu-go-agent 55 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. Need to get 142 MB of archives. After this operation, 10.3 MB of additional disk space will be used. Do you want to continue? [Y/n] Get:1 http://security.debian.org/debian-security buster/updates/main amd64 libssl-dev amd64 1.1.1n-0+deb10u2 [1,807 kB] Get:9 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mysql-common all 1:10.7.4+maria~buster [2,880 B] Get:10 http://security.debian.org/debian-security buster/updates/main amd64 libssl1.1 amd64 1.1.1n-0+deb10u2 [1,551 kB] Get:11 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mariadb-common all 1:10.7.4+maria~buster [4,052 B] Get:12 http://security.debian.org/debian-security buster/updates/main amd64 libldap-common all 2.4.47+dfsg-3+deb10u7 [90.1 kB] Get:13 http://security.debian.org/debian-security buster/updates/main amd64 libldap-2.4-2 amd64 2.4.47+dfsg-3+deb10u7 [224 kB] Get:14 https://artifacts.elastic.co/packages/7.x/apt stable/main amd64 filebeat amd64 7.17.4 [37.8 MB] Get:15 http://security.debian.org/debian-security buster/updates/main amd64 libavfilter7 amd64 7:4.1.9-0+deb10u1 [1,053 kB] Get:16 https://packages.sury.org/php buster/main amd64 libxml2 amd64 2.9.14+dfsg-0+0~20220524.12+debian10~1.gbpc5dc45 [701 kB] Get:17 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mariadb-server all 1:10.7.4+maria~buster [2,832 B] Get:18 http://security.debian.org/debian-security buster/updates/main amd64 libswscale5 amd64 7:4.1.9-0+deb10u1 [209 kB] Get:19 http://security.debian.org/debian-security buster/updates/main amd64 libavformat58 amd64 7:4.1.9-0+deb10u1 [1,019 kB] Get:20 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mariadb-client all 1:10.7.4+maria~buster [2,704 B] Get:21 http://security.debian.org/debian-security buster/updates/main amd64 libavcodec58 amd64 7:4.1.9-0+deb10u1 [4,810 kB] Get:22 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 libmariadb-dev amd64 1:10.7.4+maria~buster [158 kB] Get:23 https://packages.sury.org/php buster/main amd64 php8.1-bcmath amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [15.4 kB] Get:24 https://packages.sury.org/php buster/main amd64 php8.1-zip amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [24.2 kB] Get:25 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 libmariadb-dev-compat amd64 1:10.7.4+maria~buster [3,084 B] Get:26 https://packages.sury.org/php buster/main amd64 php8.1-xml amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [107 kB] Get:27 https://packages.sury.org/php buster/main amd64 php8.1-sqlite3 amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [29.3 kB] Get:28 https://packages.sury.org/php buster/main amd64 php8.1-soap amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [120 kB] Get:29 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 libmariadb3 amd64 1:10.7.4+maria~buster [148 kB] Get:30 https://packages.sury.org/php buster/main amd64 php8.1-readline amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [12.6 kB] Get:31 https://packages.sury.org/php buster/main amd64 php8.1-opcache amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [332 kB] Get:32 https://packages.sury.org/php buster/main amd64 php8.1-mysql amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [116 kB] Get:33 https://packages.sury.org/php buster/main amd64 php8.1-mbstring amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [396 kB] Get:34 https://packages.sury.org/php buster/main amd64 php8.1-intl amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [127 kB] Get:35 https://packages.sury.org/php buster/main amd64 php8.1-imap amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [32.6 kB] Get:36 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mariadb-client-core-10.7 amd64 1:10.7.4+maria~buster [832 kB] Get:37 https://packages.sury.org/php buster/main amd64 php8.1-gd amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [28.5 kB] Get:38 https://packages.sury.org/php buster/main amd64 php8.1-dev amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [488 kB] Get:39 https://packages.sury.org/php buster/main amd64 php8.1-curl amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [34.4 kB] Get:40 https://packages.sury.org/php buster/main amd64 php8.1-fpm amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [1,672 kB] Get:41 http://security.debian.org/debian-security buster/updates/main amd64 libswresample3 amd64 7:4.1.9-0+deb10u1 [112 kB] Get:42 http://security.debian.org/debian-security buster/updates/main amd64 libpostproc55 amd64 7:4.1.9-0+deb10u1 [108 kB] Get:43 http://security.debian.org/debian-security buster/updates/main amd64 libavutil56 amd64 7:4.1.9-0+deb10u1 [244 kB] Get:44 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mariadb-server-10.7 amd64 1:10.7.4+maria~buster [3,461 kB] Get:45 https://packages.sury.org/php buster/main amd64 php8.1-cli amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [1,662 kB] Get:46 http://security.debian.org/debian-security buster/updates/main amd64 libpq5 amd64 11.16-0+deb10u1 [172 kB] Get:47 https://packages.sury.org/php buster/main amd64 php8.1-common amd64 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [660 kB] Get:48 http://security.debian.org/debian-security buster/updates/main amd64 openjdk-11-jre amd64 11.0.15+10-1~deb10u1 [174 kB] Get:49 https://packages.sury.org/php buster/main amd64 php8.1 all 8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1 [24.7 kB] Get:50 http://security.debian.org/debian-security buster/updates/main amd64 openjdk-11-jre-headless amd64 11.0.15+10-1~deb10u1 [37.2 MB] Get:51 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mariadb-client-10.7 amd64 1:10.7.4+maria~buster [2,411 kB] Get:52 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 mariadb-server-core-10.7 amd64 1:10.7.4+maria~buster [7,153 kB] Get:53 https://packagecloud.io/sensu/stable/debian buster/main amd64 sensu-go-agent amd64 6.7.2-6283 [6,975 kB] Get:54 http://security.debian.org/debian-security buster/updates/main amd64 openssl amd64 1.1.1n-0+deb10u2 [855 kB] Get:55 https://deb.nodesource.com/node_16.x buster/main amd64 nodejs amd64 16.15.0-deb-1nodesource1 [26.4 MB] Fetched 142 MB in 6s (24.2 MB/s) Reading changelogs... Done Extracting templates from packages: 100% Preconfiguring packages ... (Reading database ... 87804 files and directories currently installed.) Preparing to unpack .../0-mysql-common_1%3a10.7.4+maria~buster_all.deb ... Unpacking mysql-common (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../1-mariadb-common_1%3a10.7.4+maria~buster_all.deb ... Unpacking mariadb-common (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../2-mariadb-server_1%3a10.7.4+maria~buster_all.deb ... Unpacking mariadb-server (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../3-mariadb-client_1%3a10.7.4+maria~buster_all.deb ... Unpacking mariadb-client (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../4-libmariadb-dev_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking libmariadb-dev (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../5-libmariadb-dev-compat_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking libmariadb-dev-compat:amd64 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../6-libssl-dev_1.1.1n-0+deb10u2_amd64.deb ... Unpacking libssl-dev:amd64 (1.1.1n-0+deb10u2) over (1.1.1n-0+deb10u1) ... Preparing to unpack .../7-libssl1.1_1.1.1n-0+deb10u2_amd64.deb ... Unpacking libssl1.1:amd64 (1.1.1n-0+deb10u2) over (1.1.1n-0+deb10u1) ... Preparing to unpack .../8-libmariadb3_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking libmariadb3:amd64 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... dpkg: mariadb-client-10.7: dependency problems, but removing anyway as you requested: mariadb-server-10.7 depends on mariadb-client-10.7 (>= 1:10.7.3+maria~buster). mariadb-client depends on mariadb-client-10.7 (>= 1:10.7.4+maria~buster). (Reading database ... 87804 files and directories currently installed.) Removing mariadb-client-10.7 (1:10.7.3+maria~buster) ... Setting up mysql-common (1:10.7.4+maria~buster) ... Setting up mariadb-common (1:10.7.4+maria~buster) ... (Reading database ... 87703 files and directories currently installed.) Preparing to unpack .../00-mariadb-server-10.7_1%3a10.7.4+maria~buster_amd64.deb ... /var/lib/mysql: found previous version 10.7 Unpacking mariadb-server-10.7 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../01-mariadb-server-core-10.7_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking mariadb-server-core-10.7 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Preparing to unpack .../02-mariadb-client-core-10.7_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking mariadb-client-core-10.7 (1:10.7.4+maria~buster) over (1:10.7.3+maria~buster) ... Selecting previously unselected package mariadb-client-10.7. Preparing to unpack .../03-mariadb-client-10.7_1%3a10.7.4+maria~buster_amd64.deb ... Unpacking mariadb-client-10.7 (1:10.7.4+maria~buster) ... Preparing to unpack .../04-libldap-common_2.4.47+dfsg-3+deb10u7_all.deb ... Unpacking libldap-common (2.4.47+dfsg-3+deb10u7) over (2.4.47+dfsg-3+deb10u6) ... Preparing to unpack .../05-libldap-2.4-2_2.4.47+dfsg-3+deb10u7_amd64.deb ... Unpacking libldap-2.4-2:amd64 (2.4.47+dfsg-3+deb10u7) over (2.4.47+dfsg-3+deb10u6) ... Preparing to unpack .../06-libavfilter7_7%3a4.1.9-0+deb10u1_amd64.deb ... Unpacking libavfilter7:amd64 (7:4.1.9-0+deb10u1) over (7:4.1.8-0+deb10u1) ... Preparing to unpack .../07-libswscale5_7%3a4.1.9-0+deb10u1_amd64.deb ... Unpacking libswscale5:amd64 (7:4.1.9-0+deb10u1) over (7:4.1.8-0+deb10u1) ... Preparing to unpack .../08-libavformat58_7%3a4.1.9-0+deb10u1_amd64.deb ... Unpacking libavformat58:amd64 (7:4.1.9-0+deb10u1) over (7:4.1.8-0+deb10u1) ... Preparing to unpack .../09-libavcodec58_7%3a4.1.9-0+deb10u1_amd64.deb ... Unpacking libavcodec58:amd64 (7:4.1.9-0+deb10u1) over (7:4.1.8-0+deb10u1) ... Preparing to unpack .../10-libswresample3_7%3a4.1.9-0+deb10u1_amd64.deb ... Unpacking libswresample3:amd64 (7:4.1.9-0+deb10u1) over (7:4.1.8-0+deb10u1) ... Preparing to unpack .../11-libpostproc55_7%3a4.1.9-0+deb10u1_amd64.deb ... Unpacking libpostproc55:amd64 (7:4.1.9-0+deb10u1) over (7:4.1.8-0+deb10u1) ... Preparing to unpack .../12-libavutil56_7%3a4.1.9-0+deb10u1_amd64.deb ... Unpacking libavutil56:amd64 (7:4.1.9-0+deb10u1) over (7:4.1.8-0+deb10u1) ... Preparing to unpack .../13-libxml2_2.9.14+dfsg-0+0~20220524.12+debian10~1.gbpc5dc45_amd64.deb ... Unpacking libxml2:amd64 (2.9.14+dfsg-0+0~20220524.12+debian10~1.gbpc5dc45) over (2.9.13+dfsg-0+0~20220410.11+debian10~1.gbp692312) ... Preparing to unpack .../14-libpq5_11.16-0+deb10u1_amd64.deb ... Unpacking libpq5:amd64 (11.16-0+deb10u1) over (11.14-0+deb10u1) ... Preparing to unpack .../15-nodejs_16.15.0-deb-1nodesource1_amd64.deb ... Unpacking nodejs (16.15.0-deb-1nodesource1) over (16.14.2-deb-1nodesource1) ... Preparing to unpack .../16-openjdk-11-jre_11.0.15+10-1~deb10u1_amd64.deb ... Unpacking openjdk-11-jre:amd64 (11.0.15+10-1~deb10u1) over (11.0.14+9-1~deb10u1) ... Preparing to unpack .../17-openjdk-11-jre-headless_11.0.15+10-1~deb10u1_amd64.deb ... Unpacking openjdk-11-jre-headless:amd64 (11.0.15+10-1~deb10u1) over (11.0.14+9-1~deb10u1) ... Preparing to unpack .../18-openssl_1.1.1n-0+deb10u2_amd64.deb ... Unpacking openssl (1.1.1n-0+deb10u2) over (1.1.1n-0+deb10u1) ... Preparing to unpack .../19-php8.1-bcmath_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-bcmath (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../20-php8.1-zip_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-zip (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../21-php8.1-xml_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-xml (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../22-php8.1-sqlite3_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-sqlite3 (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../23-php8.1-soap_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-soap (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../24-php8.1-readline_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-readline (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../25-php8.1-opcache_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-opcache (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../26-php8.1-mysql_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-mysql (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../27-php8.1-mbstring_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-mbstring (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../28-php8.1-intl_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-intl (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../29-php8.1-imap_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-imap (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../30-php8.1-gd_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-gd (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../31-php8.1-dev_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-dev (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../32-php8.1-curl_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-curl (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../33-php8.1-fpm_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-fpm (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../34-php8.1-cli_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-cli (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../35-php8.1-common_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_amd64.deb ... Unpacking php8.1-common (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../36-php8.1_8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1_all.deb ... Unpacking php8.1 (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) over (8.1.5-1+0~20220422.16+debian10~1.gbpfcaf04) ... Preparing to unpack .../44-sensu-go-agent_6.7.2-6283_amd64.deb ... Unpacking sensu-go-agent (6.7.2-6283) over (6.7.0-6196) ... Preparing to unpack .../45-filebeat_7.17.4_amd64.deb ... Unpacking filebeat (7.17.4) over (7.17.3) ... Setting up libssl1.1:amd64 (1.1.1n-0+deb10u2) ... Setting up openjdk-11-jre-headless:amd64 (11.0.15+10-1~deb10u1) ... Setting up openjdk-11-jre:amd64 (11.0.15+10-1~deb10u1) ... Setting up nodejs (16.15.0-deb-1nodesource1) ... Setting up libldap-common (2.4.47+dfsg-3+deb10u7) ... Setting up libavutil56:amd64 (7:4.1.9-0+deb10u1) ... Setting up libssl-dev:amd64 (1.1.1n-0+deb10u2) ... Setting up libpostproc55:amd64 (7:4.1.9-0+deb10u1) ... Setting up libmariadb3:amd64 (1:10.7.4+maria~buster) ... Setting up libmariadb-dev (1:10.7.4+maria~buster) ... Setting up sensu-go-agent (6.7.2-6283) ... Setting up libswscale5:amd64 (7:4.1.9-0+deb10u1) ... Setting up mariadb-server-core-10.7 (1:10.7.4+maria~buster) ... Setting up filebeat (7.17.4) ... Installing new version of config file /etc/filebeat/filebeat.reference.yml ... Configuration file '/etc/filebeat/filebeat.yml' ==> Modified (by you or by a script) since installation. ==> Package distributor has shipped an updated version. What would you like to do about it ? Your options are: Y or I : install the package maintainer's version N or O : keep your currently-installed version D : show the differences between the versions Z : start a shell to examine the situation The default action is to keep your current version. *** filebeat.yml (Y/I/N/O/D/Z) [default=N] ? Installing new version of config file /etc/filebeat/modules.d/azure.yml.disabled ... Setting up openssl (1.1.1n-0+deb10u2) ... Setting up libxml2:amd64 (2.9.14+dfsg-0+0~20220524.12+debian10~1.gbpc5dc45) ... Setting up libmariadb-dev-compat:amd64 (1:10.7.4+maria~buster) ... Installing all pip dependencies Requirement already satisfied: pika==1.2.0 in /usr/local/lib/python3.7/dist-packages (1.2.0) Setting up php8.1-common (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-imap (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-gd (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up libldap-2.4-2:amd64 (2.4.47+dfsg-3+deb10u7) ... Setting up libswresample3:amd64 (7:4.1.9-0+deb10u1) ... Setting up php8.1-curl (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-sqlite3 (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-xml (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-soap (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up mariadb-client-core-10.7 (1:10.7.4+maria~buster) ... Setting up php8.1-mysql (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-zip (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up libavcodec58:amd64 (7:4.1.9-0+deb10u1) ... Setting up php8.1-readline (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up mariadb-client-10.7 (1:10.7.4+maria~buster) ... Setting up php8.1-opcache (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-intl (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-bcmath (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up mariadb-client (1:10.7.4+maria~buster) ... Setting up php8.1-mbstring (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up libavformat58:amd64 (7:4.1.9-0+deb10u1) ... Setting up libpq5:amd64 (11.16-0+deb10u1) ... Setting up mariadb-server-10.7 (1:10.7.4+maria~buster) ... Installing new version of config file /etc/mysql/debian-start ... mariadb-extra.socket is a disabled or a static unit not running, not starting it. mariadb-extra.socket is a disabled or a static unit, not starting it. Setting up php8.1-cli (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1-dev (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up libavfilter7:amd64 (7:4.1.9-0+deb10u1) ... Setting up mariadb-server (1:10.7.4+maria~buster) ... Setting up php8.1-fpm (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Setting up php8.1 (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Processing triggers for hicolor-icon-theme (0.17-2) ... Processing triggers for libc-bin (2.28-10+deb10u1) ... Processing triggers for systemd (241-7~deb10u8) ... Processing triggers for man-db (2.8.5-2) ... Processing triggers for mime-support (3.62) ... Processing triggers for php8.1-cli (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... Processing triggers for php8.1-fpm (8.1.6-1+0~20220517.17+debian10~1.gbp6b3bd1) ... root@http-msh02:~# apt-cache policy libmariadb-dev libmariadb-dev-compat libmariadb3 mariadb-client mariadb-client-10.7 mariadb-client-core-10.7 mariadb-common mariadb-server mariadb-server-10.7 mariadb-server-core-10.7 mysql-common libmariadb-dev: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1:10.3.34-0+deb10u1 500 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages 1:10.3.25-0+deb10u1 500 500 http://security.debian.org/debian-security buster/updates/main amd64 Packages libmariadb-dev-compat: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1:10.3.34-0+deb10u1 500 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages 1:10.3.25-0+deb10u1 500 500 http://security.debian.org/debian-security buster/updates/main amd64 Packages libmariadb3: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1:10.3.34-0+deb10u1 500 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages 1:10.3.25-0+deb10u1 500 500 http://security.debian.org/debian-security buster/updates/main amd64 Packages mariadb-client: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 1:10.3.34-0+deb10u1 500 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages 1:10.3.25-0+deb10u1 500 500 http://security.debian.org/debian-security buster/updates/main amd64 Packages mariadb-client-10.7: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages mariadb-client-core-10.7: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages mariadb-common: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 1:10.3.34-0+deb10u1 500 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages 1:10.3.25-0+deb10u1 500 500 http://security.debian.org/debian-security buster/updates/main amd64 Packages mariadb-server: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 1:10.3.34-0+deb10u1 500 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages 1:10.3.25-0+deb10u1 500 500 http://security.debian.org/debian-security buster/updates/main amd64 Packages mariadb-server-10.7: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages mariadb-server-core-10.7: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages mysql-common: Installed: 1:10.7.3+maria~buster Candidate: 1:10.7.4+maria~buster Version table: 1:10.7.4+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages *** 1:10.7.3+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 100 /var/lib/dpkg/status 1:10.7.1+maria~buster 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages 5.8+1.0.5 500 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages root@http-msh02:~# apt-cache policy Package files: 100 /var/lib/dpkg/status release a=now 500 https://packages.sury.org/php buster/main amd64 Packages release o=deb.sury.org,a=buster,n=buster,c=main,b=amd64 origin packages.sury.org 500 https://packagecloud.io/sensu/stable/debian buster/main amd64 Packages release v=1,o=packagecloud.io/sensu/stable,a=buster,n=buster,l=stable,c=main,b=amd64 origin packagecloud.io 500 http://nginx.org/packages/mainline/debian buster/nginx amd64 Packages release v=10.0,o=nginx,a=stable,n=buster,l=nginx,c=nginx,b=amd64 origin nginx.org 100 http://debmirror.tuxis.nl/debian buster-backports/main amd64 Packages release o=Debian Backports,a=buster-backports,n=buster-backports,l=Debian Backports,c=main,b=amd64 origin debmirror.tuxis.nl 500 https://deb.nodesource.com/node_16.x buster/main amd64 Packages release o=Node Source,n=buster,l=Node Source,c=main,b=amd64 origin deb.nodesource.com 500 https://artifacts.elastic.co/packages/7.x/apt stable/main amd64 Packages release o=elastic,a=stable,n=stable,l=. stable,c=main,b=amd64 origin artifacts.elastic.co 500 https://apt.tuxis.nl/tuxis monitoring/main amd64 Packages release o=tuxis monitoring,a=monitoring,n=monitoring,l=tuxis monitoring,c=main,b=amd64 origin apt.tuxis.nl 500 https://apt.tuxis.nl/tuxis tuxis-cron/main amd64 Packages release o=tuxis tuxis-cron,a=tuxis-cron,n=tuxis-cron,l=tuxis tuxis-cron,c=main,b=amd64 origin apt.tuxis.nl 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main ppc64el Packages release o=MariaDB,n=buster,l=MariaDB,c=main,b=ppc64el origin ams2.mirrors.digitalocean.com 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main arm64 Packages release o=MariaDB,n=buster,l=MariaDB,c=main,b=arm64 origin ams2.mirrors.digitalocean.com 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.7/debian buster/main amd64 Packages release o=MariaDB,n=buster,l=MariaDB,c=main,b=amd64 origin ams2.mirrors.digitalocean.com 500 http://debmirror.tuxis.nl/debian buster-updates/main amd64 Packages release o=Debian,a=oldstable-updates,n=buster-updates,l=Debian,c=main,b=amd64 origin debmirror.tuxis.nl 500 http://security.debian.org/debian-security buster/updates/main amd64 Packages release v=10,o=Debian,a=oldstable,n=buster,l=Debian-Security,c=main,b=amd64 origin security.debian.org 500 http://debmirror.tuxis.nl/debian buster/main amd64 Packages release v=10.12,o=Debian,a=oldstable,n=buster,l=Debian,c=main,b=amd64 origin debmirror.tuxis.nl Pinned packages: ``` -- With kind regards, William Edwards

1 0

[Maria-discuss] In memory DB, how to in MariaDB?
by Eliezer Croitoru 23 May '22

23 May '22

I have seen the next blog post which had a video at 2014: https://blogs.oracle.com/pcoe/post/the-future-of-the-database-begins The demo video was removed from YouTube for some reason but I had a copy of it at: https://cloud1.ngtech.co.il/static/oracle/Oracle%20Database%20In-Memory%20Po wering%20the%20Real-Time%20Enterprise%20.mp4 I am not a MariaDB or MySQL or DB in general expert and was wondering if there is something these days in MariaDB that can be used in comparison to what Oracle DB demo shows? I have used LevelDB as a backend in a customized DB and it worked very very fast and it is great. With batches it works even faster but in general it works faster then standard MariaDB setups I have implemented. So what are the options? I have millions of values and I would like to be able to insert and select as fast as possible on a single DB Server. Currently I am using a Caching tier with a specific TTL to lower the stress off the DB, but, is I possible to make the DB Faster like maybe with some writeback (leaving aside fault tolerance for speed). Thanks, Eliezer ---- Eliezer Croitoru NgTech, Tech Support Mobile: +972-5-28704261 Email: <mailto:ngtech1ltd@gmail.com> ngtech1ltd(a)gmail.com

3 4

[Maria-discuss] Debian revision should not contain codename
by William Edwards 19 May '22

19 May '22

Hi, I'm attempting to upgrade a machine with MariaDB 10.6 from Buster to Bullseye using the official MariaDB repo. I was surprised to see that apt wanted to downgrade a few packages: ``` $ apt upgrade --without-new-pkgs The following packages will be DOWNGRADED: libmariadb-dev libmariadb-dev-compat libmariadb3 mysql-common ``` I was confused at first, as the priority of the candidate is higher, and the epoch is unchanged, and the upstream version is unchanged: ``` $ apt policy mysql-common mysql-common: Installed: 1:10.6.7+maria~buster Candidate: 1:10.6.7+maria~bullseye Version table: *** 1:10.6.7+maria~buster 100 100 /var/lib/dpkg/status 1:10.6.7+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main ppc64el Packages 1:10.6.5+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main ppc64el Packages 1:10.6.4+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main arm64 Packages 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main ppc64el Packages 5.8+1.0.7 500 500 http://debmirror.tuxis.nl/debian bullseye/main amd64 Packages $ apt policy libmariadb3 libmariadb3: Installed: 1:10.6.7+maria~buster Candidate: 1:10.6.7+maria~bullseye Version table: *** 1:10.6.7+maria~buster 100 100 /var/lib/dpkg/status 1:10.6.7+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.6.5+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.6.4+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.5.15-0+deb11u1 500 500 http://debmirror.tuxis.nl/debian bullseye/main amd64 Packages $ apt policy libmariadb-dev-compat libmariadb-dev-compat: Installed: 1:10.6.7+maria~buster Candidate: 1:10.6.7+maria~bullseye Version table: *** 1:10.6.7+maria~buster 100 100 /var/lib/dpkg/status 1:10.6.7+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.6.5+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.6.4+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.5.15-0+deb11u1 500 500 http://debmirror.tuxis.nl/debian bullseye/main amd64 Packages $ apt policy libmariadb-dev libmariadb-dev: Installed: 1:10.6.7+maria~buster Candidate: 1:10.6.7+maria~bullseye Version table: *** 1:10.6.7+maria~buster 100 100 /var/lib/dpkg/status 1:10.6.7+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.6.5+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.6.4+maria~bullseye 1000 1000 http://ams2.mirrors.digitalocean.com/mariadb/repo/10.6/debian bullseye/main amd64 Packages 1:10.5.15-0+deb11u1 500 500 http://debmirror.tuxis.nl/debian bullseye/main amd64 Packages ``` A simulation also reported that apt would 'downgrade' to the same versions: ``` $ apt upgrade --without-new-pkgs -s Inst libmariadb-dev [1:10.6.7+maria~buster] (1:10.6.7+maria~bullseye MariaDB:ams2.mirrors.digitalocean.com [amd64]) [] Inst libmariadb-dev-compat [1:10.6.7+maria~buster] (1:10.6.7+maria~bullseye MariaDB:ams2.mirrors.digitalocean.com [amd64]) [] Inst libmariadb3 [1:10.6.7+maria~buster] (1:10.6.7+maria~bullseye MariaDB:ams2.mirrors.digitalocean.com [amd64]) Inst mysql-common [1:10.6.7+maria~buster] (1:10.6.7+maria~bullseye MariaDB:ams2.mirrors.digitalocean.com [all]) ``` Some folks on IRC pointed me to the fact that the Debian revision has been updated from `maria~buster` to `maria~bullseye`. The following documentation at https://www.debian.org/doc/debian-policy/ch-controlfields.html#special-vers… says: > The lexical comparison is a comparison of ASCII values modified so that > all the letters sort earlier than all the non-letters and so that a > tilde sorts before anything, even the end of a part. 'bul' comes before 'bus', so the package for Bullseye is perceived as older, despite it being the same effective upstream version... According to https://www.debian.org/doc/debian-policy/ch-controlfields.html#special-vers…, the Debian revision should NOT contain the Debian release codename. This problem will re-appear with Bookworm. Could the package maintainer(s) attend to this? -- With kind regards, William Edwards

2 2

Re: [Maria-discuss] MariaDB latest source tarballs missing
by Sergei Golubchik 19 May '22

19 May '22

Hi, Shreenidhi, On May 19, Shreenidhi Shedi wrote: > > I am from VMware Photon OS engineering team. > > We are trying to fix few CVEs that are being reported in 10.2.x & > 10.3.x versions of MariaDB. > > There is release note for v10.2.44 but I cannot find the source > tarball in downloads page or in github tags of maria db server. You cannot find it, because it wasn't released yet. > https://mariadb.com/kb/en/mariadb-10244-release-notes/ This page says, on the very top, in a red box: Note: This page describes features in the source repository for MariaDB 10.2. There are currently no official packages or binaries available for download which contain the features. If you want to try out any of the new features described here you will need to get and compile the code yourself. > Can you guys please help me out here? Where can I get the latest > released source tarballs? https://mariadb.org/download/ > Also, when can we expect a fix for this? If at all this is not > released, when can we expect next release of MariaDB server versions? Any day now. Regards, Sergei VP of MariaDB Server Engineering and security(a)mariadb.org

1 0

[Maria-discuss] Galera: jump through major versions at once
by William Edwards 19 May '22

19 May '22

Hi, Does Galera support rolling upgrades between multiple major versions? I will be upgrading my Galera cluster from MariaDB 10.3.34 to 10.6.x. It'd save a lot of time to jump straight from 10.3 to 10.6 instead of upgrading 10.3 -> 10.4 -> 10.5 -> 10.6. The documentation at https://mariadb.com/kb/en/upgrading-from-mariadb-103-to-mariadb-104-with-ga… implies that the MariaDB version is irrelevant, and only the Galera version matters. > Next, make sure that the Galera version numbers are compatible. > > If you are upgrading from the most recent MariaDB 10.3 release to > MariaDB 10.4, then the versions will > be compatible. MariaDB 10.3 uses Galera 3 (i.e. Galera wsrep provider > versions 25.3.x), and MariaDB > 10.4 uses Galera 4 (i.e. Galera wsrep provider versions 26.4.x). This > means that upgrading to MariaDB > 10.4 also upgrades the system to Galera 4. However, Galera 3 and Galera > 4 should be compatible for the > purposes of a rolling upgrade, as long as you are using Galera 26.4.2 > or later. -- With kind regards, William Edwards

2 3

[Maria-discuss] FLUSH TABLES ... FOR EXPORT SLOW
by mariadb＠Biblestuph.com 18 May '22

18 May '22

I've recently updated from 10.3.14 => 10.6.7, and am running into an issue where FLUSH TABLES ... FOR EXPORT is sometimes very slow on large tables. One particular table that it seems to happen on often is over 20G. It doesn't hang, per se; it will complete eventually, but can take an hour or more. 2022-05-17 0:14:06 105636 [Note] InnoDB: Sync to disk of `MyDB`.`t1` started. 2022-05-17 0:14:06 105636 [Note] InnoDB: Writing table metadata to './MyDB/t1.cfg' 2022-05-17 0:14:06 105636 [Note] InnoDB: Table `MyDB`.`t1` flushed to disk 2022-05-17 0:14:06 105636 [Note] InnoDB: Sync to disk of `MyDB`.`t2` started. 2022-05-17 1:49:53 105636 [Note] InnoDB: Writing table metadata to './MyDB/t2.cfg' 2022-05-17 1:49:53 105636 [Note] InnoDB: Table `MyDB`.`t2` flushed to disk in the above the obfuscated table name t2 took about 1.5 hours to complete. In the previous version (10.3.14), these were always nearly instantaneous, even for the largest tables. At the time I'm executing the FLUSH TABLES the slave is stopped on the DB and there are no other users logged in to the DB (other than myself). I know from the docs that FLUSH TABLES has seen changes since my previous version, but I'm not clear as to what the process is waiting for (or how to avoid it). Shutting down the server first (I have innodb_fast_shutdown = 0) seems to prevent it; and the shutdown generally only takes 5-10 minutes or so. But I'd rather not shutdown if I don't have to (and I'm not 100% convinced that I won't someday see the issue in that scenario, as well). I've also tried this sequence thinking it might help: ---> STOP SLAVE Wed May 18 10:30:13 2022 ---> SLAVE STOPPED Wed May 18 10:30:13 2022 ---> FLUSH LOCAL TABLES WITH READ LOCK Wed May 18 10:30:14 2022 ---> UNLOCK TABLES Wed May 18 10:30:15 2022 ---> SET GLOBAL innodb_purge_rseg_truncate_frequency = 1 Wed May 18 10:30:15 2022 ---> SET GLOBAL innodb_max_purge_lag_wait = 0 Wed May 18 10:30:15 2022 ---> FLUSH TABLES ... FOR EXPORT Wed May 18 10:30:15 2022 but the FLUSH TABLES FOR EXPORT still waits on that large table. Is there a way to make this happen quicker without requiring the DB to be shutdown first? Or am I missing something else in the process? Thanks, Dan

1 0

[Maria-discuss] A federation bug was identified.
by 최혁규 11 May '22

11 May '22

A federation bug was identified. I have confirmed that the select where query does not work in the multi index field of some federated tables. A field in the table is used as a multi index. My server version : 10.8.2-MariaDB However, there is no problem with the server used in the previous version. The previous version is Server version: 10.5.10-MariaDB. The tested method was compared by creating a federated table on two servers with different versions. 1. 10.5.10 - MariaDB -> All queries are normally searched. 2. 10.8.2 - MariaDB -> Symptoms were confirmed in some multi index types. --> The table field datatype is (int, datetime) This is the table I created and the select query. Table Created CREATE TABLE `fd_partner_detail` ( `partner_id` varchar(100) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '파트너ID', `business_name` varchar(45) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '사업자상호명', `business_no` varchar(45) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '사업자번호', `online_marketing_business_no` varchar(45) NOT NULL DEFAULT '' COMMENT '통신판매업 신고번호', `representative` varchar(45) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '대표자명', `business_category` char(50) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '종목', `business_status` char(50) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '업종형태', `contact` varchar(45) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '연락처', `courier_code` varchar(45) NOT NULL DEFAULT '0' COMMENT '택배사코드', `postal_code` varchar(45) DEFAULT NULL COMMENT '우편번호', `address` varchar(45) DEFAULT NULL COMMENT '주소(도로명)', `address_detail` varchar(45) DEFAULT NULL COMMENT '상세주소', `officer` varchar(45) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '대표담당자명', `officer_contact` varchar(45) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '대표담당자연락처', `officer_email` varchar(45) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '대표담당자이메일', `order_officer` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '발주담당자명', `order_officer_contact` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '발주담당자연락처', `order_officer_email` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '발주담당자이메일', `calculate_order_officer` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '정산담당자명', `calculate_officer_contact` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '정산담당자연락처', `calculate_officer_email` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '정산담당자이메일', `cs_order_officer` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT 'CS담당자명', `cs_officer_contact` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT 'CS담당자연락처', `cs_officer_email` varchar(45) CHARACTER SET utf8mb3 DEFAULT '' COMMENT 'CS담당자이메일', `product_name` varchar(100) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '대표상품명', `product_url` varchar(255) CHARACTER SET utf8mb3 NOT NULL DEFAULT '' COMMENT '대표상품URL', `product_type` int(1) NOT NULL DEFAULT 0 COMMENT '대표상품제조구분 (1: 제조, 2:벤더)', `add_product_name_1` varchar(100) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '선택상품명1', `add_product_url_1` varchar(255) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '선택상품URL1', `add_product_type_1` int(1) DEFAULT 0 COMMENT '선택상품제조구분1', `add_product_name_2` varchar(100) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '선택상품명2', `add_product_url_2` varchar(255) CHARACTER SET utf8mb3 DEFAULT '' COMMENT '선택상품URL2', `add_product_type_2` int(1) DEFAULT 0 COMMENT '선택상품제조구분2', `calculate_bank_code` varchar(45) NOT NULL DEFAULT '' COMMENT '정산은행코드', `calculate_bank_no` varchar(45) NOT NULL DEFAULT '' COMMENT '정산계좌번호', `calculate_bank_name` varchar(45) NOT NULL DEFAULT '' COMMENT '정산예금주명', `file_bankbook` varchar(255) DEFAULT '' COMMENT '통장사본', `original_bankbook` varchar(255) DEFAULT '' COMMENT '통장사본원본명', `file_business_license` varchar(255) DEFAULT '' COMMENT '사업자등록증', `original_business_license` varchar(255) DEFAULT '' COMMENT '사업자등록증원본명', `file_document` varchar(255) DEFAULT '' COMMENT '기타서류', `original_document` varchar(255) DEFAULT '' COMMENT '기타서류원본명', `is_terms_service` int(1) NOT NULL DEFAULT 0 COMMENT '쇼핑몰이용약관동의여부', `is_privacy_consent` int(1) NOT NULL DEFAULT 0 COMMENT '개인정보처리방침동의여부', `join_status` int(1) NOT NULL DEFAULT 1 COMMENT '가입승인상태(1: 입점대기, 2: 입점반려, 3:입점승인, 4:입점불가)', `return_cause` text CHARACTER SET utf8mb3 DEFAULT NULL COMMENT '가입반려사유', `calculate_type` int(1) NOT NULL DEFAULT 1 COMMENT '정산주기유형(1:15일, 2:30일)', `dormant_change_date` datetime DEFAULT NULL COMMENT '휴면전환일', `dormant_cancel_date` datetime DEFAULT NULL COMMENT '휴면해제일', `join_date` datetime DEFAULT NULL COMMENT '가입승인일', `is_withdraw` int(1) NOT NULL DEFAULT 0 COMMENT '탈퇴회원여부', `introduce` text DEFAULT NULL COMMENT '회사소개', `memo` varchar(255) DEFAULT '' COMMENT '관리자 메모', `corporation_code` varchar(45) CHARACTER SET utf8mb3 NOT NULL COMMENT '회사코드', `marketplace_code` varchar(45) CHARACTER SET utf8mb3 NOT NULL COMMENT '쇼핑몰코드', `is_abolished` int(1) NOT NULL DEFAULT 0 COMMENT '삭제여부', `is_popup` int(1) DEFAULT 0 COMMENT '입점 승인', `application_code` varchar(45) CHARACTER SET utf8mb3 DEFAULT NULL COMMENT '어플리케이션코드', `created_by` varchar(45) CHARACTER SET utf8mb3 DEFAULT NULL COMMENT '생성자', `created_date` datetime DEFAULT NULL COMMENT '생성일', `modified_by` varchar(45) CHARACTER SET utf8mb3 DEFAULT NULL COMMENT '수정자', `modified_date` datetime DEFAULT NULL COMMENT '수정일', `abolished_by` varchar(45) CHARACTER SET utf8mb3 DEFAULT NULL COMMENT '삭제자', `abolished_date` datetime DEFAULT NULL COMMENT '삭제일', PRIMARY KEY (`partner_id`), KEY `IDX_R_1` (`is_abolished`), KEY `IDX_R_2` (`created_date`), KEY `IDX_U_1` (`courier_code`), KEY `IDX_U_2` (`postal_code`), KEY `IDX_U_3` (`calculate_bank_code`) ) ENGINE=FEDERATED DEFAULT CHARSET=utf8mb4 ROW_FORMAT=DYNAMIC COMMENT='파트너상세정보' CONNECTION='fdc_partner_bh/fo_partner_detail' Table Select Query SELECT business_no, representative, business_name, contact, partner_id ,is_abolished FROM fd_partner_detail WHERE created_date = '1'; Select Query Result business_no representative business_name contact partner_id is_abolished ----------- -------------- ------------- ------- ---------- -------------- I want to know if what I checked is a bug.

2 1

[Maria-discuss] mariabackup is slow (log scanned up to)
by John Pace 29 Apr '22

29 Apr '22

Hi, I am using mariabackup to backup a database. On day 1 a full backup with mariabackup --backup --user=Backup --password=my-password --target-dir=path-to-full and on day 2-7 a incremental backup with mariabackup --backup --user=Backup --password=my-password --target-dir=path-to-inc --incremental-basedir=path-to-full Then follows again a new backup for day 1 and so on. The database can be used while the backup is running. A web application for Apache Tomcat uses the database. This worked very well for a couple of weeks, the backup was finished within 20 minutes. But recently I noticed that the incremental backup took much longer than before. I checked the output of mariabackup and it was spammed several hours with lines like these [00] 2022-04-20 00:48:00 >> log scanned up to (1747989580536) [00] 2022-04-20 00:48:01 >> log scanned up to (1747989580536) [00] 2022-04-20 00:48:02 >> log scanned up to (1747989580536) 2022-04-20 0:48:03 0 [Note] InnoDB: Read redo log up to LSN=1747989580800 [00] 2022-04-20 00:48:03 >> log scanned up to (1747989580536) [00] 2022-04-20 00:48:04 >> log scanned up to (1747989580536) [00] 2022-04-20 00:48:05 >> log scanned up to (1747989580536) [00] 2022-04-20 00:48:06 >> log scanned up to (1747989580536) Yesterday the incremental backup took 7 hours so I wonder if there is something wrong. MariaDB shows no error in the log: 2022-03-15 8:35:48 0 [Note] InnoDB: Using Linux native AIO 2022-03-15 8:35:48 0 [Note] InnoDB: Uses event mutexes 2022-03-15 8:35:48 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2022-03-15 8:35:48 0 [Note] InnoDB: Number of pools: 1 2022-03-15 8:35:48 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2022-03-15 8:35:48 0 [Note] InnoDB: Initializing buffer pool, total size = 134217728, chunk size = 134217728 2022-03-15 8:35:48 0 [Note] InnoDB: Completed initialization of buffer pool 2022-03-15 8:35:48 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2022-03-15 8:35:49 0 [Note] InnoDB: 128 rollback segments are active. 2022-03-15 8:35:49 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2022-03-15 8:35:49 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2022-03-15 8:35:49 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2022-03-15 8:35:49 0 [Note] InnoDB: 10.5.8 started; log sequence number 1741176510061; transaction id 38228169 2022-03-15 8:35:49 0 [Note] Plugin 'FEEDBACK' is disabled. 2022-03-15 8:35:49 0 [Note] InnoDB: Loading buffer pool(s) from /path-to-database/ib_buffer_pool 2022-03-15 8:35:49 0 [Note] Server socket created on IP: '::'. 2022-03-15 8:35:50 0 [Note] InnoDB: Buffer pool(s) load completed at 220315 8:35:50 2022-03-15 8:35:50 0 [Note] /path-to-mariadb/bin/mariadbd: ready for connections. Version: '10.5.8-MariaDB' socket: '/tmp/mysql.sock' port: 3306 MariaDB Server PS: Sorry for my test-post. ------------------------------------------------------------------------------------------------- FreeMail powered by mail.de - MEHR SICHERHEIT, SERIOSITÄT UND KOMFORT

1 0

[Maria-discuss] test
by John Pace 29 Apr '22

29 Apr '22

------------------------------------------------------------------------------------------------- FreeMail powered by mail.de - MEHR SICHERHEIT, SERIOSITÄT UND KOMFORT

1 0

[Maria-discuss] Understanding SQL queries
by João Paulo Almeida 14 Apr '22

14 Apr '22

Dear MariaDB Users, We are currently carrying out some research on the understanding and usability of different relational schemas (as part of a Ph.D. student's thesis work). We would like to invite you to contribute to this research by answering a small number of questions on SQL query interpretation. Participation is via an anonymous form and there are only 7 questions, so it should not take more than 10 minutes of your time: https://forms.gle/EA2jYGf4CTmLfEiaA We thank you in advance and would appreciate it if you could also share this research with colleagues who also have a background on SQL. thank you, João Paulo A. Almeida Federal University of Espírito Santo

2 1

[Maria-discuss] mysql 5.5 client vs mariadb 10 server
by Oliver 22 Mar '22

22 Mar '22

Hi, I'm sorry for the question if it is clear that it isn't possible. I'm trying connect from a mysql 5.5.56 client against a mariadb 10 server and I'm having the next error: ERROR 2003 (HY000): Can't connect to MySQL server on 'server' (10061) Subnet source is allowed in mariadb server and grant is given for 'root'@'source_server', it is allowed both IP and hostname. So not sure if it is config problem or compatibility problem. Someone knows please? Thanks beforehand. P.D.: I can connect using dbeaver from my computer client using mysql binaries (but not sure what mysql client version uses dbeaver). Cheers...

4 5

[Maria-discuss] History Length: Purge-able vs. Not Purge-able metrics
by mariadb＠Biblestuph.com 10 Mar '22

10 Mar '22

Greetings, I know I can get the current undo log history length via: > show status like '%history%'; +----------------------------+-------+ | Variable_name | Value | +----------------------------+-------+ | Innodb_history_list_length | 854 | +----------------------------+-------+ but my understanding is that at any given point in time that number represents both the records that can be purged because they are no longer needed by any current transactions (and the purge threads for whatever reason haven't gotten to them yet), as well as those that cannot be purged yet because there are current transactions running that may still need them. So the question is, is there any way to know the difference between those two? I.E., how many are waiting to be purged and how many cannot yet be purged? And a related question. Will the undo log size (the physical size of the file) grow even when there are many entries in the history that can be purged first? Or are those unneeded records purged first and that space reused before the undo log is made larger? Or perhaps I'm mis-understanding the process? TIA, Dan

1 0

[Maria-discuss] Unable to find specific format for mariaDB 10.6.*
by ragul rangarajan 25 Feb '22

25 Feb '22

Hi Team, I try to get MariaDB 10.6.* *bintar-linux-x86_64 tar* from http://archive.mariadb.org/ But I couldn't find any other formats except *bintar-linux-systemd-x86_64 *as in the older version. Can someone please share where to get* bintar-linux-x86-64 *for 10.6.* MariaDB version as like below for 10.5.* https://archive.mariadb.org/mariadb-10.5.15/bintar-linux-x86_64/mariadb-10.… Thanks and regards, Ragul

3 4

[Maria-discuss] demo: running MariaDB with rootless Podman and socket activation
by Erik Sjölund 17 Feb '22

17 Feb '22

Hi, Support for socket activation was added to MariaDB in release 10.6 (released April 2021). Podman also supports socket activation so I thought it would be interesting to combine both of them into a systemd user service. I wrote a small demo: https://github.com/eriksjolund/mariadb-podman-socket-activation (tweet: https://twitter.com/eriksjolundcomp/status/1491162016429768704) and got it to work. Do you have any suggestions on how to improve this? Thanks, Erik Sjölund

2 3

[Maria-discuss] Fwd: [MariaDB Announce] MariaDB 10.8.1 RC and MariaDB 10.7.2, 10.6.6, 10.5.14, 10.4.23, 10.3.33 and 10.2.42 now available
by Reindl Harald 10 Feb '22

10 Feb '22

https://downloads.mariadb.org/mariadb/10.3.33/ points to a form with 10.6 preselected because a redirect to https://mariadb.org/download/?t=mariadb&p=mariadb&r=10.6.5&os=Linux&cpu=x86… and in that useless form 10.3.32 is the newest you can select when trying to download sources is there a reason why such nonsense on download pages is developed other than "some people need to be busy"? when you change to 10.3 and have selcted "source" before the form goes back to Linux with systemd as selection head - table - match -------- Weitergeleitete Nachricht -------- Betreff: [MariaDB Announce] MariaDB 10.8.1 RC and MariaDB 10.7.2, 10.6.6, 10.5.14, 10.4.23, 10.3.33 and 10.2.42 now available MariaDB 10.3.33 - Release Notes: https://mariadb.com/kb/en/mdb-10333-rn/ - Changelog: https://mariadb.com/kb/en/mdb-10333-cl/ - Downloads: https://downloads.mariadb.org/mariadb/10.3.33/

2 1

[Maria-discuss] Weird behavior in Fedora 34 server
by Miguel Lavalle 05 Jan '22

05 Jan '22

Hi, I am installing MariaDB in Fedora 34 server with the following sequence of commands: sudo dnf upgrade -y sudo dnf install -y mariadb-server mariadb-devel sudo dnf -y install git vim With this sequence of commands, I get the following installed: $ mysql --version mysql Ver 15.1 Distrib 10.5.13-MariaDB, for Linux (x86_64) using EditLine wrapper and I can successfully perform the initial setup of the root password: sudo mysqladmin -u root password password and continue with the rest of my installation. However, if I change the sequence of commands to: sudo dnf upgrade -y sudo dnf -y install git vim sudo dnf install -y mariadb-server mariadb-devel What I get installed instead is: $ mysql --version mysql Ver 8.0.27 for Linux on x86_64 (Source distribution) and the 'sudo mysqladmin -u root password password' command fails with: mysqladmin: unable to change password; error: 'You have an error in your SQL syntax; check the manual that corresponds to your MariaDB server version for the right syntax to use near '() IDENTIFIED BY 'secretdatabase'' at line 1' Could anyone shed some light on this? Thanks!

3 8

[Maria-discuss] Incremental backup with mariabackup and run-mariabackup
by Dave Wreski 02 Jan '22

02 Jan '22

Hi, I'm using mariadb-10.5.13 on fedora34 with run-mariabackup from https://github.com/omegazeng/run-mariabackup. Has anyone used this backup script or have any recommendations for ones that help to automate the process of using mariabackup for backups? This script appears to create an infinite amount of incremental backups once the original full backup is created. I believe this makes it necessary to restore each of the incrementals on top of the base. If the backups are stored off-site, this creates magnitudes more data that's needed to restore, and increases the time to restore it. It also only appears possible to backup the entire system, not just individual databases. Do you have any recommendations for other scripts that ease the process of making and restoring backups? Thanks, Dave

1 0

[Maria-discuss] sys schema backup
by William Edwards 04 Dec '21

04 Dec '21

Hi, The 'sys' schema is documented to be "A collection of views, functions and procedures to help MySQL administrators get insight in to MySQL Database usage." Is there anything in this schema that should be backed up, or can I skip it when creating backups? -- With kind regards, William Edwards

3 2

[Maria-discuss] [Warning] WSREP: certification interval for trx source [...] exceeds the limit of 16384
by Giovanni Agozzino 01 Dec '21

01 Dec '21

Hi people, I'm relatively new to Mariadb+Galera and I'm trying to understand how to manage when a node goes down the best way. I don’t know if this is the right place to ask. If not, I’d appreciate suggestions for where to ask. I am using 1:10.6.5+maria~hirsute galera-4 26.4.9-hirsute I would understand what is the meaning of the warning: [Warning] WSREP: certification interval for trx source [...] exceeds the limit of 16384 and what are the ways to avoid it. I'll explain when I encounter it: I shut down one of my three mariadb nodes during peak hours and I wait to restart it until a SST is triggered. The SST is succesfully done (both the donor and the joiner go without errors). But when applying the IST post SST to keep up with the latest transactions, I see these warning in both donor (before switching from donor/desynced to synced state) and joiner (after completing SST). What is the implication of this warning? I suppose is not the certification failing or I would have errors, but I don't know if is serious business or not. And there is a parameter to tune in the way to avoid this warning? Thank you very much. Best regards, Giovanni

1 0

[Maria-discuss] Question about MariaDB Xpand
by huan zhang 30 Nov '21

30 Nov '21

Hi all, I have some questions about MariaDB Xpand. Not sure whether here is the right place to ask questions or not. If not, appreciate for the suggestions of where to ask. I firstly put my questions here, let's assume the performance topology: 1. Every node of Xpand can read and write as described in white paper, but my question is does MariaDB Xpand support Multi-Master to finish the Global Transactions? There is only one global transaction manager(GTM) or there exists multiple GTM workers at the same time? 2. What's the usage of Paxos in Xpand? If there is only one GTM at a time, it's easy to understand: Paxos is used to determine which is the leader (GTM). 3. MPP feature of Xpand is misleading and the document is too simple to understand the internals of MPP implementation. Queries are splitted into sub query fragments and it seems that each fragment can only do every single work. So can it support Hash Join? e.g. a join fragment builds a hash table for a small table firstly and then probes the big table from the remote node? Thanks in advance. Hubert Zhang

1 0

[Maria-discuss] Issue with MariaDB backup using LVM snapshot
by Riccardo Brunetti > 29 Nov '21

29 Nov '21

Hello. We are using a backup procedure based on a combination of LVM snapshots and rsync. In particular, the procedure is the following: > ... > mysql -h -u -p -e "FLUSH TABLES WITH READ LOCK; \! lvcreate -L -s -n " > > mount > > ... > > rsync ....... At the end, we change the working directory, unmount and lvremove . Sometimes, randomly, the umount command works but the lvremove fails and we are left with the lvm snapshot unmounted but we are unable to remove it. We tried to force a removal without success with the following error: > Logical volume contains a filesystem in use We didn't find any process using that device using lsof and we can't find any handler keeping the device busy. Even a mariadb restart doesn't fix it and the only solution is to reboot the server. The only thing we noticed is a message upon the snapshot creation: > File descriptor 4 (socket:[201844800]) leaked on lvcreate invocation. Parent PID 1564033: mysql We know that this is the mysql unix socket. Have you ever had such an issue? Thanks a lot. Kind regards. Riccardo

1 0

[Maria-discuss] MyISAM: single table GROUP BY plan changes based on LIMIT. BUG?
by Vassilis Virvilis 26 Nov '21

26 Nov '21

2 4

[Maria-discuss] mariadb 10.4.13-lp152.1.1 to 10.5.12-3.9.1 upgrade failure
by Marc Chamberlin 25 Nov '21

25 Nov '21

Hello - I have ran into a problem that maybe someone else has hit and knows a solution for it. I recently upgraded my OpenSuSE 15.2 x64 version to OpenSuSE 15.3 x64 and installed all additional updates and patches that were suggested for 15.3. Most of the upgrade succeeded, all except Mariadb. Google has not been helpful either. My understanding of Mariadb is that after a new install of a new version it is suppose to automagically update and fix the databases from the older version, when the server is restarted, but I think this is failing. I found the upgrade log file for Mariadb and it appears to be reporting some kind of corruption has occurred. This is preventing the mariadb (mysql) server from even starting, so it is not possible to use queries to find and repair the database. - > bigbang:/var/tmp/mysql-protected.lBP2YQ # more log_upgrade_run.err > 2021-10-31 12:11:36 0 [Note] InnoDB: !!! innodb_force_recovery is set > to 1 !!! > 2021-10-31 12:11:36 0 [Note] InnoDB: Uses event mutexes > 2021-10-31 12:11:36 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 > 2021-10-31 12:11:36 0 [Note] InnoDB: Number of pools: 1 > 2021-10-31 12:11:36 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions > 2021-10-31 12:11:36 0 [Note] mysqld: O_TMPFILE is not supported on > /tmp (disabling future attempts) > 2021-10-31 12:11:36 0 [Note] InnoDB: Using Linux native AIO > 2021-10-31 12:11:36 0 [Note] InnoDB: Initializing buffer pool, total > size = 134217728, chunk size = 134217728 > 2021-10-31 12:11:36 0 [Note] InnoDB: Completed initialization of > buffer pool > 2021-10-31 12:11:36 0 [ERROR] InnoDB: corrupted TRX_NO 5f737461748dea16 > 2021-10-31 12:11:36 0 [Note] InnoDB: Retry with innodb_force_recovery=5 > 2021-10-31 12:11:36 0 [ERROR] InnoDB: Plugin initialization aborted > with error Data structure corruption > 2021-10-31 12:11:36 0 [Note] InnoDB: Starting shutdown... > 2021-10-31 12:11:36 0 [ERROR] Plugin 'InnoDB' init function returned > error. > 2021-10-31 12:11:36 0 [ERROR] Plugin 'InnoDB' registration as a > STORAGE ENGINE failed. > 2021-10-31 12:11:36 0 [Note] Plugin 'FEEDBACK' is disabled. > 2021-10-31 12:11:36 0 [ERROR] Unknown/unsupported storage engine: InnoDB > 2021-10-31 12:11:36 0 [ERROR] Aborting On a hunch, I decided to install the OpenSuSE OSS repository for 15.2 and this allowed me to drop back and install version 10.4.13-lp152.1.1 of the mariadb server, client, errormessages, and tools packages. (OpenSuSE 15.3 wants to install version 10.5.12-3.9.1 of these mariadb packages.) And lo and behold the previous 10.4.13-lp152.1.1 package works fine! So what gives? Any idea why the upgraded version of mariadb packages are failing to upgrade and support my databases? As I said I have tried Googling for an answer but no joy finding one. A lot of the proposed solutions, Google found, assume the mariadb server is up and running (hump!) so the example solutions given, use mysql queries and commands to fix corrupt databases and tables. I should also point out that AFAIK most, if not all of my database structures are using InnoDB and not the older MYISAM structures (although the mysql database itself appears to have both). I did make a mariadb backup of all the databases but without the ability to start the mariadb server I don't know how to make use of this backup file to reconstruct all the databases and their tables etc. Thanks in advance for any and all advice on how to upgrade my mariadb server. Marc Chamberlin -- *"The Truth is out there" - Spooky* -- *_ _ . . . . . . _ _ . _ _ _ _ . . . . _ . . . . _ _ . _ _ _ . . . . _ _ . _ . . _ . _ _ _ _ . _ . _ . _ . _ . * Computers: the final frontier. These are the voyages of the user Marc. His mission: to explore strange new hardware. To seek out new software and new applications. To boldly go where no Marc has gone before! (/This email is digitally signed. My public key for sending encrypted email to me can be found at - https://keys.openpgp.org/search?q=marc@domesweetdome.us.com or just ask me for it and I will send it to you as an attachment. If you don't understand, no worries, just ignore it and/or ask me to explain it further./)

5 12

[Maria-discuss] Failed DDL on Galera
by William Edwards 23 Nov '21

23 Nov '21

Hi, A customer ran an 'ALTER TABLE' query, which failed. This caused Galera slaves to shut themselves down: 2021-11-23 9:35:25 1 [ERROR] Slave SQL: Column 2 of table 'inserve_fpfvxiqm.invoices' cannot be converted from type 'date' to type 'int(10) unsigned', Internal MariaDB error code: 1677 2021-11-23 9:35:25 1 [Warning] WSREP: RBR event 17 Update_rows_v1 apply warning: 3, 28891485 2021-11-23 9:35:25 1 [Warning] WSREP: Failed to apply app buffer: seqno: 28891485, status: 1 at /home/buildbot/buildbot/build/galera/src/trx_handle.cpp:apply():353 [ 3 more times ] 2021-11-23 9:35:25 1 [Warning] WSREP: RBR event 17 Update_rows_v1 apply warning: 3, 28891485 2021-11-23 9:35:26 1 [ERROR] WSREP: Failed to apply trx: source: 41c479ab-0527-11ec-9fcc-9f02b1141194 version: 4 local: 0 state: APPLYING flags: 1 conn_id: 13475392 trx_id: 63620823 seqnos (l: 312653, g: 28891485, s: 28891454, d: 28891449, ts: 10603037948851154) 2021-11-23 9:35:26 1 [ERROR] WSREP: Failed to apply trx 28891485 4 times 2021-11-23 9:35:26 1 [ERROR] WSREP: Node consistency compromised, aborting... The node on which the query was executed, crashed ("mysqld got signal 11"). At first sight, this seems to be the result of "WSREP: Send action {(nil), 528, TORDERED} returned -107 (Transport endpoint is not connected)" - as all the slaves were down at this point. As 'ALTER' is a DDL statement that does not support rollback, I understand that the only option for Galera may be to abort. But is there a way to handle something like this more gracefully? -- With kind regards, William Edwards

1 0

[Maria-discuss] How can I separate one test from mysql_test
by Lukas Javorsky 19 Nov '21

19 Nov '21

Hi guys, I've found few particular tests from the test suite that is failing due to the OpenSSL-3 version and I want to separate them and give them to the OpenSSL team in Red Hat. The idea behind this is to give them a set of commands/config options (reproducer) for each test and they will try to find out what's the exact problem there and help us develop the patch. The tests that I'm interested in are (there are more of them, I just need to see how to reproduce few of them and I'll do the same for the other ones as well): encryption.corrupted_during_recovery encryption.innodb-checksum-algorithm encryption.innodb-discard-import-change encryption.innodb_page_encryption_key_change binlog_encryption.rpl_loaddata_local binlog_encryption.rpl_parallel_free_deferred_event IMPORTANT: These tests are failing only with the 'cbc' cipher in use, the 'ctr' is passing. Could you please help me with how to make a reproducer for each test, so I can create them and give them to the OpenSSL team? Thank you for any help you can provide Lukas -- S pozdravom/ Best regards Lukáš Javorský Associate Software Engineer, Core service - Databases Red Hat <https://www.redhat.com> Purkyňova 115 (TPB-C) 612 00 Brno - Královo Pole ljavorsk(a)redhat.com <https://www.redhat.com>

3 14

[Maria-discuss] Mariadb 10.2 - 10.6 mysqld_multi problem
by Tom Dangler 18 Nov '21

18 Nov '21

We're working on upgrading a mariadb-10.1 server to mariadb-10.6. We run multiple instances of Mariadb on this server, and some run different versions of Mariadb for different reasons. When we attempted to upgrade to mariadb-10.2, we noticed that we can no longer specify mysqld=/path/to/mysqld without generating an error and not starting the instance. We get [ERROR] /opt/mariadb10_2/bin/mysqld: unknown variable 'mysqld=/opt/mariadb10_2/bin/mysqld'. We tested this with 10.2 and 10.6 binaries. When using 10.1 binaries for the [mysqld_multi] group, it accepts the mysqld= argument just fine, and starts each instance with the version defined in mysql= in each option group. The documentation still shows that mysqld= is still a valid configuration, but it does not seem to work from 10.2 to current. Is there a different configuration for this now? We would like to continue using mysqld_multi with different versions of Mariadb. Using 10.1 binaries for mysqld_multi it works [mysqld_multi] mysqld = /opt/mariadb10_1/bin/mysqld_safe mysqladmin = /opt/mariadb10_1/bin/mysqladmin user = multi_admin password = ourpassword Using 10.2 - 10.6 binaries for mysqld_multi we get errors about unknown variable mysqld [mysqld_multi] mysqld = /opt/mariadb10_6/bin/mysqld_safe mysqladmin = /opt/mariadb10_6/bin/mysqladmin user = multi_admin password = ourpassword [mysqld1] mysqld = /opt/mariadb10_1/bin/mysqld datadir = /opt/mysql_data/mariadb10_1 port = 3306 socket = /var/run/mysqld/mariadb_10_1.sock pid-file = /var/run/mysqld/mariadb_10_1.pid user = mysql [mysqld2] mysqld = /opt/mariadb10_2/bin/mysqld datadir = /opt/mysql_data/mariadb10_2 port = 3307 socket = /var/run/mysqld/mariadb_10_2.sock pid-file = /var/run/mysqld/mariadb_10_2.pid user = mysql [mysqld6] mysqld = /opt/mariadb10_6/bin/mysqld datadir = /opt/mysql_data/mariadb10_6 port = 3308 socket = /var/run/mysqld/mariadb_10_6.sock pid-file = /var/run/mysqld/mariadb_10_6.pid user = mysql -- Tom Dangler IT Architect and Systems Manager T 214.778.3158 | M 214.493.0386 | F 888.811.1566 tom.dangler(a)oakwoodsoftware.com Oakwood Software Insurance Solutions 6201 W Plano Parkway | Suite 225 | Plano, TX 75093 Facebook <https://www.facebook.com/OakwoodSoftware> | LinkedIn <https://www.linkedin.com/company/oakwoodsoftware> | Twitter <https://twitter.com/TheRealOakwood> | oakwoodsoftware.com <http://www.oakwoodsoftware.com/> An Amwins Company

1 0

[Maria-discuss] JOB | Permanent DBA in Quebec
by James Tobin 15 Nov '21

15 Nov '21

Contact me using "jamesbtobin (at) gmail (dot) com" to learn more

1 0

[Maria-discuss] Timestamp column not inserting UTC
by William Edwards 13 Nov '21

13 Nov '21

Hi, I have a `timestamp` column, because I would like to insert timestamps in UTC. The documentation says that the inserted value should be converted from my session's time zone to UTC, but I can't reproduce that behaviour. I'm on MariaDB 10.5.9. I have a column of type `timestamp`: `created_at` timestamp NULL DEFAULT NULL The documentation at https://mariadb.com/kb/en/timestamp/ says: "If a column uses the TIMESTAMP data type, then any inserted values are converted from the session's time zone to Coordinated Universal Time (UTC) when stored, and converted back to the session's time zone when retrieved." However, I cannot reproduce this intended behaviour. I set my time zone as follows. (The value was 'SYSTEM', which should also be '+01:00', but I'm setting it explicitly just in case.) -- MariaDB [db]> set time_zone = '+01:00'; Query OK, 0 rows affected (0.006 sec) MariaDB [db]> select now(); +---------------------+ | now() | +---------------------+ | 2021-11-13 14:56:09 | +---------------------+ 1 row in set (0.001 sec) MariaDB [db]> SELECT @@global.time_zone, @@session.time_zone; +--------------------+---------------------+ | @@global.time_zone | @@session.time_zone | +--------------------+---------------------+ | SYSTEM | +01:00 | +--------------------+---------------------+ 1 row in set (0.000 sec) -- Then, I update the values in the `timestamp` column to the timestamp of my session's time zone: -- MariaDB [db]> update objs set created_at=now(); Query OK, 2 rows affected (0.001 sec) Rows matched: 2 Changed: 2 Warnings: 0 -- ... I would expect the inserted value to be converted from my session's time zone ('+01:00') to UTC. However, the inserted value is actually a timestamp of my session's time zone: -- MariaDB [db]> select created_at from objs; +---------------------+ | created_at | +---------------------+ | 2021-11-13 14:56:42 | | 2021-11-13 14:56:42 | +---------------------+ 2 rows in set (0.000 sec) -- I would not be surprised if I'm looking over something very obvious, but I haven't figured it out yet. Hopefully someone sees what I'm missing. TIA! -- With kind regards, William Edwards

1 1

[Maria-discuss] Clarification on Memory utilization of Mariadb
by ragul rangarajan 10 Nov '21

10 Nov '21

Hi Team, Need clarification on Memory utilization of Mariadb. I have a java application with MariaDB that runs on the same Rhel 7 server with physical memory(RAM) allocated as 12GB where I would see the normal utilization at the start as below. *sys> free -h* * total used free shared buff/cache available* *Mem: 11G 7.8G 1.6G 9.0M 2.2G 3.5G* *Swap: 0B 0B 0B* Over a period of time say >6month, I could see the RAM utilization is almost full, and available space is very less but still, the application continues to work fine without any issues. *sys> free -h* * total used free shared buff/cache available* *Mem: 11G 11G 134M 17M 411M 240M* *Swap: 0B 0B 0B* I don't see any OOM issue or high usage of RSS at the java application level but I could see MariaDB occupies huge memory.... apart from that overall application runs fine. To ensure this we observed memory utilization at the large-scale application servers where we deployed MariaDB and Java applications into different servers with 128GB each and could observe that the system with MariaDB uses full RAM size whereas the Java application consumption looks stable. *Server with Java application* sys> free total used free shared buff/cache available Mem: 128755 125171 606 118 2977 2694 Swap: 65535 9746 55789 *Server with MariaDB* sys> free total used free shared buff/cache available Mem: 128755 125171 606 118 2977 2694 Swap: 65535 9746 55789 *MariaDb conf:* innodb_buffer_pool_size=102G innodb_buffer_pool_instances=8 innodb_io_capacity=3000 innodb_log_buffer_size=8M innodb_log_file_size=2047MB innodb_log_files_in_group=2 Is this expected that MariaDB consumes overall memory and manages within RAM size.... regardless of buffer size configured? Do we need to optimize any configuration to control the MariaDB consumption apart from buffer pool size? Thanks and Regards, Ragul

3 3

[Maria-discuss] Troubleshooting Statement That Crashes MariaDB (mysqld got signal 11)
by Michael Caplan 04 Nov '21

04 Nov '21

Hello, I have a nothing fancy SQL statement that crashes MariaDB 10.3.31. The error log reports "mysqld got signal 11" with the below included mini core dump. The statement caused no issues with my prior install of 10.2.xx. With 10.3, the statement runs the majority of the time. The vast majority of the time. I have never dealt with such an issue with MariaDB, and am unsure where to start with troubleshooting this. Any tips? FYI, there is a corresponding bug recorded here: https://jira.mariadb.org/browse/MDEV-26835 Thanks, Mike 211014 16:13:53 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.31-MariaDB-1:10.3.31+maria~focal-log key_buffer_size=134217728 read_buffer_size=131072 max_used_connections=587 max_threads=752 thread_count=81 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1784362 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f13e83b3768 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f1644e96dd8 thread_stack 0x49000 /usr/sbin/mysqld(my_print_stacktrace+0x32)[0x55d5a2f6f3a2] /usr/sbin/mysqld(handle_fatal_signal+0x55d)[0x55d5a2a46e8d] /lib/x86_64-linux-gnu/libpthread.so.0(+0x153c0)[0x7f27569fc3c0] /usr/sbin/mysqld(+0x978f4f)[0x55d5a2bdbf4f] /usr/sbin/mysqld(_ZN7handler10ha_rnd_posEPhS0_+0x50)[0x55d5a2a4c6d0] /usr/sbin/mysqld(_Z16rr_from_pointersP11READ_RECORD+0x3e)[0x55d5a2b7cb2e] /usr/sbin/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x18e)[0x55d5a28869be] /usr/sbin/mysqld(_ZN4JOIN10exec_innerEv+0xbee)[0x55d5a28b0dce] /usr/sbin/mysqld(_ZN4JOIN4execEv+0x37)[0x55d5a28b1137] /usr/sbin/mysqld(_Z12mysql_selectP3THDP10TABLE_LISTjR4ListI4ItemEPS4_jP8st_orderS9_S7_S9_yP13select_resultP18st_select_lex_unitP13st_select_lex+0xf2)[0x55d5a28b1282] /usr/sbin/mysqld(_Z13handle_selectP3THDP3LEXP13select_resultm+0x14b)[0x55d5a28b1bcb] /usr/sbin/mysqld(+0x5de9f1)[0x55d5a28419f1] /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x5414)[0x55d5a284f6e4] /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_statebb+0x1f3)[0x55d5a2852253] /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcjbb+0x105d)[0x55d5a285462d] /usr/sbin/mysqld(_Z10do_commandP3THD+0x12d)[0x55d5a28565dd] /usr/sbin/mysqld(_Z24do_handle_one_connectionP7CONNECT+0x246)[0x55d5a293f186] /usr/sbin/mysqld(handle_one_connection+0x3f)[0x55d5a293f35f] /lib/x86_64-linux-gnu/libpthread.so.0(+0x9609)[0x7f27569f0609] /lib/x86_64-linux-gnu/libc.so.6(clone+0x43)[0x7f2756915293] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7f13e84a8b70): SELECT * FROM (( # # get postings from last statement and postings not on statements # SELECT a.*, COALESCE(ci.id, i.id) as invoice_id FROM ddx_lab_801317.postings a LEFT JOIN ddx_lab_801317.cases_invoices ci ON a.ref_type = 'CASE_INVOICE' AND a.ref_id = ci.id LEFT JOIN ddx_lab_801317.invoices i ON a.ref_type = 'INVOICE' AND a.ref_id = i.id WHERE ( a.statement_date IS NULL OR a.statement_date = '2021-09-27' ) AND a.practice_id='19686' ORDER BY post_date ) UNION ( # # get postings that have remaining balances # SELECT DISTINCT a.*, COALESCE(ci.id, i.id) as invoice_id FROM ddx_lab_801317.postings a LEFT JOIN ddx_lab_801317.cases_invoices ci ON a.ref_type = 'CASE_INVOICE' AND a.ref_id = ci.id LEFT JOIN ddx_lab_801317.invoices i ON a.ref_type = 'INVOICE' AND a.ref_id = i.id LEFT JOIN ddx_lab_801317.postings b ON a.ref_type = b.ref_type AND a.ref_id = b.ref_id AND a.id != b.id WHERE NOT (a.type = 'CREDIT' OR a.type = 'PAYMENT') AND ((SELECT SUM(b.amount)) IS NULL OR (SELECT SUM(a.amount)) + (SELECT SUM(b.amount)) > 0) AND a.practice_id='19686' GROUP BY a.id ORDER BY post_date ) UNION ( # # get partial payments and credits from older statements # SELECT a.*, COALESCE(ci.id, i.id) as invoice_id FROM ddx_lab_801317.postings a LEFT JOIN ddx_lab_801317.cases_invoices ci ON a.ref_type = 'CASE_INVOICE' AND a.ref_id = ci.id LEFT JOIN ddx_lab_801317.invoices i ON a.ref_type = 'INVOICE' AND a.ref_id = i.id WHERE ( a.statement_date < '2021-09-27' ) AND (a.type='PAYMENT' OR a.type='CREDIT') AND a.practice_id='19686' )) AS t1 ORDER BY post_date ASC, invoice_id ASC Connection ID (thread ID): 21014956 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes unlimited unlimited processes Max open files 1048576 1048576 files Max locked memory unlimited unlimited bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 514974 514974 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core

2 2

[Maria-discuss] Incorrectly formatted XML files in mariadb-server sources
by Zuzana Miklankova 26 Oct '21

26 Oct '21

Hi, Fedora's rpminspect tool reports [1] some incorrectly formatted XMLs (most of them used for testsuite) within mariadb source files, namely they are: mysql-test/plugin/sphinx/sphinx/testdata.xml - undefined namespace mysql-test/std_data/loadxml.dat - different parser errors, seems to me like it is ill formed on purpose of the test mysql-test/plugin/connect/connect/std_data/nocs.xml - not proper utf-8 encoding mysql-test/std_data/loaddata/mdev9874.xml - not proper utf-8 encoding sql/share/mariadb/charsets/Index.xml - redefined attribute mysql-test/std_data/ldml/Index.xml - redefined attribute It does not seem (to me) that the ill-formatting breaks anything, and that in some cases it is desired. Specifically the loadxml.dat XML, where the test case counts with the form as it is, and Index.xml files, where modification to the XML format could change the meaning of the file. In other cases, it seems (to me) that the correction of the XMLs to a valid format could be possible. These are specifically the XMLs with encoding issues, where it should be sufficient to specify a used charset (ISO-8859-1 in both cases). This is also the case with the undefined namespace in testdata.xml, whose definition should be also possible. Would the correct approach to this issue be to suppress the rpminspect warnings, or should the specified XML files be modified to a valid XML form? Thanks for your opinions in advance. [1] https://osci-jenkins-1.ci.fedoraproject.org/job/fedora-ci/job/rpminspect-pi… Zuzana Miklánková Associate Software Engineer Red Hat <https://www.redhat.com> <https://www.redhat.com>

2 2

[Maria-discuss] MariaDB 10.4 shows a 2e308 cost on a optimization plan correctly preferred by 10.0
by David Strauss 25 Oct '21

25 Oct '21

I'm seeing a regression in query optimization after testing a database+query that was running well on MariaDB 10.0. The issue occurs on an installation of 10.4.18. Version 10.4 considers the plan that 10.0 used but dismisses it as having a cost of 2e308 [1]. The plan 10.4 chooses is highly non-optimal. Based on reviewing some source code, it looks like this sort of "max" cost should only result if summing/multiplying other costs would exceed that maximum. The usual steps of rebuilding tables and index statistics don't help, especially because the JSON output for the optimization plan already shows reasonable index use costs. (The 2e308 cost only starts appearing in a later section.) Because 10.0 lacks the same optimization tracing as 10.4, here is the EXPLAIN output for comparison [2]. Hopefully, there's just something simple amiss and posting here helps anyone else who encounters a 2e308 cost on query optimization plans. I tried to see if this may be fixed in 10.5+, but I haven't found much discussion online of this phenomenon. [1] https://gist.github.com/davidstrauss/becb03fa75ecac046cafe6f05da9f869#file-… [2] https://gist.github.com/davidstrauss/becb03fa75ecac046cafe6f05da9f869#file-…

1 0

[Maria-discuss] State of "alternative" engines and mariadb
by pslawek83 19 Oct '21

19 Oct '21

Hi Guys, what's the state of "alternative" engines (aria and rocks). AFAIR there were some plans to make aria much more advanced than myisam, transactional (transaction safe?) and more optimized for todays hardware. What's the status of RocksBD, basically on the mariadb website i can't find recent updates and most of sources on the internet are outdated. Is it 100% compatible with mariadb nowdays, is there a possibility to have "one-file-per-table" (one set of files) or at least per-database? If everything resides in shared space is there a possibility that one write error (eg. resulting from power loss) can make all rocks tables unreadable? Is it possible to efficiently drop eg. 100GB table partition if the table is using rocks? Last time i checked there were some issues with compaction for Rocks (some limit on DB size, which was rather small can't recall this currently). Is that resolved, and how much additional space is required to compact eg. 1tb database? How's the adoption and developement of both engines going? Are people using it instead of myisam/toku/inno? Is there a lot of effor put into making aria/rocks better? As i'll have to update many servers in the future what's generally the preferred way to go? Drop everything and just use innodb like Oracle did or move towards rocks/aria for everything which doesn't play with innodb well? Another interesting topic is that myisam is having performance issues because of spectre/meltdown mitigations and it seems to hit this engine the most (at least in 10.3, 10.4 as far as I recall). Are there some plans to optimize it for new CPUs (maybe it was already done) or all the effors are going into different storage engines and i should abandon myisam long term? Thanks

2 1

[Maria-discuss] Loading a backup created from 10.6.4 into newly installed 10.6.4 causes mysql.proc to appear corrupt
by Jeff Dyke 30 Sep '21

30 Sep '21

Failing process: Install mariadb from ppa using apt (happens through salt, fwiw) Download last night's backup from a 10.6.4 server, which is a replica from a galera cluster. run the script attached restore_mariabackup.sh Once this is done the database itself works, for our application, but any client trying to access anything that requires mysql.proc gets an error similar to: *Sep 30 19:29:07 devmaria /etc/mysql/debian-start[24656]: error : CorruptSep 30 19:29:07 devmaria /etc/mysql/debian-start[24656]: sys.x$schema_table_statistics* *Sep 30 19:29:07 devmaria /etc/mysql/debian-start[24656]: Error : Cannot load from mysql.proc. The table is probably corrupted * I just built two new servers, one that builds mariadb and then overwrites the data from a backup and one that just installs mariadb. The two different files base_install.proc.sql and backupedup.proc.sql. The error output from sudo mysql_upgrade on the server that received the backup is in mysql_upgrade.out There are more differences in the proc table if i dump the data as well, but i think much of it is driven by the utf8_mb4 rather than 3. Tried to keep this sucient and use attachments. This process has worked for me for until i upgraded to 10.6.4. Please ask anything you need. I think i've been using this similar process to build dev machines since about 10.4 Thanks Jeff

1 2

[Maria-discuss] A general question about performance of update command
by Lehrbass, Robert 27 Sep '21

27 Sep '21

Hi there, I'm new to MariaDB and I'm running tests on the update command. Server version 10.5.11. I'm finding that updates to a table with engine=columnstore are far slower than to a table with default engine=innodb. Obviously, there is no primary key in a table with engine=columnstore, whereas the innodb table does have a primary key. In my tests, for engine=columnstore, 10000 rows took 1995 seconds to be updated, but for engine=innodb, 10000 rows took only 7 seconds to transfer. The difference suggests columnstore takes about 285X longer than innodb. Is this to be expected? I don't need a lengthy answer, btw, just general guidance. Thanks very much, Rob

1 0

[Maria-discuss] DBSeeder Version 3.0.3
by Walter Weinmann 13 Sep '21

13 Sep '21

We are pleased to release version 3.0.3 of DBSeeder ( https://github.com/KonnexionsGmbH/db_seeder) DBSeeder also supports the latest version of MariaDB Server available on Docker Hub (DBMS 10.6.4-focal) and Maven Repository (JDBC 2.7.4). [image: Perf_Snap_3.0.3_win10.png]

2 2

[Maria-discuss] AWS Key management plugin key rotation in replication
by Reinis Rozitis 30 Aug '21

30 Aug '21

Hello, I wanted to clarify - does the key rotation (with AWS KMS backend) work in replication scenario? As in do the slaves (somehow) get also notified and perform the re-encryption if the key is rotated (on master) in background or you have to use different key for each slave for rotation to work? In https://mariadb.com/kb/en/encryption-key-management/#key-rotation it wasn't mentioned. wbr rr

2 3

[Maria-discuss] Issues with Upgrading from MariaDB 10.2.22 to 10.5.12
by Michael Caplan 25 Aug '21

25 Aug '21

Hi there. I'm going through an upgrade process I have done before with earlier versions of mariaDB and Mysql, but running into an issue. My goal is to create a new slave including upgrade process from MariaDB 10.2.22 (serverOld) to 10.5.12 on a new server (serverNew) (as inspired by the brighter mind at https://www.stephenrlang.com/2016/08/setting-up-mysql-master-slave-replicat… ) 1. rsync /var/lib/mysql from serverOld to serverNew 2. On serverOld: FLUSH TABLES WITH READ LOCK; SHOW MASTER STATUS; 3. rerun rsync from serverOld to serverNew 4. Release read lock from serverOld 5. Start mariadb on serverNew 6. run mysql_upgrade on serverNew 7. Celebrate and have a nap In actual practice step #5 failed numerous times before what I think is now an okay serverNew # Innodb settings between serverOld and serverNew #serverOld innodb-flush-method = O_DIRECT innodb-log-files-in-group = 2 innodb-log-file-size = 48M innodb-flush-log-at-trx-commit = 2 innodb-file-per-table = 1 innodb-buffer-pool-size = 128M #serverNew innodb-flush-method = O_DIRECT innodb-log-file-size = 48M innodb-flush-log-at-trx-commit = 2 innodb-file-per-table = 1 innodb-buffer-pool-size = 128M The only difference is innodb-log-files-in-group setting is removed in serverNew, as it has been depricated and removed in 10.5 # Upgrade after crash? When attempting to start serverNew, it would fail with the following error: [ERROR] InnoDB: Upgrade after a crash is not supported. The redo log was created with MariaDB 10.2.22. [ERROR] InnoDB: Plugin initialization aborted with error Generic error the log file on serverOld showed no evidence of crashing. None the less, I restarted serverOld, and reran the process above. Still the same issue step #5. # Remove ib_logfile* files I then tried forcing the recreation of the redo logs by removing them and then starting up serverNew. This resulted in the following scary errors: [ERROR] InnoDB: Page [page id: space=0, page number=1984] log sequence number 285722576186 is in the future! Current system log sequence number 259573448177. [ERROR] InnoDB: Your database may be corrupt or you may have copied the InnoDB tablespace but not the InnoDB log files. Please refer to https://mariadb.com/kb/en/library/innodb-recovery-modes/ for information about forcing recovery. # innodb_fast_shutdown = 0 The next attempt started with serverOld being restarted and innodb_fast_shutdown = 0 being set beforehand. I reran the above steps and still got stuck on step #5 with the following error: [ERROR] InnoDB: Upgrade after a crash is not supported. The redo log was created with MariaDB 10.2.22. [ERROR] InnoDB: Plugin initialization aborted with error Generic error This time, however, when I removed the ib_logfile* files, we seemed to have an okay startup: [Note] InnoDB: Initializing buffer pool, total size = 134217728, chunk size = 134217728 [Note] InnoDB: Completed initialization of buffer pool [Note] InnoDB: Setting log file ./ib_logfile101 size to 50331648 bytes [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 [Note] InnoDB: New log file created, LSN=288830457728 [Note] InnoDB: 128 rollback segments are active. [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" [Note] InnoDB: Creating shared tablespace for temporary tables [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... [Note] InnoDB: File './ibtmp1' size is now 12 MB. [Note] InnoDB: 10.5.12 started; log sequence number 0; transaction id 3037161218 [Note] Plugin 'FEEDBACK' is disabled. [Note] Recovering after a crash using /var/lib/mysql/mysql-bin [Note] Starting crash recovery... [Note] Crash recovery finished. [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool [Note] Server socket created on IP: '::'. [ERROR] Incorrect definition of table mysql.event: expected column 'sql_mode' at position 14 to have type set('REAL_AS_FLOAT','PIPES_AS_CONCAT','ANSI_QUOTES','IGNORE_SPACE','IGNORE_BAD_TABLE_OPTIONS','ONLY_FULL_GROUP_BY','NO_UNSIGNED_SUBTRACTION','NO_DIR_IN_CREATE','POSTGRESQL','ORACLE','MSSQL','DB2','MAXDB','NO_KEY_OPTIONS','NO_TABLE_OPTIONS','NO_FIELD_OPTIONS','MYSQL323','MYSQL40','ANSI','NO_AUTO_VALUE_ON_ZERO','NO_BACKSLASH_ESCAPES','STRICT_TRANS_TABLES','STRICT_ALL_TABLES','NO_ZERO_IN_DATE','NO_ZERO_DATE','INVALID_DATES','ERROR_FOR_DIVISION_BY_ZERO','TRADITIONAL','NO_AUTO_CREATE_USER','HIGH_NOT_PRECEDENCE','NO_ENGINE_SUBSTITUTION','PAD_CHAR_TO_FULL_LENGTH','EMPTY_STRING_IS_NULL','SIMULTANEOUS_ASSIGNMENT'), found type set('REAL_AS_FLOAT','PIPES_AS_CONCAT','ANSI_QUOTES','IGNORE_SPACE','IGNORE_BAD_TABLE_OPTIONS','ONLY_FULL_GROUP_BY','NO_UNSIGNED_SUBTRACTION','NO_DIR_IN_CREATE','POSTGRESQL','ORACLE','MSSQL','DB2','MAXDB','NO_KEY_OPTIONS','NO_TABLE_OPTIONS','NO_FIELD_OPTIONS','MYSQL323','MYSQL40','ANSI','NO_AUTO_VALU [ERROR] mariadbd: Event Scheduler: An error occurred when initializing system tables. Disabling the Event Scheduler. [Note] Reading of all Master_info entries succeeded [Note] Added new Master_info '' to hash table [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.5.12-MariaDB-1:10.5.12+maria~focal-log' socket: '/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution Running mysql_upgrade completed without issue. I'm not feeling confident that this upgrade is actually okay. removing the ib_logfile* seems questionable as a requirement to get the upgrade done. Anyone have similar troubles? Recommendations on what my process should be? Thanks, Mike

3 3

[Maria-discuss] Adding MySQL database backup to rsnapshot for Linux Servers
by Turritopsis Dohrnii Teo En Ming 22 Aug '21

22 Aug '21

Subject: Adding MySQL database backup to rsnapshot for Linux Servers Author: Mr. Turritopsis Dohrnii Teo En Ming (TARGETED INDIVIDUAL) Country: Singapore Date: 22 August 2021 Sunday Singapore Time Type of Pulication: Plain Text Document Version: 20210822.01 DETAILED INSTRUCTIONS ===================== Looking for mysqldump ===================== # which mysqldump /usr/bin/mysqldump Testing if mysqldump works ========================== # /usr/bin/mysqldump --all-databases > mysqldump_all_databases.sql Check the filesize of MySQL dump ================================ # du -h mysqldump_all_databases.sql 23M mysqldump_all_databases.sql Backup rsnapshot configuration file first ========================================= # cd /etc/ # cp rsnapshot.conf rsnapshot.conf.backup20082021 Deploying MySQL backup script ============================= # cp /usr/share/doc/rsnapshot-1.4.3/utils/backup_mysql.sh /usr/local/bin/ # chown root.root /usr/local/bin/backup_mysql.sh # chmod o-w /usr/local/bin/backup_mysql.sh # chmod +x /usr/local/bin/backup_mysql.sh # cat /usr/local/bin/backup_mysql.sh ===BEGIN of backup_mysql.sh=== #!/bin/sh ############################################################################## # backup_mysql.sh # # by Nathan Rosenquist <nathan(a)rsnapshot.org> # http://www.rsnapshot.org/ # # This is a simple shell script to backup a MySQL database with rsnapshot. # # The assumption is that this will be invoked from rsnapshot. Also, since it # will run unattended, the user that runs rsnapshot (probably root) should have # a .my.cnf file in their home directory that contains the password for the # MySQL root user. For example: # # /root/.my.cnf (chmod 0600) # [client] # user = root # password = thepassword # host = localhost # # This script simply needs to dump a file into the current working directory. # rsnapshot handles everything else. ############################################################################## # $Id: backup_mysql.sh,v 1.6 2007/03/22 02:50:21 drhyde Exp $ umask 0077 # backup the database /usr/bin/mysqldump --all-databases > mysqldump_all_databases.sql # make the backup readable only by root /bin/chmod 600 mysqldump_all_databases.sql ===END of backup_mysql.sh=== Edit rsnapshot configuration file ================================== # nano /etc/rsnapshot.conf Under BACKUP POINTS / SCRIPTS add the following line ==================================================== backup_script /usr/local/bin/backup_mysql.sh secret.teo-en-ming-corp.com/mysqldump/ Test the rsnapshot configuration file for syntax errors ======================================================= # rsnapshot configtest require Lchown Lchown module loaded successfully Syntax OK Mr. Turritopsis Dohrnii Teo En Ming, 43 years old as of 22 August 2021, is a TARGETED INDIVIDUAL living in Singapore. He is an IT Consultant with a System Integrator (SI)/computer firm in Singapore. He is an IT enthusiast. -----BEGIN EMAIL SIGNATURE----- The Gospel for all Targeted Individuals (TIs): [The New York Times] Microwave Weapons Are Prime Suspect in Ills of U.S. Embassy Workers Link: https://www.nytimes.com/2018/09/01/science/sonic-attack-cuba-microwave.html ******************************************************************************************** Singaporean Targeted Individual Mr. Turritopsis Dohrnii Teo En Ming's Academic Qualifications as at 14 Feb 2019 and refugee seeking attempts at the United Nations Refugee Agency Bangkok (21 Mar 2017), in Taiwan (5 Aug 2019) and Australia (25 Dec 2019 to 9 Jan 2020): [1] https://tdtemcerts.wordpress.com/ [2] https://tdtemcerts.blogspot.sg/ [3] https://www.scribd.com/user/270125049/Teo-En-Ming -----END EMAIL SIGNATURE-----

1 0

[Maria-discuss] MariaDB Server Fest CfP
by Ian Gilfillan 19 Aug '21

19 Aug '21

The Call for Papers for the MariaDB Server Fest is open until 16 August. If you have an idea to share, anything MariaDB-related, new, fun, interesting, scary or exciting, you are welcome to submit at https://mariadb.org/fest2021-cfp-submission/ The MariaDB Server Fest will be held on Tuesday and Wednesday 21-22 September - full details at https://mariadb.org/fest2021/

2 1

[Maria-discuss] ALTER vs MODIFY to set default on a column
by Shane Bishop 14 Aug '21

14 Aug '21

Hi folks, Long story short, I have a table with a TIMESTAMP column where I want to make the default CURRENT_TIMESTAMP (default currently is 1971-01-01 00:00:00). This is part of a WordPress plugin, and so I need to make this as performant as possible. I originally used a query like this: ALTER TABLE wp_ewwwio_images ALTER updated SET DEFAULT CURRENT_TIMESTAMP; This was speedy, and worked a treat, but now I'm finding it doesn't work on all MySQL servers. Notably, we've run into trouble with sites running MariaDB 10.1 and MySQL 5.7, where it says something like this: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near CURRENT_TIMESTAMP Per https://dev.mysql.com/doc/refman/5.7/en/alter-table.html the syntax looks fine. At least, the syntax in the manual is identical to that for MySQL 8: https://dev.mysql.com/doc/refman/8.0/en/alter-table.html And ditto for MariaDB of course: https://mariadb.com/kb/en/alter-table/ The alternative is to use this: ALTER TABLE wp_ewwwio_images MODIFY updated TIMESTAMP DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP; This works fine for the affected server versions, but is much slower; ALTER is near instant, MODIFY takes 3-4 seconds on a table with 260k records on SSDs. Who knows what it looks like if some poor sap is on spinning disks still... So I know how to work around said "issue", but what I really want to know is, what IS the actual problem here? Why don't older MySQL (and MariaDB) versions accept the ALTER syntax when the docs are identical? Notably, 10.5 works fine, and I think 10.4 was okay also, don't have any sites to test older versions myself. Thanks! Shane Bishop

3 5

[Maria-discuss] MariaDB master-slave chained replication and parallelism
by Jan Křístek 06 Aug '21

06 Aug '21

Hi, We have a MariaDB 10.3 replication setup with one master and a few chained slaves (each has log_slave_updates switched on). Master uses mainly MyISAM tables, slaves have about 10 or 40 threads for parallel replication. Interesting is, that the first slave in the chain counts replicated statements into Non-Transactional Groups and the following ones count them into Transactional Groups. Also, when checking process lists it seems that just one statement is being processed at the time (of the many threads) on the first slave, while there are multiple slave replication statements being executed on the 2nd and following slaves. Please, does anyone know the reason why the replicated statements are counted into different groups? Or, more importantly, how to increase the parallelism on the first slave in the chain? Thank you for any help. Jan

3 3

[Maria-discuss] sssd with authentication plugin pam
by Michael Barkdoll 05 Aug '21

05 Aug '21

Hi, I'm having issues getting the pam plugin to work with Rocky Linux 8 (RHEL 8) with AppStream MariaDB 10.5. I've installed mariadb appstream for 10.5 and mariadb-pam packages. Added the following to /etc/my.cnf.d: [mariadb] plugin_load_add = auth_pam My sssd is joined to Active Directory. I've created /etc/pam.d/mariadb trying both local pam_unix and pam_sss configurations: # /etc/pam.d/mariadb for local accounts auth required pam_unix.so audit account required pam_unix.so audit # /etc/pam.d/mariadb for sssd active directory accounts auth required pam_sss.so account required pam_sss.so Tried creating local accounts with: #CREATE USER 'user'@'%' IDENTIFIED VIA pam USING 'mariadb'; #GRANT SELECT ON db.* TO 'user'@'%' IDENTIFIED VIA pam; #CREATE USER 'user2'@'%' IDENTIFIED VIA pam; #GRANT SELECT ON db.* TO 'user2'@'%' IDENTIFIED VIA pam; I've also tried creating AD accounts: #CREATE USER 'aduser'@'%' IDENTIFIED VIA pam USING 'mariadb'; #GRANT SELECT ON db.* TO 'aduser'@'%' IDENTIFIED VIA pam; #CREATE USER 'aduser(a)college.edu'@'%' IDENTIFIED VIA pam USING 'mariadb'; #GRANT SELECT ON db.* TO 'aduser(a)college.edu'@'%' IDENTIFIED VIA pam; I see Redhat has issues with MariaDB 10.3 working with pam plugin but it sounded like 10.5 should work? https://bugzilla.redhat.com/show_bug.cgi?id=1942330 I feel like I'm missing something in my /etc/sssd/sssd.conf file or some pam configuration steps. I'm using authselect with sssd: authselect select custom/user-profile with-mkhomedir with-sudo with-pamaccess All attempts to `mysql -u user -p` fail. MariaDB [(none)]> show plugins; | pam | ACTIVE | AUTHENTICATION | auth_pam.so | GPL | I tried adding a [pam] section to sssd. [pam] pam_public_domains = all pam_verbosity = 3 Didn't seem to help. I used realmd to join AD. Any help is much appreciated. mysql -u user -p Enter password: ERROR 1045 (28000): Access denied for user 'user'@'localhost' (using password: NO)

4 13

Re: [Maria-discuss] MariaDB master-slave chained replication and parallelism
by Jan Křístek 05 Aug '21

05 Aug '21

Hi Kristian, Thank you for your answer. On Thu, 5 Aug 2021 at 09:44, Kristian Nielsen <knielsen(a)knielsen-hq.org> wrote: > > Interesting. Where do you see these counts? My guess is that these are > counting the "transactional" status flag on each GTID event in the binlog. > I see these counts almost at the end of 'mysql -e "show slave status\G"' You can see these yourself in a mysqlbinlog output from a binlog on the > master respectively the slaves. > I will check that when I get the setup running again. Thank you for the tip. If these show non-transactional on the master but transactional on the first > slave, it sounds like you are replicating from MyISAM tables on the master > to InnoDB tables on the slave. Try SHOW CREATE TABLE t on a relevant table > on the master and the slave and see which storage engine they are using. > I am sure that at least the big tables use MyISAM on master and all the slaves. Could be that one or two small tables use InnoDB. But when the replication is running, just one counter is always increasing, the other is staying zero (or in case of switching the master while being run) staying fixed. Thus, the first slave sees MyISAM changes, and does not do parallel > operation, but writes InnoDB transactions. These InnoDB transactions are > then seen by following slaves which enables the parallel replication > algorithms. > This could be the reason, even though I am sure that all slaves use MyISAM for almost all tables. I suppose that (could be) the default engine might be switched to InnoDB. > The obvious answer is to change the tables to be InnoDB on the master. > Which > may or may not be possible in your setup. > Oh, this is not so easy. The size of a few MyISAM tables is reaching almost TBs. And thank you for the idea with the BlackHole engine :) Jan

2 4

[Maria-discuss] DBSeeder Version 3.0.1
by Walter Weinmann 03 Aug '21

03 Aug '21

We are pleased to release version 3.0.1 of DBSeeder ( https://github.com/KonnexionsGmbH/db_seeder) The most important enhancement is the possibility to deactivate the constraints of the type FOREIGN, PRIMARY and UNIQUE KEY before the DML statements and to activate them again afterwards. The JDBC DatabaseMetaData class is used for this purpose. DBSeeder also supports the latest version of MariaDB Server available on Docker Hub (DBMS 10.6.3) and Maven Repository (JDBC 2.7.3).

1 0

[Maria-discuss] MySQL crash after 'partial' version upgrade
by William Edwards 26 Jul '21

26 Jul '21

Hello, The weather probably has an effect on me, because I'm not seeing the cause for the issue below right away. Hopefully someone can use the cluebat. Also, I apologize if we're not supposed to paste snippets of this size in email, but I couldn't find a mailing list policy on this. I was using this repo: `deb [arch=amd64,i386,ppc64el] http://mariadb.mirror.pcextreme.nl/repo/10.3/debian stretch main` This repo was no longer being updated, so I replaced it with this repo: `deb [arch=amd64,arm64,ppc64el] http://ams2.mirrors.digitalocean.com/mariadb/repo/10.3/debian buster main` That made these updates available: ``` galera-3/unknown 25.3.33-buster amd64 [upgradable from: 25.3.32-stretch] libmariadb-dev-compat/unknown 1:10.3.30+maria~buster amd64 [upgradable from: 1:10.3.28+maria~stretch] libmariadb-dev/unknown 1:10.3.30+maria~buster amd64 [upgradable from: 1:10.3.28+maria~stretch] libmariadb3/unknown 1:10.3.30+maria~buster amd64 [upgradable from: 1:10.3.28+maria~stretch] mariadb-client-10.3/unknown 1:10.3.30+maria~buster amd64 [upgradable from: 1:10.3.28+maria~stretch] mariadb-client-core-10.3/unknown 1:10.3.30+maria~buster amd64 [upgradable from: 1:10.3.28+maria~stretch] mariadb-common/unknown,unknown,unknown 1:10.3.30+maria~buster all [upgradable from: 1:10.3.28+maria~stretch] mariadb-server-10.3/unknown 1:10.3.30+maria~buster amd64 [upgradable from: 1:10.3.28+maria~stretch] mariadb-server-core-10.3/unknown 1:10.3.30+maria~buster amd64 [upgradable from: 1:10.3.28+maria~stretch] mysql-common/unknown,unknown,unknown 1:10.3.30+maria~buster all [upgradable from: 1:10.3.28+maria~stretch] ``` Ansible then wrongly attempted installing the meta package 'mariadb-server', which was not installed yet ('mariadb-server-10.3' was installed directly). This meta package depends on 'mariadb-server-10.3 (>= 1:10.3.30+maria~buster)' (we were running 10.3.28, and an update was now available), so apt did this: ``` Building dependency tree... Reading state information... The following packages were automatically installed and are no longer required: gir1.2-packagekitglib-1.0 libappstream4 libglib2.0-bin libgstreamer1.0-0 libpackagekit-glib2-18 libstemmer0d packagekit packagekit-tools python3-distro-info python3-software-properties Use 'apt autoremove' to remove them. The following additional packages will be installed: mariadb-client-10.3 mariadb-client-core-10.3 mariadb-common mariadb-server-10.3 mariadb-server-core-10.3 Suggested packages: mailx mariadb-test netcat-openbsd tinyca The following NEW packages will be installed: mariadb-server The following packages will be upgraded: mariadb-client-10.3 mariadb-client-core-10.3 mariadb-common mariadb-server-10.3 mariadb-server-core-10.3 5 upgraded, 1 newly installed, 0 to remove and 32 not upgraded. Need to get 12.0 MB of archives. [...] dpkg: error processing package mariadb-server-10.3 (--configure): installed mariadb-server-10.3 package post-installation script subprocess returned error exit status 1 dpkg: dependency problems prevent configuration of mariadb-server: mariadb-server depends on mariadb-server-10.3 (>= 1:10.3.30+maria~buster); however: Package mariadb-server-10.3 is not configured yet. dpkg: error processing package mariadb-server (--configure): dependency problems - leaving unconfigured Processing triggers for man-db (2.8.5-2) ... Processing triggers for systemd (241-7~deb10u8) ... Errors were encountered while processing: mariadb-server-10.3 mariadb-server ``` From 16:06:44 (apt upgrade fail time), SST kept failing due to https://jira.mariadb.org/browse/MDEV-26172 (most likely not related to this issue), till 16:09:32, which is when I stopped MariaDB. After stopping and starting MariaDB (probably loading new libraries), I started seeing this: ``` 210723 16:09:33 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.30-MariaDB-1:10.3.30+maria~buster-log key_buffer_size=134217728 read_buffer_size=131072 max_used_connections=0 max_threads=102 thread_count=4 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 355304 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7f0d8c000c08 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7f0d9effcce8 thread_stack 0x49000 /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x561a7200ddee] /usr/sbin/mysqld(handle_fatal_signal+0x54d)[0x561a71b2087d] /lib/x86_64-linux-gnu/libpthread.so.0(+0x12730)[0x7f0df182b730] /usr/sbin/mysqld(+0x9a6f22)[0x561a71d10f22] /usr/sbin/mysqld(+0xa80632)[0x561a71dea632] /usr/sbin/mysqld(+0xa03852)[0x561a71d6d852] /usr/sbin/mysqld(+0xa039f5)[0x561a71d6d9f5] /usr/sbin/mysqld(+0x9fe0f1)[0x561a71d680f1] /usr/sbin/mysqld(+0x9fe1e2)[0x561a71d681e2] /usr/sbin/mysqld(+0xa00aba)[0x561a71d6aaba] /usr/sbin/mysqld(+0xa01129)[0x561a71d6b129] /usr/sbin/mysqld(+0x9c2d88)[0x561a71d2cd88] /usr/sbin/mysqld(+0xa2777c)[0x561a71d9177c] /lib/x86_64-linux-gnu/libpthread.so.0(+0x7fa3)[0x7f0df1820fa3] /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f0df174f4cf] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x0): (null) Connection ID (thread ID): 3 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. We think the query pointer is invalid, but we will try to print it anyway. Query: Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 15657 15657 processes Max open files 32133 32133 files Max locked memory 67108864 67108864 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 15657 15657 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core ``` Thanks to systemd, this went on for 2 minutes, until this, which is when I gave up trying to fix this and replaced the node in the Galera cluster: ``` 2021-07-23 16:11:07 0 [Note] Starting crash recovery... 2021-07-23 16:11:07 0 [Note] Crash recovery finished. 2021-07-23 16:11:07 6 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired 2021-07-23 16:11:07 6 [Warning] Checking table: './mysql/user' 2021-07-23 16:11:07 6 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly /lib/x86_64-linux-gnu/libpthread.so.0(+0x7fa3)[0x7f0f17430fa3] 2021-07-23 16:11:08 0 [ERROR] InnoDB: Page [page id: space=11326, page number=3] log sequence number 30633696699 is in the future! Current system log sequence number 30424127374. 2021-07-23 16:11:08 0 [ERROR] InnoDB: Your database may be corrupt or you may have copied the InnoDB tablespace but not the InnoDB log files. Please refer to https://mariadb.com/kb/en/library/innodb-recovery-modes/ for information about forcing recovery. 2021-07-23 16:11:08 0 [ERROR] InnoDB: Page [page id: space=11330, page number=3] log sequence number 30634051832 is in the future! Current system log sequence number 30424127374. 2021-07-23 16:11:08 0 [ERROR] InnoDB: Your database may be corrupt or you may have copied the InnoDB tablespace but not the InnoDB log files. Please refer to https://mariadb.com/kb/en/library/innodb-recovery-modes/ for information about forcing recovery. 2021-07-23 16:11:08 0 [ERROR] InnoDB: Page [page id: space=11332, page number=3] log sequence number 30634054073 is in the future! Current system log sequence number 30424127374. 2021-07-23 16:11:08 0 [ERROR] InnoDB: Your database may be corrupt or you may have copied the InnoDB tablespace but not the InnoDB log files. Please refer to https://mariadb.com/kb/en/library/innodb-recovery-modes/ for information about forcing recovery. 2021-07-23 16:11:08 0 [ERROR] InnoDB: Page [page id: space=11333, page number=3] log sequence number 30633696016 is in the future! Current system log sequence number 30424127374. 2021-07-23 16:11:08 0 [ERROR] InnoDB: Your database may be corrupt or you may have copied the InnoDB tablespace but not the InnoDB log files. Please refer to https://mariadb.com/kb/en/library/innodb-recovery-modes/ for information about forcing recovery. /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7f0f1735f4cf] ``` These are the packages that apt installed/upgraded: ``` The following additional packages will be installed: mariadb-client-10.3 mariadb-client-core-10.3 mariadb-common mariadb-server-10.3 mariadb-server-core-10.3 Suggested packages: mailx mariadb-test netcat-openbsd tinyca The following NEW packages will be installed: mariadb-server The following packages will be upgraded: mariadb-client-10.3 mariadb-client-core-10.3 mariadb-common mariadb-server-10.3 mariadb-server-core-10.3 ``` That means that these packages, that were available for upgrade, were not upgraded: - mysql-common - libmariadb3 - libmariadb-dev - libmariadb-dev-compat - galera-3 However, none of the upgraded packages depend on newer versions of the packages above, so I would have expected this - even though installing the meta package was a mistake - to just work (assuming the problem was an e.g. outdated library). I have two other machines in the same situation, where I simply did 'apt upgrade' after replacing the repo, and all seems well. In conclusion: replacing a repo that provides an update from 10.3.28 to 10.3.30, then installing the 'mariadb-server' meta package that does not install all available updates (like 'libmariadb3'), caused MySQL to crash (badly)... While installing all available updates at the same time ('apt upgrade') does not cause this issue on another machine. I don't necessarily want to understand how to avoid this specific situation, because I should've done a full upgrade in any case, but I am wondering what I am missing that caused this issue. -- With kind regards, William Edwards

3 3

[Maria-discuss] MariaDB daily backups on EC2/EBS via EBS snapshots?
by Joachim Dorn 12 Jul '21

12 Jul '21

Hi, for the scenario of a daily backup on a MariaDB with InnoDB engine running on a EC2 with EBS - would a EBS snapshot be enough to have consistent backups that MariaDB could restore from? I know that I might lose in-flight transactions without any "flushing", but for a daily backup, I accept the backup being a few (milli) seconds bit behind, as long as I have a consistent persistent state. To my understanding Amazon EBS snapshots are consistent point-in-time snapshots (e.g via copy-on-write) of the volume, and MariaDB with a transactional storage engine guarantees transactional consistent writes to disk under all conditions. Thanks for any clarification! Joachim

1 0

[Maria-discuss] dist-upgrade for minor version upgrade
by William Edwards 10 Jul '21

10 Jul '21

Hi, https://mariadb.com/kb/en/upgrading-from-mariadb-104-to-mariadb-105/ (and all other minor upgrade guides) contain these steps: 2. Stop MariaDB. 3. Uninstall the old version of MariaDB: On Debian, Ubuntu, and other similar Linux distributions, execute the following: sudo apt-get remove mariadb-server 4. Install the new version of MariaDB. I'm thinking to myself: doesn't it make more sense to instruct readers to 'dist-upgrade' on Ubuntu and Debian (which works because of the 'Replaces' in newer packages)? That would merge steps 3 and 4 (and maybe step 2 as well, because of stop_server() in preinst) into one command that could be easier to use for novice users. Sorry if I missed a detail that dist-upgrade does not take care of. -- With kind regards, William Edwards

2 1

[Maria-discuss] Differences between MariaDB packages
by William Edwards 27 Jun '21

27 Jun '21

Hello, I recently discovered a bug in my MariaDB deployment process. I have two Ansible tasks that respectively add the downloads.mariadb.org Debian repo, and install mariadb-server-10.*. I forgot to add 'update_cache: yes' to the repo add task, so incidentally mariadb-server-10.* was actually installed from the Debian repo. I have seen the following differences between the mariadb-server-10.* packages: - Packages from Debian repo only come with the 'root@localhost' user. Packages from MariaDB repo come with the users 'root@localhost', 'root@::1' and 'root(a)127.0.0.1'. - Packages from Debian repo don't come with 'debian-sys-maint@localhost' user. Instead, the 'root' user is used in /etc/mysql/debian.cnf - Packages from Debian repo use DebianAlternatives for my.cnf. Packages from MariaDB repo also come with a more advanced my.cnf, e.g. 'bind-address = 127.0.0.1' is set - not being able to remotely connect is how I discovered this bug on my side. - Packages from MariaDB repo come with package configuration (specifically: setting root password). Q: I'm wondering if anyone has a more complete list of differences between these packages (the above is just what I've observed from fixing issues due to this bug). I don't know if the Debian maintainers for this package branch off a package by MariaDB, so I posted this here, but please let me know if I would be better off posting this on a Debian mailing list. TIA. With kind regards, William Edwards

3 2

[Maria-discuss] OpenSSL 3.0 support
by Lukas Javorsky 17 Jun '21

17 Jun '21

Hi, We've created two Jira tickets for the OpenSSL 3.0 support, however, we didn't really get a response or any detailed information from you about it. Connector-c: https://jira.mariadb.org/browse/CONC-503 Server: https://jira.mariadb.org/browse/MDEV-25785 It's our big concern to support this ASAP because we are aiming to support OpenSSL version 3.0 in the RHEL-9 which is coming soon. Our mission in RHEL-9 is to aim for the newest software version because we are going to support this OS for more than 10 years, and the major changes should be done in the beginning. We would like to know your opinion about this so we can maybe try to help you in some way. Please let us know what you think about it. Thank you and have a nice day -- S pozdravom/ Best regards Lukáš Javorský Associate Software Engineer, Core service - Databases Red Hat <https://www.redhat.com> Purkyňova 115 (TPB-C) 612 00 Brno - Královo Pole ljavorsk(a)redhat.com <https://www.redhat.com>

2 1

[Maria-discuss] Problem with mariabackup
by Riccardo Brunetti 17 Jun '21

17 Jun '21

Hello. We are using the mariabackup tool to stream to a remote server the backup of our databases. We are having some issue because in the middle of the operation the db server stops responding for many minutes until we ultimately kill the mariabackup process. During the lock, we can see the following: > MariaDB [(none)]> show processlist; > > +--------+----------------------------+-----------------+--------------------------+---------+------+------------------------------+------------------------------------------------------------------------------------------------------+----------+ > > | Id | User | Host | db | Command | Time | State | Info | Progress | > > +--------+----------------------------+-----------------+--------------------------+---------+------+------------------------------+------------------------------------------------------------------------------------------------------+----------+ > > | 3 | system user | | NULL | Daemon | NULL | InnoDB purge worker | NULL | 0.000 | > > | 4 | system user | | NULL | Daemon | NULL | InnoDB purge worker | NULL | 0.000 | > > | 1 | system user | | NULL | Daemon | NULL | InnoDB purge coordinator | NULL | 0.000 | > > | 2 | system user | | NULL | Daemon | NULL | InnoDB purge worker | NULL | 0.000 | > > | 5 | system user | | NULL | Daemon | NULL | InnoDB shutdown handler | NULL | 0.000 | > > | 274355 | root | localhost:42512 | NULL | Sleep | 407 | | NULL | 0.000 | > > | 297631 | udaww4uw_gsut | localhost:39784 | udaww4uw_gsprod | Query | 17 | Waiting for global read lock | UPDATE `wp_litespeed_crawler` SET reason = CONCAT( SUBSTRING_INDEX( reason, ',', 0 ), '200', SUBSTRI | 0.000 | > > | 302083 | ud4k9xsm_pres633 | localhost | ud4k9xsm_pres633 | Query | 47 | Waiting for global read lock | DELETE FROM `ps4d_marketplace_product_action` > > WHERE `id_product` = 7356 AND `id_lan | 0.000 | > > | 302391 | udaww4uw_gsut | localhost:50748 | udaww4uw_gsprod | Query | 46 | Waiting for global read lock | INSERT INTO wp_post_views (id, type, period, count) > > VALUES (62075, 3, '2021', 1) > > ON DUPLIC | 0.000 | > > | 302395 | uqlugtoj_enedina.it | localhost | uqlugtoj_enedina | Query | 44 | Waiting for global read lock | UPDATE `wp_options` SET `option_value` = '1623829414' WHERE `option_name` = '_transient_timeout_wc_r | 0.000 | > > | 302404 | udlah5r1_remigio | localhost:50782 | udlah5r1_vtiger71 | Query | 44 | Waiting for global read lock | insert into vtiger_pbxmanager(pbxmanagerid,direction,callstatus,starttime,endtime,totalduration,bill | 0.000 | > > | 302431 | utlmb6ko_6M0oD0 | localhost | utlmb6ko_6M0oD0 | Query | 38 | Waiting for global read lock | UPDATE `wp_options` SET `option_value` = '1623743080' WHERE `option_name` = 'action_scheduler_lock_a | 0.000 | > > | 302432 | uml1gkxr_58IJ3 | localhost:50836 | uml1gkxr_prod | Query | 38 | Waiting for global read lock | UPDATE `wp_options` SET `option_value` = 'a:13835:{i:1226;s:32:\"ab7050de2954be1e369e358a15a17c48\"; | 0.000 | > > | 302433 | uml1gkxr_58IJ3 | localhost:50838 | uml1gkxr_prod | Query | 38 | Waiting for global read lock | UPDATE `wp_options` SET `option_value` = 'a:13835:{i:1226;s:32:\"ab7050de2954be1e369e358a15a17c48\"; | 0.000 | > > | 302440 | uqtx0c94_giorgio | localhost:50848 | uqtx0c94_due | Query | 38 | Waiting for global read lock | UPDATE `wp_options` SET `option_value` = '[]' WHERE `option_name` = '_transient_adsforwp_transient_a | 0.000 | > > | 302473 | uw6vnwff_helpdesk | localhost:50932 | uw6vnwff_helpassist | Query | 30 | Waiting for global read lock | INSERT INTO ost_syslog SET created=NOW(), updated=NOW() ,title='DB Error #1205',log_type='Error',log | 0.000 | At the same time, we see messages like these in the system log: > Executing FLUSH NO_WRITE_TO_BINLOG TABLES... > > Executing FLUSH TABLES WITH READ LOCK... This is the command we launch to backup data: > mariabackup --backup --stream=xbstream --user=root --extra-lsndir=${BCKDBDIR} -u${MYSQLUSER} -p${MYSQLPW} -H ${MYSQLHOST}" Is it somehow an expected behavior (some of the db are quite heavily used)? How can we avoid those locks? Thanks Riccardo

3 7

[Maria-discuss] Disable Some Operators in Fulltext Boolean mode
by Samuel Lorch 12 Jun '21

12 Jun '21

Hello, I am using MariaDB in a Project and to Allow users to Search the Data we use Fulltext Indexes, as you cannot make a Fulltext Index across multiple tables we have multiple match against statements and are Combining them with OR. The Problem is that the Natural Language Mode only Matches Full Words and not Partial ones. The Solution is Boolean Mode where you can append a * to a word to allow 0 or more characters. But Boolean Mode also Brings Other Operators. These other Operator can Behave Unexpectedly for The User when Combining Multiple Match Against Statements With OR. Using the "ft_boolean_syntax" variable one can change the characters used for these operators but this is limited to ASCII characters below 127. I suggest That we add a special character that disables a operator. What do you think about this? Or do you See a different Solution? Regards, Samuel

1 0

[Maria-discuss] DBSeeder Version 2.9.0
by Walter Weinmann 08 Jun '21

08 Jun '21

We are happy to announce that version 2.9.0 of DBSeeder ( https://github.com/KonnexionsGmbH/db_seeder) is now available for general use. DBSeeder also supports the latest version of MariaDB Server available on DockerHub (10.6.1).

2 2

[Maria-discuss] Can't build mariadb 10.5 without gssapi?
by Chris Ross (cross2) 27 May '21

27 May '21

G’day there. So, I was trying to turn off the auth_gssapi plugin which we aren’t using in our build of mariadb 10.5.8. However, adding -DPLUGIN_AUTH_GSSAPI=NO, which is how I've turned off multiple other plugins, seems to have no effect. It still searches for gssapi, and then later builds auth_gssapi_client. Is there an issue/defect open yet that this plugin can't be disabled, or have I done something incorrectly to turn it off? - Chris

2 1

[Maria-discuss] Performance of MariaDB ODBC connector
by Dušan Pavlica 05 May '21

05 May '21

Hi, I'm new with MariaDB. We try to switch from MySQL 5.0.96 to MariaDB 10.5.9. Move data to MariaDB was easy but now we have problems with speed of ODBC connector. I tried MariaDB ODBC connector 3.1.12 with default settings without SSL and our applications (mostly written in Embarcadero RAD Studio) showed very poor performance. When I tried MySQL ODBC connector 8.0.24 everything ran smoothly. Queries through MariaDB's connector was 3-5 times slower. In general query log I found that MariaDB's connector generates a lot of queries to information_scheme.columns table and all over again it reads variable TX_ISOLATION. Short extract - MariaDB connector: 3 Query SELECT VARIABLE_VALUE FROM INFORMATION_SCHEMA.SESSION_VARIABLES WHERE VARIABLE_NAME='TX_ISOLATION' 3 Prepare select * from stanice 3 Execute select * from stanice 3 Prepare SELECT TABLE_SCHEMA AS TABLE_CAT, NULL AS TABLE_SCHEM, TABLE_NAME, COLUMN_NAME, ORDINAL_POSITION KEY_SEQ, 'PRIMARY' PK_NAME FROM INFORMATION_SCHEMA.COLUMNS WHERE COLUMN_KEY = 'pri' AND TABLE_SCHEMA LIKE 'unicentrum' AND TABLE_NAME LIKE 'stanice' ORDER BY TABLE_SCHEMA, TABLE_NAME, ORDINAL_POSITION 3 Execute SELECT TABLE_SCHEMA AS TABLE_CAT, NULL AS TABLE_SCHEM, TABLE_NAME, COLUMN_NAME, ORDINAL_POSITION KEY_SEQ, 'PRIMARY' PK_NAME FROM INFORMATION_SCHEMA.COLUMNS WHERE COLUMN_KEY = 'pri' AND TABLE_SCHEMA LIKE 'unicentrum' AND TABLE_NAME LIKE 'stanice' ORDER BY TABLE_SCHEMA, TABLE_NAME, ORDINAL_POSITION 3 Close stmt 3 Reset stmt 3 Query SELECT VARIABLE_VALUE FROM INFORMATION_SCHEMA.SESSION_VARIABLES WHERE VARIABLE_NAME='TX_ISOLATION' 3 Prepare SELECT * FROM stanice WHERE Sit_ID = ? ORDER BY Sit_ID, Podsit_ID, ID 3 Execute SELECT * FROM stanice WHERE Sit_ID = 1 ORDER BY Sit_ID, Podsit_ID, ID 3 Prepare SELECT TABLE_SCHEMA AS TABLE_CAT, NULL AS TABLE_SCHEM, TABLE_NAME, COLUMN_NAME, ORDINAL_POSITION KEY_SEQ, 'PRIMARY' PK_NAME FROM INFORMATION_SCHEMA.COLUMNS WHERE COLUMN_KEY = 'pri' AND TABLE_SCHEMA LIKE 'unicentrum' AND TABLE_NAME LIKE 'stanice' ORDER BY TABLE_SCHEMA, TABLE_NAME, ORDINAL_POSITION 3 Execute SELECT TABLE_SCHEMA AS TABLE_CAT, NULL AS TABLE_SCHEM, TABLE_NAME, COLUMN_NAME, ORDINAL_POSITION KEY_SEQ, 'PRIMARY' PK_NAME FROM INFORMATION_SCHEMA.COLUMNS WHERE COLUMN_KEY = 'pri' AND TABLE_SCHEMA LIKE 'unicentrum' AND TABLE_NAME LIKE 'stanice' ORDER BY TABLE_SCHEMA, TABLE_NAME, ORDINAL_POSITION 3 Close stmt 3 Reset stmt MySQL connector: 3 Query SELECT @@tx_isolation ... 3 Query select * from stanice 3 Prepare SELECT * FROM stanice WHERE Sit_ID = ? ORDER BY Sit_ID, Podsit_ID, ID 3 Execute SELECT * FROM stanice WHERE Sit_ID = '1' ORDER BY Sit_ID, Podsit_ID, ID 3 Close stmt I think those "unnecessary" queries are making difference in performance of those connectors. Does anybody have any ideas what could I do to speed up MariaDB's connector? We prefer not using MySQL connectors anymore. Thanks in advance Dušan Pavlica

2 1

[Maria-discuss] How to Host Multiple Mail Domains (Email Hosting) in iRedMail Full Featured Linux Mail Server
by Turritopsis Dohrnii Teo En Ming 04 May '21

04 May '21

Subject: How to Host Multiple Mail Domains (Email Hosting) in iRedMail Full Featured Linux Mail Server Author: Mr. Turritopsis Dohrnii Teo En Ming (TARGETED INDIVIDUAL) Country: Singapore Date: 3rd May 2021 Monday Type of Publication: PDF Manual Document Version: 20210503.01 ***IMPORTANT NOTICE*** Please note that Turritopsis Dohrnii Teo En Ming’s guide is based on Xiao Guoan’s guide at linuxbabe.com. Reference Guide Used by Teo En Ming: How to Host Multiple Mail Domains in iRedMail with Nginx Link: https://www.linuxbabe.com/mail-server/set-up-iredmail-multiple-domains-nginx Original Author: Xiao Guoan The following is a list of open-source software that will be automatically installed and configured by iRedMail. • Postfix SMTP server • Dovecot IMAP server • Nginx web server to serve the admin panel and webmail • OpenLDAP, MySQL/MariaDB, or PostgreSQL for storing user information • Amavised-new for DKIM signing and verification • SpamAssassin for anti-spam • ClamAV for anti-virus • Roundcube webmail • SOGo groupware, providing webmail, calendar (CalDAV), contacts (CardDAV), tasks and ActiveSync services. • Fail2ban for protecting SSH • mlmmj mailing list manager • Netdata server monitoring • iRedAPD Postfix policy server for greylisting In addition, you need to add MX, A and TXT records to your ISC BIND DNS domain name server. Redundant download links for Turritopsis Dohrnii Teo En Ming's PDF manual: [1] https://www.mediafire.com/file/q6txmx0rc1cwfzw/Additional+Mail+Domains+1st+… [2] https://www.docdroid.net/Q9TRL5D/additional-mail-domains-1st-release-pdf [3] https://www.scribd.com/document/506193434/Additional-Mail-Domains-1st-Relea… [4] https://drive.google.com/file/d/10AYGt4-omBeC3vXJfzswQq0M7E09gXpG/view?usp=… [5] https://drive.google.com/file/d/113dy0AKmBYGugBueK1vS_dJwI35J6XmJ/view?usp=… [6] https://drive.google.com/file/d/1dhpYIZp31ug5hoiVNbjh6uh99s_PEx8q/view?usp=… Mr. Turritopsis Dohrnii Teo En Ming, 43 years old as of 4th May 2021, is a TARGETED INDIVIDUAL living in Singapore. He is an IT Consultant with a System Integrator (SI)/computer firm in Singapore. He is an IT enthusiast. -----BEGIN EMAIL SIGNATURE----- The Gospel for all Targeted Individuals (TIs): [The New York Times] Microwave Weapons Are Prime Suspect in Ills of U.S. Embassy Workers Link: https://www.nytimes.com/2018/09/01/science/sonic-attack-cuba-microwave.html ******************************************************************************************** Singaporean Targeted Individual Mr. Turritopsis Dohrnii Teo En Ming's Academic Qualifications as at 14 Feb 2019 and refugee seeking attempts at the United Nations Refugee Agency Bangkok (21 Mar 2017), in Taiwan (5 Aug 2019) and Australia (25 Dec 2019 to 9 Jan 2020): [1] https://tdtemcerts.wordpress.com/ [2] https://tdtemcerts.blogspot.sg/ [3] https://www.scribd.com/user/270125049/Teo-En-Ming -----END EMAIL SIGNATURE-----

2 1

[Maria-discuss] Help for USE is missing
by Krzysztof Żelechowski 27 Apr '21

27 Apr '21

Mel: \h USE mysql: Nothing found Expected: <URL: https://mariadb.com/kb/en/use/ > Please fix, Chris

1 0

[Maria-discuss] How to Easily Set Up a Full-Featured Linux Mail Server on Ubuntu 18.04.5 LTS with iRedMail 1.4.0
by Turritopsis Dohrnii Teo En Ming 26 Apr '21

26 Apr '21

Subject: How to Easily Set Up a Full-Featured Linux Mail Server on Ubuntu 18.04.5 LTS with iRedMail 1.4.0 Good day from Singapore, I followed linuxbabe.com's Xiao Guoan's guide and successfully setup a full featured Linux mail server on Ubuntu 18.04.5 LTS with IRedMail 1.4.0. Author: Mr. Turritopsis Dohrnii Teo En Ming (TARGETED INDIVIDUAL) Country: Singapore Date: 25 April 2021 Sunday Type of Publication: PDF Manual Document Version: 20210425.01 (1st release) ***IMPORTANT NOTICE*** Please note that Turritopsis Dohrnii Teo En Ming’s guide is based on Xiao Guoan’s guide at linuxbabe.com. Reference Guide Used by Teo En Ming: How to Easily Set Up a Full-Featured Mail Server on Ubuntu 18.04 with iRedMail Link: https://www.linuxbabe.com/mail-server/ubuntu-18-04-iredmail-email-server Original Author: Xiao Guoan The following is a list of open-source software that will be automatically installed and configured by iRedMail. • Postfix SMTP server • Dovecot IMAP server • Nginx web server to serve the admin panel and webmail • OpenLDAP, MySQL/MariaDB, or PostgreSQL for storing user information • Amavised-new for DKIM signing and verification • SpamAssassin for anti-spam • ClamAV for anti-virus • Roundcube webmail • SOGo groupware, providing webmail, calendar (CalDAV), contacts (CardDAV), tasks and ActiveSync services. • Fail2ban for protecting SSH • mlmmj mailing list manager • Netdata server monitoring • iRedAPD Postfix policy server for greylisting Redundant Download Links for Teo En Ming's PDF Manual: [1] https://drive.google.com/file/d/1un8sLLmNSMIt7V6blWCvJEgwGvxMbd4B/view?usp=… [2] https://drive.google.com/file/d/1i0vY7kfYkobu563qoI3_qCZg7G7BFoYR/view?usp=… [3] https://drive.google.com/file/d/1U9MFN1EklLbA8TMweLV5ntiSJuBBVkpQ/view?usp=… [4] https://www.docdroid.net/dW70KtS/iredmail-setup-1st-release-pdf [5] https://www.mediafire.com/file/evar7j28knqyoj6/IRedMail+Setup+1st+Release.p… [6] https://www.scribd.com/document/504932780/IRedMail-Setup-1st-Release Mr. Turritopsis Dohrnii Teo En Ming, 43 years old as of 26 April 2021, is a TARGETED INDIVIDUAL living in Singapore. He is an IT Consultant with a System Integrator (SI)/computer firm in Singapore. He is an IT enthusiast. -----BEGIN EMAIL SIGNATURE----- The Gospel for all Targeted Individuals (TIs): [The New York Times] Microwave Weapons Are Prime Suspect in Ills of U.S. Embassy Workers Link: https://www.nytimes.com/2018/09/01/science/sonic-attack-cuba-microwave.html ******************************************************************************************** Singaporean Targeted Individual Mr. Turritopsis Dohrnii Teo En Ming's Academic Qualifications as at 14 Feb 2019 and refugee seeking attempts at the United Nations Refugee Agency Bangkok (21 Mar 2017), in Taiwan (5 Aug 2019) and Australia (25 Dec 2019 to 9 Jan 2020): [1] https://tdtemcerts.wordpress.com/ [2] https://tdtemcerts.blogspot.sg/ [3] https://www.scribd.com/user/270125049/Teo-En-Ming -----END EMAIL SIGNATURE-----

1 0

[Maria-discuss] pt-online-schema-change vs alter with alter_algorithm='NOCOPY'
by Jeff Dyke 23 Apr '21

23 Apr '21

Hi. In previous jobs, i have used pt-online-schema-change quite a bit, normally testing the change the night before it went live. I have a very good understanding about how pt-online-schema-change works and i would like to understand the inner workings of alter_algorithm='NOCOPY'. If i can trust that as much as the percona script, i'm going to be happy happy person. Thanks. This is my reddit post. https://www.reddit.com/r/mariadb/comments/mx4e60/ptonlineschemachange_vs_al… . I know we have a lot of great responders here, and if the answer comes here or on reddit, i will copy and paste for everyone's knowledge. Thanks all!

1 0

[Maria-discuss] Galera cluster will not bootstrap with SST set to use TLS
by lejeczek 23 Apr '21

23 Apr '21

Hi Guys. I wonder if anybody sees the same or similar issues which I do experience with SST, or maybe could try to reproduce it simply by: [sst] tkey = /etc/my.cnf.d/certs/sst/sst.key tcert = /etc/my.cnf.d/certs/sst/sst.crt Yes, by having SST to use TLS. If I do have those two params in my config then 'galera_new_cluster' fails to bootstrap new cluster. (naturally all other bits to required are set with TLS) Suffices to take those out and cluster bootstrap okey, then, on such up&running cluster, I can on each node put those back in and, one by one, restart the service/server and... it works!? I filled a bug report - https://jira.mariadb.org/browse/MDEV-25435 - and will appreciate if somebody can comment. many thanks, L.

1 0

[Maria-discuss] Building mariadb without PCRE?
by Chris Ross (cross2) 21 Apr '21

21 Apr '21

Good day. We have been using MariaDB in our product for a while, and are upgrading to 10.5.8 at the moment. I’ve just noticed that it’s no longer using the PCRE on our system, it’s grabbing its own from outside since the upgrade to PCRE2. We’re not using PCRE extensions at all in our applications, and I’d rather not pull in another extraneous library. We are a largely embedded product, and adding libraries is a technical and bureaucratic effort. Can I just build mariadb without PCRE support at all, using the traditional extended POSIX regexps instead? I don’t see a way to do this in the cmake files/parameters. - Chris -- Chris Ross cross2(a)cisco.com

3 5

[Maria-discuss] Planning on setting up Postfix + Dovecot + Webmail + Apache + MariaDB + PHP using Webmin Control Panel in the Cloud
by Turritopsis Dohrnii Teo En Ming 21 Apr '21

21 Apr '21

Subject: Planning on setting up Postfix + Dovecot + Webmail + Apache + MariaDB + PHP using Webmin Control Panel in the Cloud Good day from the Republic of Singapore, I am planning to setup Postfix Email Server + Dovecot IMAP/POP3 Incoming Mail Server + Webmail (Roundcube or Squirrelmail) + Apache Web Server + MariaDB Database Server + PHP using Webmin Control Panel specifically, in the cloud, preferably Amazon EC2. Are there any very good and well written guides on doing this type of setup? I am looking forward to your reply. Thank you very much. Mr. Turritopsis Dohrnii Teo En Ming, 43 years old as of 21 April 2021 Wed, is a TARGETED INDIVIDUAL (TI) living in Singapore. He is an IT Consultant with a System Integrator (SI)/computer firm in Singapore. He is an IT enthusiast. -----BEGIN EMAIL SIGNATURE----- The Gospel for all Targeted Individuals (TIs): [The New York Times] Microwave Weapons Are Prime Suspect in Ills of U.S. Embassy Workers Link: https://www.nytimes.com/2018/09/01/science/sonic-attack-cuba-microwave.html ******************************************************************************************** Singaporean Targeted Individual Mr. Turritopsis Dohrnii Teo En Ming's Academic Qualifications as at 14 Feb 2019 and refugee seeking attempts at the United Nations Refugee Agency Bangkok (21 Mar 2017), in Taiwan (5 Aug 2019) and Australia (25 Dec 2019 to 9 Jan 2020): [1] https://tdtemcerts.wordpress.com/ [2] https://tdtemcerts.blogspot.sg/ [3] https://www.scribd.com/user/270125049/Teo-En-Ming -----END EMAIL SIGNATURE-----

2 1

[Maria-discuss] mysql_upgrade fails
by Majed Zouhairy 21 Apr '21

21 Apr '21

in last time's upgrade and today i got: sudo mysql_upgrade -u root -p Enter password: Phase 1/7: Checking and upgrading mysql database Processing databases mysql mysql.column_stats OK mysql.columns_priv OK mysql.db OK mysql.event OK mysql.func OK mysql.help_category OK mysql.help_keyword OK mysql.help_relation OK mysql.help_topic OK mysql.host OK mysql.index_stats OK mysql.plugin OK mysql.proc OK mysql.procs_priv OK mysql.proxies_priv OK mysql.roles_mapping OK mysql.servers OK mysql.table_stats OK mysql.tables_priv OK mysql.time_zone OK mysql.time_zone_leap_second OK mysql.time_zone_name OK mysql.time_zone_transition OK mysql.time_zone_transition_type OK mysql.user OK Phase 2/7: Installing used storage engines... Skipped Phase 3/7: Fixing views Phase 4/7: Running 'mysql_fix_privilege_tables' ERROR 1813 (HY000) at line 77: Tablespace for table '`mysql`.`innodb_table_stats`' exists. Please DISCARD the tablespace before IMPORT ERROR 1813 (HY000) at line 81: Tablespace for table '`mysql`.`innodb_index_stats`' exists. Please DISCARD the tablespace before IMPORT ERROR 1813 (HY000) at line 85: Tablespace for table '`mysql`.`transaction_registry`' exists. Please DISCARD the tablespace before IMPORT ERROR 1813 (HY000) at line 153: Tablespace for table '`mysql`.`gtid_slave_pos`' exists. Please DISCARD the tablespace before IMPORT ERROR 1146 (42S02) at line 642: Table 'mysql.innodb_index_stats' doesn't exist ERROR 1243 (HY000) at line 643: Unknown prepared statement handler (stmt) given to EXECUTE ERROR 1146 (42S02) at line 645: Table 'mysql.innodb_table_stats' doesn't exist ERROR 1243 (HY000) at line 646: Unknown prepared statement handler (stmt) given to EXECUTE ERROR 1146 (42S02) at line 650: Table 'mysql.innodb_index_stats' doesn't exist ERROR 1146 (42S02) at line 654: Table 'mysql.innodb_table_stats' doesn't exist ERROR 1146 (42S02) at line 657: Table 'mysql.innodb_table_stats' doesn't exist FATAL ERROR: Upgrade failed what to do?

2 1

[Maria-discuss] SST's TLS in Galera prevents bootstrapping a new cluster
by lejeczek 12 Apr '21

12 Apr '21

Hi guys. It's pretty strange, in fact so strange that I presume I must be messing up something rather that MariaDB/Galera behaving this way by design. Thus before I paste any log snippets this question first: Why having this - [sst] tkey = /etc/my.cnf.d/certs/sst/sst.key tcert = /etc/my.cnf.d/certs/sst/sst.crt - would prevent a user to bootstrap new cluster? If do not use tkey/tcert I can bootstrap fine and after, cluster is up & running I put those back, then very next restart of mariadb on any/each node will work just fine. What is happening there some expert would mind to shed more light? many thanks, L.

1 0

[Maria-discuss] Exceeding configured memory
by Sig Pam 12 Apr '21

12 Apr '21

Hi all! I run into problems with the memory configuration of MariaDB 10.3.27 on Debian 10. It looks as if it exceeds the configured memory. The server hat 4 GB of memory. It runs MariaDB and a Kopano (Mail/Collaboration) server. The configuration I believe I have made is 2GB for MariaDB, plus 1 GB for Kopano. The rest is for reserved for the OS. If I look at the process list, I can see that mysql greatly exceeds the configured 2GB limit: root@exchange64:~# ps -e -o "vsz rss pid comm" | grep mysql 4933304 1604212 852 mysqld The virtual process size is 4.9 GB, with 1.6 GB resident in RAM. I think this is the reason why the server heavily uses swap: root@exchange64:~# free total used free shared buff/cache available Mem: 4027240 2812284 117932 49712 1097024 875632 Swap: 4191228 1963464 2227764 <- 1.9 GB of swap in use The server runs only one database. The database itself consists only INNODB tables, with some of them being quite large: MariaDB [zarafa]> show table status; +-------------------+--------+---------+------------+---------+------------- ---+-------------+-----------------+--------------+-------------+----------- -----+---------------------+---------------------+------------+------------- -------+----------+-----------------------------------------+---------+----- -------------+-----------+ | Name | Engine | Version | Row_format | Rows | Avg_row_length | Data_length | Max_data_length | Index_length | Data_free | Auto_increment | Create_time | Update_time | Check_time | Collation | Checksum | Create_options | Comment | Max_index_length | Temporary | +-------------------+--------+---------+------------+---------+------------- ---+-------------+-----------------+--------------+-------------+----------- -----+---------------------+---------------------+------------+------------- -------+----------+-----------------------------------------+---------+----- -------------+-----------+ | abchanges | InnoDB | 10 | Compact | 223 | 293 | 65536 | 0 | 98304 | 13429112832 | 57841 | 2019-10-02 08:01:57 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | acl | InnoDB | 10 | Compact | 134 | 122 | 16384 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:01:57 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | changes | InnoDB | 10 | Compact | 3531055 | 136 | 483393536 | 0 | 693075968 | 13429112832 | 4601576 | 2019-10-02 08:06:06 | 2021-04-12 08:06:29 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | deferredupdate | InnoDB | 10 | Compact | 20038 | 116 | 2342912 | 0 | 442368 | 13429112832 | NULL | 2019-10-02 08:06:06 | 2021-04-12 08:06:29 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | hierarchy | InnoDB | 10 | Compact | 348880 | 61 | 21495808 | 0 | 12976128 | 13429112832 | 2361351 | 2019-10-02 08:06:07 | 2021-04-12 08:06:29 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | indexedproperties | InnoDB | 10 | Compact | 259399 | 103 | 26787840 | 0 | 25640960 | 13429112832 | NULL | 2019-10-02 08:06:10 | 2021-04-12 08:06:29 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | lob | InnoDB | 10 | Compact | 130069 | 175090 | 22773825536 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:08:59 | 2021-04-12 08:05:53 | NULL | utf8mb4_general_ci | NULL | max_rows=1000000000 avg_row_length=1750 | | 0 | N | | mvproperties | InnoDB | 10 | Compact | 9703 | 158 | 1540096 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:08:59 | 2021-04-12 06:58:44 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | names | InnoDB | 10 | Compact | 3283 | 69 | 229376 | 0 | 671744 | 13429112832 | 3294 | 2019-10-02 08:08:59 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | object | InnoDB | 10 | Compact | 6 | 2730 | 16384 | 0 | 32768 | 13429112832 | 7 | 2019-10-02 08:08:59 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | objectmvproperty | InnoDB | 10 | Compact | 0 | 0 | 16384 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:08:59 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | objectproperty | InnoDB | 10 | Compact | 40 | 409 | 16384 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:08:59 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | objectrelation | InnoDB | 10 | Compact | 3 | 5461 | 16384 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:08:59 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | outgoingqueue | InnoDB | 10 | Compact | 0 | 0 | 16384 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:08:59 | 2021-04-12 07:20:40 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | properties | InnoDB | 10 | Compact | 9895527 | 414 | 4104863744 | 0 | 0 | 13429112832 | NULL | 2019-10-02 08:12:52 | 2021-04-12 08:18:25 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | receivefolder | InnoDB | 10 | Compact | 60 | 273 | 16384 | 0 | 16384 | 13429112832 | 209 | 2019-02-06 17:01:07 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | searchresults | InnoDB | 10 | Compact | 7404 | 161 | 1196032 | 0 | 0 | 13429112832 | NULL | 2019-02-06 17:01:08 | 2021-04-12 06:58:46 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | settings | InnoDB | 10 | Compact | 6 | 2730 | 16384 | 0 | 0 | 13429112832 | NULL | 2019-02-06 17:07:00 | 2021-04-12 08:05:53 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | singleinstances | InnoDB | 10 | Compact | 93075 | 70 | 6553600 | 0 | 4472832 | 13429112832 | 789962 | 2019-02-06 17:01:09 | 2021-04-12 08:05:53 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | stores | InnoDB | 10 | Compact | 16 | 1024 | 16384 | 0 | 16384 | 13429112832 | 55 | 2019-02-06 17:01:09 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | syncedmessages | InnoDB | 10 | Compact | 31098 | 135 | 4210688 | 0 | 2113536 | 13429112832 | NULL | 2019-02-06 17:01:09 | 2021-04-12 08:08:07 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | syncs | InnoDB | 10 | Compact | 30813 | 85 | 2621440 | 0 | 5750784 | 13429112832 | 255042 | 2019-02-06 17:01:10 | 2021-04-12 08:18:24 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | tproperties | InnoDB | 10 | Compact | 8528065 | 103 | 881278976 | 0 | 319373312 | 13429112832 | NULL | 2019-02-06 17:06:59 | 2021-04-12 08:06:29 | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | usergroup_acl | InnoDB | 10 | Compact | 2 | 8192 | 16384 | 0 | 0 | 13429112832 | NULL | 2018-11-08 18:13:26 | NULL | NULL | latin1_swedish_ci | NULL | | | 0 | N | | users | InnoDB | 10 | Compact | 24 | 682 | 16384 | 0 | 16384 | 13429112832 | 86 | 2019-02-06 17:06:59 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | | versions | InnoDB | 10 | Compact | 88 | 186 | 16384 | 0 | 0 | 13429112832 | NULL | 2019-02-06 17:06:59 | NULL | NULL | utf8mb4_general_ci | NULL | | | 0 | N | +-------------------+--------+---------+------------+---------+------------- ---+-------------+-----------------+--------------+-------------+----------- -----+---------------------+---------------------+------------+------------- -------+----------+-----------------------------------------+---------+----- -------------+-----------+ 26 rows in set (0.490 sec) These are the innodb variables: MariaDB [zarafa]> show variables like 'innodb%'; +---------------------------------------------+------------------------+ | Variable_name | Value | +---------------------------------------------+------------------------+ | innodb_adaptive_flushing | ON | | innodb_adaptive_flushing_lwm | 10.000000 | | innodb_adaptive_hash_index | ON | | innodb_adaptive_hash_index_parts | 8 | | innodb_adaptive_max_sleep_delay | 150000 | | innodb_autoextend_increment | 64 | | innodb_autoinc_lock_mode | 1 | | innodb_background_scrub_data_check_interval | 3600 | | innodb_background_scrub_data_compressed | OFF | | innodb_background_scrub_data_interval | 604800 | | innodb_background_scrub_data_uncompressed | OFF | | innodb_buf_dump_status_frequency | 0 | | innodb_buffer_pool_chunk_size | 134217728 | | innodb_buffer_pool_dump_at_shutdown | ON | | innodb_buffer_pool_dump_now | OFF | | innodb_buffer_pool_dump_pct | 25 | | innodb_buffer_pool_filename | ib_buffer_pool | | innodb_buffer_pool_instances | 8 | | innodb_buffer_pool_load_abort | OFF | | innodb_buffer_pool_load_at_startup | ON | | innodb_buffer_pool_load_now | OFF | | innodb_buffer_pool_size | 2147483648 | | innodb_change_buffer_max_size | 25 | | innodb_change_buffering | all | | innodb_checksum_algorithm | crc32 | | innodb_checksums | ON | | innodb_cmp_per_index_enabled | OFF | | innodb_commit_concurrency | 0 | | innodb_compression_algorithm | zlib | | innodb_compression_default | OFF | | innodb_compression_failure_threshold_pct | 5 | | innodb_compression_level | 6 | | innodb_compression_pad_pct_max | 50 | | innodb_concurrency_tickets | 5000 | | innodb_data_file_path | ibdata1:12M:autoextend | | innodb_data_home_dir | | | innodb_deadlock_detect | ON | | innodb_default_encryption_key_id | 1 | | innodb_default_row_format | dynamic | | innodb_defragment | OFF | | innodb_defragment_fill_factor | 0.900000 | | innodb_defragment_fill_factor_n_recs | 20 | | innodb_defragment_frequency | 40 | | innodb_defragment_n_pages | 7 | | innodb_defragment_stats_accuracy | 0 | | innodb_disable_sort_file_cache | OFF | | innodb_disallow_writes | OFF | | innodb_doublewrite | ON | | innodb_encrypt_log | OFF | | innodb_encrypt_tables | OFF | | innodb_encrypt_temporary_tables | OFF | | innodb_encryption_rotate_key_age | 1 | | innodb_encryption_rotation_iops | 100 | | innodb_encryption_threads | 0 | | innodb_fast_shutdown | 1 | | innodb_fatal_semaphore_wait_threshold | 600 | | innodb_file_format | | | innodb_file_per_table | ON | | innodb_fill_factor | 100 | | innodb_flush_log_at_timeout | 1 | | innodb_flush_log_at_trx_commit | 1 | | innodb_flush_method | fsync | | innodb_flush_neighbors | 1 | | innodb_flush_sync | ON | | innodb_flushing_avg_loops | 30 | | innodb_force_load_corrupted | OFF | | innodb_force_primary_key | OFF | | innodb_force_recovery | 0 | | innodb_ft_aux_table | | | innodb_ft_cache_size | 8000000 | | innodb_ft_enable_diag_print | OFF | | innodb_ft_enable_stopword | ON | | innodb_ft_max_token_size | 84 | | innodb_ft_min_token_size | 3 | | innodb_ft_num_word_optimize | 2000 | | innodb_ft_result_cache_limit | 2000000000 | | innodb_ft_server_stopword_table | | | innodb_ft_sort_pll_degree | 2 | | innodb_ft_total_cache_size | 640000000 | | innodb_ft_user_stopword_table | | | innodb_idle_flush_pct | 100 | | innodb_immediate_scrub_data_uncompressed | OFF | | innodb_instant_alter_column_allowed | add_last | | innodb_io_capacity | 200 | | innodb_io_capacity_max | 2000 | | innodb_large_prefix | | | innodb_lock_schedule_algorithm | fcfs | | innodb_lock_wait_timeout | 50 | | innodb_locks_unsafe_for_binlog | OFF | | innodb_log_buffer_size | 33554432 | | innodb_log_checksums | ON | | innodb_log_compressed_pages | ON | | innodb_log_file_size | 536870912 | | innodb_log_files_in_group | 2 | | innodb_log_group_home_dir | ./ | | innodb_log_optimize_ddl | OFF | | innodb_log_write_ahead_size | 8192 | | innodb_lru_scan_depth | 1024 | | innodb_max_dirty_pages_pct | 75.000000 | | innodb_max_dirty_pages_pct_lwm | 0.000000 | | innodb_max_purge_lag | 0 | | innodb_max_purge_lag_delay | 0 | | innodb_max_purge_lag_wait | 4294967295 | | innodb_max_undo_log_size | 10485760 | | innodb_monitor_disable | | | innodb_monitor_enable | | | innodb_monitor_reset | | | innodb_monitor_reset_all | | | innodb_old_blocks_pct | 37 | | innodb_old_blocks_time | 1000 | | innodb_online_alter_log_max_size | 134217728 | | innodb_open_files | 1000 | | innodb_optimize_fulltext_only | OFF | | innodb_page_cleaners | 4 | | innodb_page_size | 16384 | | innodb_prefix_index_cluster_optimization | OFF | | innodb_print_all_deadlocks | OFF | | innodb_purge_batch_size | 300 | | innodb_purge_rseg_truncate_frequency | 128 | | innodb_purge_threads | 4 | | innodb_random_read_ahead | OFF | | innodb_read_ahead_threshold | 56 | | innodb_read_io_threads | 4 | | innodb_read_only | OFF | | innodb_replication_delay | 0 | | innodb_rollback_on_timeout | OFF | | innodb_rollback_segments | 128 | | innodb_scrub_log | OFF | | innodb_scrub_log_speed | 256 | | innodb_sort_buffer_size | 1048576 | | innodb_spin_wait_delay | 4 | | innodb_stats_auto_recalc | ON | | innodb_stats_include_delete_marked | OFF | | innodb_stats_method | nulls_equal | | innodb_stats_modified_counter | 0 | | innodb_stats_on_metadata | OFF | | innodb_stats_persistent | ON | | innodb_stats_persistent_sample_pages | 20 | | innodb_stats_sample_pages | 8 | | innodb_stats_traditional | ON | | innodb_stats_transient_sample_pages | 8 | | innodb_status_output | OFF | | innodb_status_output_locks | OFF | | innodb_strict_mode | ON | | innodb_sync_array_size | 1 | | innodb_sync_spin_loops | 30 | | innodb_table_locks | ON | | innodb_temp_data_file_path | ibtmp1:12M:autoextend | | innodb_thread_concurrency | 0 | | innodb_thread_sleep_delay | 10000 | | innodb_tmpdir | | | innodb_undo_directory | ./ | | innodb_undo_log_truncate | OFF | | innodb_undo_logs | 128 | | innodb_undo_tablespaces | 0 | | innodb_use_atomic_writes | ON | | innodb_use_native_aio | ON | | innodb_version | 10.3.27 | | innodb_write_io_threads | 4 | +---------------------------------------------+------------------------+ 159 rows in set (0.217 sec) And for completeness, all variables (sorry, it's long and looks ugly): root@exchange64:/etc/mysql/conf.d# <mailto:root@exchange64:/etc/mysql/conf.d#> echo "show variables;" | mysql zarafa Variable_name Value alter_algorithm DEFAULT aria_block_size 8192 aria_checkpoint_interval 30 aria_checkpoint_log_activity 1048576 aria_encrypt_tables OFF aria_force_start_after_recovery_failures 0 aria_group_commit none aria_group_commit_interval 0 aria_log_file_size 1073741824 aria_log_purge_type immediate aria_max_sort_file_size 9223372036853727232 aria_page_checksum ON aria_pagecache_age_threshold 300 aria_pagecache_buffer_size 134217728 aria_pagecache_division_limit 100 aria_pagecache_file_hash_size 512 aria_recover_options BACKUP,QUICK aria_repair_threads 1 aria_sort_buffer_size 268434432 aria_stats_method nulls_unequal aria_sync_log_dir NEWFILE aria_used_for_temp_tables ON auto_increment_increment 1 auto_increment_offset 1 autocommit ON automatic_sp_privileges ON back_log 80 basedir /usr big_tables OFF bind_address 127.0.0.1 binlog_annotate_row_events ON binlog_cache_size 32768 binlog_checksum CRC32 binlog_commit_wait_count 0 binlog_commit_wait_usec 100000 binlog_direct_non_transactional_updates OFF binlog_file_cache_size 16384 binlog_format MIXED binlog_optimize_thread_scheduling ON binlog_row_image FULL binlog_stmt_cache_size 32768 bulk_insert_buffer_size 8388608 character_set_client utf8mb4 character_set_connection utf8mb4 character_set_database latin1 character_set_filesystem binary character_set_results utf8mb4 character_set_server utf8mb4 character_set_system utf8 character_sets_dir /usr/share/mysql/charsets/ check_constraint_checks ON collation_connection utf8mb4_general_ci collation_database latin1_swedish_ci collation_server utf8mb4_general_ci column_compression_threshold 100 column_compression_zlib_level 6 column_compression_zlib_strategy DEFAULT_STRATEGY column_compression_zlib_wrap OFF completion_type NO_CHAIN concurrent_insert AUTO connect_timeout 10 core_file OFF datadir /var/lib/mysql/ date_format %Y-%m-%d datetime_format %Y-%m-%d %H:%i:%s deadlock_search_depth_long 15 deadlock_search_depth_short 4 deadlock_timeout_long 50000000 deadlock_timeout_short 10000 debug_no_thread_alarm OFF default_master_connection default_regex_flags default_storage_engine InnoDB default_tmp_storage_engine default_week_format 0 delay_key_write ON delayed_insert_limit 100 delayed_insert_timeout 300 delayed_queue_size 1000 div_precision_increment 4 encrypt_binlog OFF encrypt_tmp_disk_tables OFF encrypt_tmp_files OFF enforce_storage_engine eq_range_index_dive_limit 0 error_count 0 event_scheduler OFF expensive_subquery_limit 100 expire_logs_days 10 explicit_defaults_for_timestamp OFF external_user extra_max_connections 1 extra_port 0 flush OFF flush_time 0 foreign_key_checks ON ft_boolean_syntax + -><()~*:""&| ft_max_word_len 84 ft_min_word_len 4 ft_query_expansion_limit 20 ft_stopword_file (built-in) general_log OFF general_log_file exchange64.log group_concat_max_len 1048576 gtid_binlog_pos gtid_binlog_state gtid_current_pos gtid_domain_id 0 gtid_ignore_duplicates OFF gtid_pos_auto_engines gtid_seq_no 0 gtid_slave_pos gtid_strict_mode OFF have_compress YES have_crypt YES have_dynamic_loading YES have_geometry YES have_openssl NO have_profiling YES have_query_cache YES have_rtree_keys YES have_ssl DISABLED have_symlink YES histogram_size 0 histogram_type SINGLE_PREC_HB host_cache_size 279 hostname exchange64 identity 0 idle_readonly_transaction_timeout 0 idle_transaction_timeout 0 idle_write_transaction_timeout 0 ignore_builtin_innodb OFF ignore_db_dirs in_predicate_conversion_threshold 1000 in_transaction 0 init_connect init_file init_slave innodb_adaptive_flushing ON innodb_adaptive_flushing_lwm 10.000000 innodb_adaptive_hash_index ON innodb_adaptive_hash_index_parts 8 innodb_adaptive_max_sleep_delay 150000 innodb_autoextend_increment 64 innodb_autoinc_lock_mode 1 innodb_background_scrub_data_check_interval 3600 innodb_background_scrub_data_compressed OFF innodb_background_scrub_data_interval 604800 innodb_background_scrub_data_uncompressed OFF innodb_buf_dump_status_frequency 0 innodb_buffer_pool_chunk_size 134217728 innodb_buffer_pool_dump_at_shutdown ON innodb_buffer_pool_dump_now OFF innodb_buffer_pool_dump_pct 25 innodb_buffer_pool_filename ib_buffer_pool innodb_buffer_pool_instances 8 innodb_buffer_pool_load_abort OFF innodb_buffer_pool_load_at_startup ON innodb_buffer_pool_load_now OFF innodb_buffer_pool_size 2147483648 innodb_change_buffer_max_size 25 innodb_change_buffering all innodb_checksum_algorithm crc32 innodb_checksums ON innodb_cmp_per_index_enabled OFF innodb_commit_concurrency 0 innodb_compression_algorithm zlib innodb_compression_default OFF innodb_compression_failure_threshold_pct 5 innodb_compression_level 6 innodb_compression_pad_pct_max 50 innodb_concurrency_tickets 5000 innodb_data_file_path ibdata1:12M:autoextend innodb_data_home_dir innodb_deadlock_detect ON innodb_default_encryption_key_id 1 innodb_default_row_format dynamic innodb_defragment OFF innodb_defragment_fill_factor 0.900000 innodb_defragment_fill_factor_n_recs 20 innodb_defragment_frequency 40 innodb_defragment_n_pages 7 innodb_defragment_stats_accuracy 0 innodb_disable_sort_file_cache OFF innodb_disallow_writes OFF innodb_doublewrite ON innodb_encrypt_log OFF innodb_encrypt_tables OFF innodb_encrypt_temporary_tables OFF innodb_encryption_rotate_key_age 1 innodb_encryption_rotation_iops 100 innodb_encryption_threads 0 innodb_fast_shutdown 1 innodb_fatal_semaphore_wait_threshold 600 innodb_file_format innodb_file_per_table ON innodb_fill_factor 100 innodb_flush_log_at_timeout 1 innodb_flush_log_at_trx_commit 1 innodb_flush_method fsync innodb_flush_neighbors 1 innodb_flush_sync ON innodb_flushing_avg_loops 30 innodb_force_load_corrupted OFF innodb_force_primary_key OFF innodb_force_recovery 0 innodb_ft_aux_table innodb_ft_cache_size 8000000 innodb_ft_enable_diag_print OFF innodb_ft_enable_stopword ON innodb_ft_max_token_size 84 innodb_ft_min_token_size 3 innodb_ft_num_word_optimize 2000 innodb_ft_result_cache_limit 2000000000 innodb_ft_server_stopword_table innodb_ft_sort_pll_degree 2 innodb_ft_total_cache_size 640000000 innodb_ft_user_stopword_table innodb_idle_flush_pct 100 innodb_immediate_scrub_data_uncompressed OFF innodb_instant_alter_column_allowed add_last innodb_io_capacity 200 innodb_io_capacity_max 2000 innodb_large_prefix innodb_lock_schedule_algorithm fcfs innodb_lock_wait_timeout 50 innodb_locks_unsafe_for_binlog OFF innodb_log_buffer_size 33554432 innodb_log_checksums ON innodb_log_compressed_pages ON innodb_log_file_size 536870912 innodb_log_files_in_group 2 innodb_log_group_home_dir ./ innodb_log_optimize_ddl OFF innodb_log_write_ahead_size 8192 innodb_lru_scan_depth 1024 innodb_max_dirty_pages_pct 75.000000 innodb_max_dirty_pages_pct_lwm 0.000000 innodb_max_purge_lag 0 innodb_max_purge_lag_delay 0 innodb_max_purge_lag_wait 4294967295 innodb_max_undo_log_size 10485760 innodb_monitor_disable innodb_monitor_enable innodb_monitor_reset innodb_monitor_reset_all innodb_old_blocks_pct 37 innodb_old_blocks_time 1000 innodb_online_alter_log_max_size 134217728 innodb_open_files 1000 innodb_optimize_fulltext_only OFF innodb_page_cleaners 4 innodb_page_size 16384 innodb_prefix_index_cluster_optimization OFF innodb_print_all_deadlocks OFF innodb_purge_batch_size 300 innodb_purge_rseg_truncate_frequency 128 innodb_purge_threads 4 innodb_random_read_ahead OFF innodb_read_ahead_threshold 56 innodb_read_io_threads 4 innodb_read_only OFF innodb_replication_delay 0 innodb_rollback_on_timeout OFF innodb_rollback_segments 128 innodb_scrub_log OFF innodb_scrub_log_speed 256 innodb_sort_buffer_size 1048576 innodb_spin_wait_delay 4 innodb_stats_auto_recalc ON innodb_stats_include_delete_marked OFF innodb_stats_method nulls_equal innodb_stats_modified_counter 0 innodb_stats_on_metadata OFF innodb_stats_persistent ON innodb_stats_persistent_sample_pages 20 innodb_stats_sample_pages 8 innodb_stats_traditional ON innodb_stats_transient_sample_pages 8 innodb_status_output OFF innodb_status_output_locks OFF innodb_strict_mode ON innodb_sync_array_size 1 innodb_sync_spin_loops 30 innodb_table_locks ON innodb_temp_data_file_path ibtmp1:12M:autoextend innodb_thread_concurrency 0 innodb_thread_sleep_delay 10000 innodb_tmpdir innodb_undo_directory ./ innodb_undo_log_truncate OFF innodb_undo_logs 128 innodb_undo_tablespaces 0 innodb_use_atomic_writes ON innodb_use_native_aio ON innodb_version 10.3.27 innodb_write_io_threads 4 insert_id 0 interactive_timeout 28800 join_buffer_size 262144 join_buffer_space_limit 2097152 join_cache_level 2 keep_files_on_create OFF key_buffer_size 134217728 key_cache_age_threshold 300 key_cache_block_size 1024 key_cache_division_limit 100 key_cache_file_hash_size 512 key_cache_segments 0 large_files_support ON large_page_size 0 large_pages OFF last_gtid last_insert_id 0 lc_messages en_US lc_messages_dir /usr/share/mysql lc_time_names en_US license GPL local_infile ON lock_wait_timeout 86400 locked_in_memory OFF log_bin OFF log_bin_basename log_bin_compress OFF log_bin_compress_min_len 256 log_bin_index log_bin_trust_function_creators OFF log_disabled_statements sp log_error /var/log/mysql/error.log log_output FILE log_queries_not_using_indexes OFF log_slave_updates OFF log_slow_admin_statements ON log_slow_disabled_statements sp log_slow_filter admin,filesort,filesort_on_disk,filesort_priority_queue,full_join,full_scan, query_cache,query_cache_miss,tmp_table,tmp_table_on_disk log_slow_rate_limit 1 log_slow_slave_statements ON log_slow_verbosity log_tc_size 24576 log_warnings 2 long_query_time 10.000000 low_priority_updates OFF lower_case_file_system OFF lower_case_table_names 0 master_verify_checksum OFF max_allowed_packet 16777216 max_binlog_cache_size 18446744073709547520 max_binlog_size 1073741824 max_binlog_stmt_cache_size 18446744073709547520 max_connect_errors 100 max_connections 151 max_delayed_threads 20 max_digest_length 1024 max_error_count 64 max_heap_table_size 16777216 max_insert_delayed_threads 20 max_join_size 18446744073709551615 max_length_for_sort_data 1024 max_long_data_size 16777216 max_prepared_stmt_count 16382 max_recursive_iterations 4294967295 max_relay_log_size 1073741824 max_seeks_for_key 4294967295 max_session_mem_used 9223372036854775807 max_sort_length 1024 max_sp_recursion_depth 0 max_statement_time 0.000000 max_tmp_tables 32 max_user_connections 0 max_write_lock_count 4294967295 metadata_locks_cache_size 1024 metadata_locks_hash_instances 8 min_examined_row_limit 0 mrr_buffer_size 262144 multi_range_count 256 myisam_block_size 1024 myisam_data_pointer_size 6 myisam_max_sort_file_size 9223372036853727232 myisam_mmap_size 18446744073709551615 myisam_recover_options BACKUP,QUICK myisam_repair_threads 1 myisam_sort_buffer_size 134216704 myisam_stats_method NULLS_UNEQUAL myisam_use_mmap OFF mysql56_temporal_format ON net_buffer_length 16384 net_read_timeout 30 net_retry_count 10 net_write_timeout 60 old OFF old_alter_table DEFAULT old_mode old_passwords OFF open_files_limit 16186 optimizer_prune_level 1 optimizer_search_depth 62 optimizer_selectivity_sampling_limit 100 optimizer_switch index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_in tersection=on,index_merge_sort_intersection=off,engine_condition_pushdown=of f,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmat ch=on,loosescan=on,materialization=on,in_to_exists=on,semijoin=on,partial_ma tch_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr _cost_based=off,mrr_sort_keys=off,outer_join_with_cache=on,semijoin_with_cac he=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optim ize_join_buffer_size=off,table_elimination=on,extended_keys=on,exists_to_in= on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materi alized=on optimizer_use_condition_selectivity 1 performance_schema OFF performance_schema_accounts_size -1 performance_schema_digests_size -1 performance_schema_events_stages_history_long_size -1 performance_schema_events_stages_history_size -1 performance_schema_events_statements_history_long_size -1 performance_schema_events_statements_history_size -1 performance_schema_events_waits_history_long_size -1 performance_schema_events_waits_history_size -1 performance_schema_hosts_size -1 performance_schema_max_cond_classes 80 performance_schema_max_cond_instances -1 performance_schema_max_digest_length 1024 performance_schema_max_file_classes 50 performance_schema_max_file_handles 32768 performance_schema_max_file_instances -1 performance_schema_max_mutex_classes 200 performance_schema_max_mutex_instances -1 performance_schema_max_rwlock_classes 40 performance_schema_max_rwlock_instances -1 performance_schema_max_socket_classes 10 performance_schema_max_socket_instances -1 performance_schema_max_stage_classes 160 performance_schema_max_statement_classes 200 performance_schema_max_table_handles -1 performance_schema_max_table_instances -1 performance_schema_max_thread_classes 50 performance_schema_max_thread_instances -1 performance_schema_session_connect_attrs_size -1 performance_schema_setup_actors_size 100 performance_schema_setup_objects_size 100 performance_schema_users_size -1 pid_file /run/mysqld/mysqld.pid plugin_dir /usr/lib/x86_64-linux-gnu/mariadb19/plugin/ plugin_maturity gamma port 3306 preload_buffer_size 32768 profiling OFF profiling_history_size 15 progress_report_time 5 protocol_version 10 proxy_protocol_networks proxy_user pseudo_slave_mode OFF pseudo_thread_id 10804 query_alloc_block_size 16384 query_cache_limit 1048576 query_cache_min_res_unit 4096 query_cache_size 16777216 query_cache_strip_comments OFF query_cache_type ON query_cache_wlock_invalidate OFF query_prealloc_size 24576 rand_seed1 27429069 rand_seed2 533006049 range_alloc_block_size 4096 read_binlog_speed_limit 0 read_buffer_size 131072 read_only OFF read_rnd_buffer_size 262144 relay_log relay_log_basename relay_log_index relay_log_info_file relay-log.info relay_log_purge ON relay_log_recovery OFF relay_log_space_limit 0 replicate_annotate_row_events ON replicate_do_db replicate_do_table replicate_events_marked_for_skip REPLICATE replicate_ignore_db replicate_ignore_table replicate_wild_do_table replicate_wild_ignore_table report_host report_password report_port 3306 report_user rowid_merge_buff_size 8388608 rpl_semi_sync_master_enabled OFF rpl_semi_sync_master_timeout 10000 rpl_semi_sync_master_trace_level 32 rpl_semi_sync_master_wait_no_slave ON rpl_semi_sync_master_wait_point AFTER_COMMIT rpl_semi_sync_slave_delay_master OFF rpl_semi_sync_slave_enabled OFF rpl_semi_sync_slave_kill_conn_timeout 5 rpl_semi_sync_slave_trace_level 32 secure_auth ON secure_file_priv secure_timestamp NO server_id 1 session_track_schema ON session_track_state_change OFF session_track_system_variables autocommit,character_set_client,character_set_connection,character_set_resul ts,time_zone session_track_transaction_info OFF skip_external_locking ON skip_name_resolve OFF skip_networking OFF skip_parallel_replication OFF skip_replication OFF skip_show_database OFF slave_compressed_protocol OFF slave_ddl_exec_mode IDEMPOTENT slave_domain_parallel_threads 0 slave_exec_mode STRICT slave_load_tmpdir /tmp slave_max_allowed_packet 1073741824 slave_net_timeout 60 slave_parallel_max_queued 131072 slave_parallel_mode conservative slave_parallel_threads 0 slave_parallel_workers 0 slave_run_triggers_for_rbr NO slave_skip_errors OFF slave_sql_verify_checksum ON slave_transaction_retries 10 slave_transaction_retry_errors 1213,1205 slave_transaction_retry_interval 0 slave_type_conversions slow_launch_time 2 slow_query_log OFF slow_query_log_file exchange64-slow.log socket /run/mysqld/mysqld.sock sort_buffer_size 2097152 sql_auto_is_null OFF sql_big_selects ON sql_buffer_result OFF sql_log_bin ON sql_log_off OFF sql_mode STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE _SUBSTITUTION sql_notes ON sql_quote_show_create ON sql_safe_updates OFF sql_select_limit 18446744073709551615 sql_slave_skip_counter 0 sql_warnings OFF ssl_ca ssl_capath ssl_cert ssl_cipher ssl_crl ssl_crlpath ssl_key standard_compliant_cte ON storage_engine InnoDB stored_program_cache 256 strict_password_validation ON sync_binlog 0 sync_frm ON sync_master_info 10000 sync_relay_log 10000 sync_relay_log_info 10000 system_time_zone CEST system_versioning_alter_history ERROR system_versioning_asof DEFAULT table_definition_cache 400 table_open_cache 1000 table_open_cache_instances 8 tcp_keepalive_interval 0 tcp_keepalive_probes 0 tcp_keepalive_time 0 thread_cache_size 151 thread_concurrency 10 thread_handling one-thread-per-connection thread_pool_idle_timeout 60 thread_pool_max_threads 65536 thread_pool_oversubscribe 3 thread_pool_prio_kickup_timer 1000 thread_pool_priority auto thread_pool_size 4 thread_pool_stall_limit 500 thread_stack 299008 time_format %H:%i:%s time_zone SYSTEM timed_mutexes OFF timestamp 1618208688.935216 tmp_disk_table_size 18446744073709551615 tmp_memory_table_size 16777216 tmp_table_size 16777216 tmpdir /tmp transaction_alloc_block_size 8192 transaction_prealloc_size 4096 tx_isolation REPEATABLE-READ tx_read_only OFF unique_checks ON updatable_views_with_limit YES use_stat_tables NEVER userstat OFF version 10.3.27-MariaDB-0+deb10u1 version_comment Debian 10 version_compile_machine x86_64 version_compile_os debian-linux-gnu version_malloc_library system version_source_revision dba846ce2a4c57363c4f0256b0e6d2dd1a55ac40 version_ssl_library YaSSL 2.4.4 wait_timeout 28800 warning_count 0 wsrep_osu_method TOI wsrep_auto_increment_control ON wsrep_causal_reads OFF wsrep_certification_rules strict wsrep_certify_nonpk ON wsrep_cluster_address wsrep_cluster_name my_wsrep_cluster wsrep_convert_lock_to_trx OFF wsrep_data_home_dir /var/lib/mysql/ wsrep_dbug_option wsrep_debug OFF wsrep_desync OFF wsrep_dirty_reads OFF wsrep_drupal_282555_workaround OFF wsrep_forced_binlog_format NONE wsrep_gtid_domain_id 0 wsrep_gtid_mode OFF wsrep_load_data_splitting ON wsrep_log_conflicts OFF wsrep_max_ws_rows 0 wsrep_max_ws_size 2147483647 wsrep_mysql_replication_bundle 0 wsrep_node_address wsrep_node_incoming_address AUTO wsrep_node_name exchange64 wsrep_notify_cmd wsrep_on OFF wsrep_patch_version wsrep_25.24 wsrep_provider none wsrep_provider_options wsrep_recover OFF wsrep_reject_queries NONE wsrep_replicate_myisam OFF wsrep_restart_slave OFF wsrep_retry_autocommit 1 wsrep_slave_fk_checks ON wsrep_slave_uk_checks OFF wsrep_slave_threads 1 wsrep_sst_auth wsrep_sst_donor wsrep_sst_donor_rejects_queries OFF wsrep_sst_method rsync wsrep_sst_receive_address AUTO wsrep_start_position 00000000-0000-0000-0000-000000000000:-1 wsrep_sync_wait 0 Can somebody please give me an advice what I made wrong to limit the memory usage of MariaDB to 2 GB? Thank you very much! Sig

2 1

[Maria-discuss] MEMORY tables and binlog
by Dajka Tamás 07 Apr '21

07 Apr '21

Hi All, I'm facing a weird error. We're migrating our old 10.1 multi-master setup to a new 10.3 cluster (everything is running on Debian). New-node01 is connected as a slave to the old cluster's master. When I tried to set up the replication between the 2 new nodes (with data files copy), the slave thread stopped nearly immediatelly stating, that the command is invalid - containing illegal characters. After some investigation, it turned out, that binlog on the master (new-node01) is - let's say - corrupted. After a few iterations/checking I saw, that the error always happens with some MEMORY tables (I know I can exclude them from the replica, but want to understand the issue first). new-node01/02 running 10.3.27-MariaDB-0+deb10u1-log on latest Debian 10.9 (replication from old-node is OK), replication is GTID based. HW is a new HP Gen10 DL380. When checking the binlog on the new-node01 with mysqlbinlog, I get the following: # at 2361 #210407 11:13:34 server id 4 end_log_pos 2403 CRC32 0x90080d27 GTID 100-4-37336878143 trans /*!100001 SET @@session.gtid_seq_no=37336878143*//*!*/; START TRANSACTION /*!*/; # at 2403 #210407 11:13:34 server id 4 end_log_pos 2527 CRC32 0x27183d2f Query thread_id=341297541 exec_time=318 error_code=0 SET TIMESTAMP=1617786814/*!*/; DELETE FROM `mydb1`.`collect_output`e<FB>#<98> /*!*/; # at 2527 #210407 11:13:34 server id 4 end_log_pos 2598 CRC32 0x427f0ed7 Table_map: `mydb1`.`collect_output` mapped to number 1330 Please notice the illegal chars at the end of the "DELETE FROM" line. (DELETE FROM is normal, since new-node01 is starting up from shutdown and mydb1.collect_output is a MEMORY table -> will delete the contents, so that the replications slaves have the same data). Is this a bug or a known issue? Is there any other way to solve this, than exclude the MEMORY tables from the replication? Thanks, Tom

5 7

[Maria-discuss] ODBC picking nearby connections?
by Antony Stone 07 Apr '21

07 Apr '21

Hi. I have the following setup: Two data centres which I shall label North and South for the following explanation. Four virtual machines, Whiskey and Xray in data centre North, and Yankee and Zulu in data centre South, which have the Debian package unixodbc installed, together with libmaodbc. Four other virtual machines, Alfa and Bravo in North and Charlie and Delta in South, all running MariaDB with Galera replication. A single hostname DB.example.com which resolves to the four IP addresses of the four database servers Alfa, Bravo, Charlie and Delta. Every instance of /etc/odbc.ini on machines Whiskey, Xray, Yankee and Zulu has the setting "SERVER=DB.example.com" in it. When I start an application which uses ODBC (in my case this is Asterisk), I find that each application server manages to connect to a database server in its own data centre. Given a 50% chance of this happening for machine Whiskey, a 50% chance for machine Xray, etc., this comes out as a 1 in 16 combined probability of happening by chance. Therefore I think it is not by chance :) I've done some packet captures, and I see each machine Whiskey, Xray, Yankee and Zulu doing a single DNS query for DB.example.com and getting the four IP addresses of Alfa, Bravo, Chalie and Delta returned. As expected, the order the addresses is returned in is randomised for different queries. Each machine then makes a single connection to MariaDB on port 3306 on one of the IP addresses in the list. This address can be the first in the list returned from the DNS resolver, or it can the the last one, or it can be on in the middle. There is no attempt to ping the four addresses and compare round-trip times, or to connect to MariaDB on more than one server and measure the query response times. Each applicaton server connects to one database server, and they always manage to connect to a machine in their own data centre. My question is: how do they do this? How does machine Whiskey manage to select one of the two IP addresses for database servers Alfa and Bravo, and connect to it, ignoring the addresses for Charlie and Delta? If I can supply any further information to help with answering this question, please let me know. Thanks, Antony. -- "Have you been drinking brake fluid again? I think you're addicted to the stuff." "No, no, it's alright - I can stop any time I want to." Please reply to the list; please *don't* CC me.

1 0

[Maria-discuss] Galera with TLS not happy.
by lejeczek 29 Mar '21

29 Mar '21

Hi guys. I'm trying to add encryption to my already working galera cluster and I've look at number of tutorials, official ones included. I've added these to configs: [mariadb] ssl_cert = /etc/my.cnf.d/certs/c8kubernode2.private.pawel.crt ssl_key = /etc/my.cnf.d/certs/c8kubernode2.private.pawel.key ssl_ca = /etc/my.cnf.d/certs/ca.crt [mysqld] wsrep_provider_options="socket.ssl=yes;socket.ssl_cert=/etc/my.cnf.d/certs/c8kubernode2.private.pawel.crt;socket.ssl_key=/etc/my.cnf.d/certs/c8kubernode2.private.pawel.key;socket.ssl_ca=/etc/my.cnf.d/certs/ca.crt" First server, above configs, starts okey with 'galera_new_cluster' but the second, I'm on Centos 8, when started as normal with systemd shows: ... 2021-03-29 17:33:34 0 [ERROR] WSREP: gcomm/src/asio_tcp.cpp:handshake_handler():128: handshake with remote endpoint ssl://10.1.1.223:4567 failed: asio.ssl:337047686: 'certificate verify failed' ( 337047686: 'error:1416F086:SSL routines:tls_process_server_certificate:certificate verify failed') 2021-03-29 17:33:36 0 [ERROR] WSREP: gcomm/src/asio_tcp.cpp:handshake_handler():128: handshake with remote endpoint ssl://10.1.1.223:4567 failed: asio.ssl:337047686: 'certificate verify failed' ( 337047686: 'error:1416F086:SSL routines:tls_process_server_certificate:certificate verify failed') ... and eventually after a moment fails. The second server has the same bits in configs only, naturally, files names are different respectively. I also see this, in case might tell more or be relevant, this is on 'galera_new_cluster' up & running: -> $ mysql --ssl -h c8kubernode2.private.pawel -u wordpress -p --ssl-verify-server-cert=true Enter password: ERROR 2026 (HY000): SSL connection error: self signed certificate in certificate chain -> $ mysql --ssl -h c8kubernode2.private.pawel -u wordpress -p --ssl-verify-server-cert=false Enter password: Welcome to the MariaDB monitor. Commands end with ; or \g. But if this is 'CN' problem then looking at the mysql server cert: -> $ _my._sslPrintCert.sh c8kubernode2.private.pawel.crt issuer=CN = "nodemaster.private.pawel," # <= here, it matches server's hostname as expected. subject=CN = c8kubernode2.private.pawel notAfter=Jul 2 20:50:57 2023 GMT Certificate: ... Also, in case it might matter, I do not have as you can see [sst] bits done yet. Any ideas someone cares to share I'll appreciate. many thanks, L.

1 0

[Maria-discuss] Introduction and Task Suggestion
by Hemant Kumar Singh 22 Mar '21

22 Mar '21

Hi everyone, I am Hemant from Nepal, currently a Computer Science Junior at NIT Warangal, India willing to take part in GSoC 2021. I saw a major priority task "MDEV-13648- Add FULL OUTER JOIN to MariaDB (https://link.getmailspring.com/link/F02B618E-9401-406B-BD92-A573A39AD858@ge…)" unresolved since gsoc 2019; but it's not listed in 2021 List of Ideas. So, I was just wondering whether I can contribute to this task for gsoc 2021. Can anyone confirm this? Regards, Hemant Kumar Singh https://iamhks.com (https://link.getmailspring.com/link/F02B618E-9401-406B-BD92-A573A39AD858@ge…)

3 3