- discuss - lists.mariadb.org

[Maria-discuss] Nosql language with plugins
by Roberto Spadim 11 May '20

11 May '20

Could be possible use the query rewrite plugin to execute no sql commands? Something like disable sql parser and execute some specific protocol, returning standard sql datasets as result? -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira

3 4

[Maria-discuss] OSX fix need on MariaDB-10.5
by Daniel Black 09 May '20

09 May '20

Mac lovers (who can use C/C++ and a debugger), As your MariaDB developers are hard at work getting 10.5 ready for you, unfortunately a bug has slipped into the 10.5 branch making it unusable on OSX (at least that's what it looks like on the CI infrastructure). The bug report is here: https://jira.mariadb.org/browse/MDEV-22173 As the time of developers is a little short as is the availability of OSX hardware, I'm hoping some of you are able to spend a few hours tackling this task to understand it better, and if possible, create patch. Steps: 1. build environment https://mariadb.com/kb/en/Build_Environment_Setup_for_Mac/ 2. clone the source git clone --branch 10.5 https://github.com/MariaDB/server.git mariadb-server cd mariadb-server git submodule update --recursive --init 3. build instructions https://mariadb.com/kb/en/generic-build-instructions/ (you don't need to install) 4. test (from build directory) mysql-test/mysql-test-run main.select might be useful here: --debugger=NAME or --gdb client-debugger=NAME or client-gdb To collaborative share your findings and to ask for further help MariaDB's community chat stream has been created for you. https://mariadb.zulipchat.com/#narrow/stream/118759-general/topic/Get.20OSX… To paraphrase J.F.Kennedy ask not what your database server community can do for you — ask what you can do for your database server community. Keep the community spirit going, Daniel Black -- Sent as a community member who noticed OSX failures and that everyone is busy

2 3

[Maria-discuss] Data At Rest Encryption Overhead
by Michael Caplan 09 May '20

09 May '20

Hello, I'm working on a plan to roll out MariaDB per table data at rest encryption. Reading through the docs (https://mariadb.com/kb/en/data-at-rest-encryption-overview/) I understand that "Using encryption has an overhead of roughly 3-5%." I'd like to know what this 3-4% refers to. I am assuming this is a penalty related to transactions a second (as the referenced blog post discusses: https://mariadb.com/resources/blog/table-and-tablespace-encryption-on-maria…) I am hoping I can access the MariaDB community brain trust to understand the overhead of deploying encryption as related to: * Disk: what overhead can I plan around for disk space? * Scale considerations: in my environment I am looking at encrypting around 100,000 smaller tables (spread out over numerous databases). With the tables being encrypted, will they be decrypted and encrypted on demand (as opposed to being "decrypted" on startup)? * Index query performance: does encryption have an effect on how indexes are utilized that I would need to plan against? Are there other factors that others consider when deploying data at rest encryption? Best, Mike

2 1

[Maria-discuss] Maybe OT: we have clients from Centos 7.8 sporadically connecting via 'strange' ipv6 address
by Thomas Plant 08 May '20

08 May '20

Hello, do not know if this is the right place to ask, we have, since updating to Centos 7.8 from 7.7, some PHP Webs which try to connect to the MySQL server with the following IPv6 as address in the addresspart of the user: 'user'@[::ffff:10.11.12.13] They get access denied as the real user is 'user'@'10.11.12.13'. Is this a PHP problem or a MySQL client setting i can set to disable this IPv6 thing? Disabling IPv6 on the interface can be done but I'd rather would not. Regards, Thomas

1 0

Re: [Maria-discuss] Problems copy database files
by Ling, Andy 07 May '20

07 May '20

I’ve been doing a bit more investigation and it looks like the FLUSH TABLES FOR EXPORT isn’t flushing to disk. I monitor the modified time of the .MAD file for a table. If I make a change to the table the modified date doesn’t change. If I do FLUSH TABLES FOR EXPORT the modified time still doesn’t change. If I do a FLUSH TABLES the modified time does change. So adding the FOR EXPORT option seems to stop the data being flushed to disk. Is this expected behaviour? It certainly isn’t how I read the documentation. Regards Andy Ling From: Ling, Andy Sent: Wed 06 May 2020 12:12 To: 'Roberto Spadim' <roberto(a)spadim.com.br> Subject: RE: [EXTERNAL] Re: Re: [Maria-discuss] Problems copy database files As I said, there is no destination server in this simple test. It is all done within the same machine and the same instance of MariaDB server. In the full system where I first noticed the problem the copied files are checked with the aria_chk command and the mysqlcheck command and apart from the “zero filling” message are OK. Still the data is missing. It looks like the FLUSH command isn’t flushing all the way to disk. Regards Andy Ling From: Roberto Spadim [mailto:roberto@spadim.com.br] Sent: Wed 06 May 2020 12:06 To: Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> Subject: [EXTERNAL] Re: Re: [Maria-discuss] Problems copy database files there's an aria journaling file too, maybe it's not being sync before you copy, but from what i remember this should work, try to flush table at destination server and open table again just to check if it's not something at destination server Em qua., 6 de mai. de 2020 às 07:59, Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> escreveu: They are the same. I’m actually doing this simple test on a single machine (and disk). So the files are just being copied from the original database folder to a backup folder on the same disk drive. Regards Andy Ling From: Roberto Spadim [mailto:roberto@spadim.com.br<mailto:roberto@spadim.com.br>] Sent: Wed 06 May 2020 11:55 To: Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> Cc: Mailing-List mariadb <maria-discuss(a)lists.launchpad.net<mailto:maria-discuss@lists.launchpad.net>> Subject: [EXTERNAL] Re: [Maria-discuss] Problems copy database files what about file size on both servers? Em qua., 6 de mai. de 2020 às 07:35, Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> escreveu: Hi, I am having problems copying database files. I am using MariaDB 10.4.12 on Windows server 2019. And all the tables use the Aria engine A simple set of operations that reproduces the problem is… Add some data to a table FLUSH TABLE “table” FOR EXPORT Copy the .FRM, .MAI, .MAD files for the table to a backup folder. UNLOCK TABLES switch to the database in the backup folder and check the contents of the copied table. I doesn’t contain the data just added. So it looks like the data is not being flushed to disk. The documentation suggests this should work, so are there some settings I need to change to make sure the data is flushed before I do the file copies. Thanks for any help Andy Ling _______________________________________________ Mailing list: https://launchpad.net/~maria-discuss<https://urldefense.proofpoint.com/v2/url?u=https-3A__launchpad.net_-7Emaria…> Post to : maria-discuss(a)lists.launchpad.net<mailto:maria-discuss@lists.launchpad.net> Unsubscribe : https://launchpad.net/~maria-discuss<https://urldefense.proofpoint.com/v2/url?u=https-3A__launchpad.net_-7Emaria…> More help : https://help.launchpad.net/ListHelp<https://urldefense.proofpoint.com/v2/url?u=https-3A__help.launchpad.net_Lis…> -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira ________________________________ DISCLAIMER: Privileged and/or Confidential information may be contained in this message. If you are not the addressee of this message, you may not copy, use or deliver this message to anyone. In such event, you should destroy the message and kindly notify the sender by reply e-mail. It is understood that opinions or conclusions that do not relate to the official business of the company are neither given nor endorsed by the company. Thank You. -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira ********************************************************************** DISCLAIMER: Privileged and/or Confidential information may be contained in this message. If you are not the addressee of this message, you may not copy, use or deliver this message to anyone. In such event, you should destroy the message and kindly notify the sender by reply e-mail. It is understood that opinions or conclusions that do not relate to the official business of the company are neither given nor endorsed by the company. Thank You.

1 0

[Maria-discuss] Problems copy database files
by Ling, Andy 06 May '20

06 May '20

Hi, I am having problems copying database files. I am using MariaDB 10.4.12 on Windows server 2019. And all the tables use the Aria engine A simple set of operations that reproduces the problem is... Add some data to a table FLUSH TABLE "table" FOR EXPORT Copy the .FRM, .MAI, .MAD files for the table to a backup folder. UNLOCK TABLES switch to the database in the backup folder and check the contents of the copied table. I doesn't contain the data just added. So it looks like the data is not being flushed to disk. The documentation suggests this should work, so are there some settings I need to change to make sure the data is flushed before I do the file copies. Thanks for any help Andy Ling

2 1

[Maria-discuss] Redisql
by Roberto Spadim 20 Apr '20

20 Apr '20

Hi folks There’s a module, redisql That allow redis server execute sqlite like queries Could be possible a engine with this tool? It’s looks very interesting to pub sub (stream) data from mysql to redis streamers https://github.com/RedBeardLab/rediSQL -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira

2 1

Re: [Maria-discuss] backup from any cluster member can't be restarted and restored
by Jeff Dyke 18 Apr '20

18 Apr '20

Thanks Justin, Sorry Karl. That was indeed a typo in the email. One thing i didn't mention is that both of these clusters were updated to 10.4.12 about a month apart. They have identical versions of mariadb(mysqld) and mariabackup on both servers. I tried it also with --extended-validation with no warnings or errors. The way its been leading, my leading two ideas are that there is some corrupted data that can't be read by mariabackup, or it gets corrupted with saving local. mariabackup and mariadb-server has been uninstalled and re-installed a couple of times. On Sat, Apr 18, 2020 at 12:45 PM Justin Swanhart <greenlion(a)gmail.com> wrote: > His point was it is it is misspelled so you aren't deleting anything which > could be a problem. > > On Sat, Apr 18, 2020, 12:25 PM Jeff Dyke <jeff.dyke(a)gmail.com> wrote: > >> Thanks Karl, that is just there so everything under mysql is deleted and >> not the directory itself as mariabackup needs the datadir clean. And i'm >> using the same "script" on both VPCs. >> >> Appreciate the read! >> >> On Sat, Apr 18, 2020 at 6:01 AM Karl Erik Levik <karl.levik(a)gmail.com> >> wrote: >> >>> Hi Jeff, >>> >>> Probably not helpful, but I dunno if this is a typo just in your email >>> or also in the script? >>> >>> > sudo rm -rf /var/lib/mysl/* >>> >>> Cheers, >>> Karl >>> >>> On Thu, 16 Apr 2020 at 00:47, Jeff Dyke <jeff.dyke(a)gmail.com> wrote: >>> >>>> This has biting me for a bit, and i have tried a litany of things. >>>> Here is the issue: >>>> VPC 1: (prod) >>>> Mariadb 10.4.12 - galera in a 3 node cluster, cluster functioning >>>> perfectly >>>> >>>> VPC 2: (staging) >>>> Mariadb 10.4.12 galera in a 3 node cluster also running smoothly. >>>> >>>> -- backup script (clipped for only the essentials) -- >>>> set -e >>>> DIR="/home/jeff/restore" >>>> rm -rf $DIR >>>> mkdir $DIR >>>> AUTH='--defaults-extra-file=/root/db.cnf -u root' >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_desync = ON;" >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_on = OFF"; >>>> sudo mariabackup ${AUTH} --backup --binlog-info=ON >>>> --target-dir="${DIR}" 2>&1 | grep -vE "Copying|done|log scanned" >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_on = ON;" >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_desync = OFF"; >>>> >>>> -- end script -- >>>> >>>> -- restore process -- >>>> sudo service mariadb stop (or kill -9 PID only when the server won't >>>> start) >>>> sudo rm -rf /var/lib/mysl/* >>>> sudo mariabackup --prepare --target-dir=restore >>>> sudo mariabackup --copy-back --target-dir=restore >>>> sudo chown -R mysql:mysql /var/lib/mysql/* >>>> sudo service mariadb start >>>> -- end restore -- >>>> >>>> I can run this on any of the script and backup process on any of the >>>> *staging* nodes and restore them to a freshly built server within that >>>> VPC. I can also take the backup from *staging* and load in into a >>>> newly build machine on the *prod* VPC. >>>> >>>> What i can not do is run the script on any of the prod members and >>>> restore it to a newly built server, regardless of location. (really the >>>> locations don't matter at all) >>>> >>>> The following is the log from a failing restore from a proddb backup >>>> and restore: >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Using Linux native AIO >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Mutexes and rw_locks use GCC >>>> atomic builtins >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Uses event mutexes >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Number of pools: 1 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Using SSE2 crc32 instructions >>>> 2020-04-15 22:11:10 0 [Note] mysqld: O_TMPFILE is not supported on /tmp >>>> (disabling future attempts) >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Initializing buffer pool, total >>>> size = 2G, instances = 8, chunk size = 128M >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Completed initialization of buffer >>>> pool >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: If the mysqld execution user is >>>> authorized, page cleaner thread priority can be changed. See the man page >>>> of setpriority(). >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Setting log file ./ib_logfile101 >>>> size to 50331648 bytes >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Setting log file ./ib_logfile1 >>>> size to 50331648 bytes >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Renaming log file ./ib_logfile101 >>>> to ./ib_logfile0 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: New log files created, >>>> LSN=42006460184 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: 128 out of 128 rollback segments >>>> are active. >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Creating shared tablespace for >>>> temporary tables >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 >>>> MB. Physically writing the file full; Please wait ... >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Waiting for purge to start >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: 10.4.12 started; log sequence >>>> number 42006460428; transaction id 23858673 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Loading buffer pool(s) from >>>> /var/lib/mysql/ib_buffer_pool >>>> 2020-04-15 22:11:10 0 [Note] Plugin 'FEEDBACK' is disabled. >>>> 2020-04-15 22:11:11 0 [Note] InnoDB: Buffer pool(s) load completed at >>>> 200415 22:11:11 >>>> -- hangs here for about an hour before timing out -- >>>> >>>> >>>> Logfile from a successful start >>>> >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Using Linux native AIO >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Mutexes and rw_locks use GCC >>>> atomic builtins >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Uses event mutexes >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Number of pools: 1 >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Using SSE2 crc32 instructions >>>> 2020-04-15 23:13:15 0 [Note] mysqld: O_TMPFILE is not supported on /tmp >>>> (disabling future attempts) >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Initializing buffer pool, total >>>> size = 2G, instances = 8, chunk size = 128M >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Completed initialization of buffer >>>> pool >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: If the mysqld execution user is >>>> authorized, page cleaner thread priority can be changed. See the man page >>>> of setpriority(). >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Setting log file ./ib_logfile101 >>>> size to 50331648 bytes >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Setting log file ./ib_logfile1 >>>> size to 50331648 bytes >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Renaming log file ./ib_logfile101 >>>> to ./ib_logfile0 >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: New log files created, >>>> LSN=43323668550 >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: 128 out of 128 rollback segments >>>> are active. >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Creating shared tablespace for >>>> temporary tables >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 >>>> MB. Physically writing the file full; Please wait ... >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Waiting for purge to start >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: 10.4.12 started; log sequence >>>> number 43323669004; transaction id 22422468 >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Loading buffer pool(s) from >>>> /var/lib/mysql/ib_buffer_pool >>>> 2020-04-15 23:13:16 0 [Note] Plugin 'FEEDBACK' is disabled. >>>> 2020-04-15 23:13:16 0 [Note] Server socket created on IP: '0.0.0.0'. >>>> 2020-04-15 23:13:16 0 [Note] Reading of all Master_info entries >>>> succeeded >>>> 2020-04-15 23:13:16 0 [Note] Added new Master_info '' to hash table >>>> 2020-04-15 23:13:16 0 [Note] /usr/sbin/mysqld: ready for connections. >>>> Version: '10.4.12-MariaDB-1:10.4.12+maria~bionic' socket: >>>> '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary >>>> distribution >>>> 2020-04-15 23:13:22 0 [Note] InnoDB: Buffer pool(s) load completed at >>>> 200415 23:13:22 >>>> >>>> ------------------------ >>>> The main difference between the two is that: >>>> - the server socket is logged >>>> - master_info is logged >>>> - and it binds to the port/socket >>>> >>>> Before they *both* end with >>>> 2020-04-15 23:13:22 0 [Note] InnoDB: Buffer pool(s) load completed at >>>> 200415 23:13:22 >>>> >>>> -- Other Notes -- >>>> - Config files are the same except for ips, both on newly built servers >>>> as the cluster as they are managed through salt. I ran a diff -r against >>>> prod vs staging and only saw >>>> >>>> There has to be some corruption in the mariabackup output, but still >>>> reported OK. Since i can put a staging backup on a prod server, but i can >>>> not put a prod backup on a staging server. >>>> >>>> If you've gotten this far, thank you. If you have any ideas on what i >>>> could try, i'd be grateful. aria_chk and all other table checks return >>>> correctly. I'm not sure what makes a server write out the master_info, so >>>> possibly that is a pointer. >>>> >>>> I'm happy to answer any questions, i've tried way to many things to >>>> post here as i didn't want to write until i had enough of dumb stuff >>>> figured out. I could rebuild the prod cluster but am really looking to >>>> understand this. I don't really want to build my own with debug info on >>>> b/c why would they be different between the two vpcs. >>>> >>>> >>>> _______________________________________________ >>>> Mailing list: https://launchpad.net/~maria-discuss >>>> Post to : maria-discuss(a)lists.launchpad.net >>>> Unsubscribe : https://launchpad.net/~maria-discuss >>>> More help : https://help.launchpad.net/ListHelp >>>> >>> _______________________________________________ >>> Mailing list: https://launchpad.net/~maria-discuss >>> Post to : maria-discuss(a)lists.launchpad.net >>> Unsubscribe : https://launchpad.net/~maria-discuss >>> More help : https://help.launchpad.net/ListHelp >>> >> _______________________________________________ >> Mailing list: https://launchpad.net/~maria-discuss >> Post to : maria-discuss(a)lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-discuss >> More help : https://help.launchpad.net/ListHelp >> >

1 0

[Maria-discuss] How to make Maxscale change master?
by Rodrigo Severo - Fábrica 17 Apr '20

17 Apr '20

Hi, How can I make Maxscale change from it's current master to another one when it's current master stops? Here Maxscale gets stuck at: 28271 2020-04-15 11:54:32 error : Monitor was unable to connect to server S1 : 'Can't connect to MySQL server on 'S1' (115)' 28272 2020-04-15 11:54:32 warning: [mariadbmon] 'S2' is a better master candidate than the current master 'S1'. Master will change when 'S1' is no longer a valid master. and nevers changes to S2. Regards, Rodrigo Severo

1 0

[Maria-discuss] Maxscale not changing to other viable masters
by Rodrigo Severo - Fábrica 15 Apr '20

15 Apr '20

Hi, I'm not sure this is the right mailing list to talk about MaxScale. Please let me know if there is a better place. My problem is that MaxScale is not using another server as MaxScale's master when the previous master get inaccessible. More details: I'm running MaxScale 2.4.5 and my MariaDB servers are a mixture of 10.3.21 and 10.3.22. I have three MariaDB servers with a star topology replication GTID based setup: each server is a slave of the other 2. Let's call them S1, S2, and S3. When starting the whole cluster MaxScale chooses S1 as it's master (the one where MaxScale will send the change data INSERT/UPDATE/DELETE) as S1 is the first one listed in MaxScale's config. When I stop S1 I expect MaxScale to choose another server as it's new master but instead I get: 28271 2020-04-15 11:54:32 error : Monitor was unable to connect to server S1 : 'Can't connect to MySQL server on 'S1' (115)' 28272 2020-04-15 11:54:32 warning: [mariadbmon] 'S2' is a better master candidate than the current master 'S1'. Master will change when 'S1' is no longer a valid master. but S2 is never promoted to MaxScale's master, even after ((monitor_interval + backend_connect_timeout) * failcount) seconds as mentioned in https://mariadb.com/kb/en/mariadb-maxscale-24-mariadb-monitor/#failcount As I have default values for monitor_interval, backend_connect_timeout and failcount - 2s, 3s, 5 retries respectively - I would expect that in 25 seconds I would have a new master selected but, unfortunately, MaxScale gets stuck in the above situation until I restart the S1 server, when S1 resumes it's hole as MaxScale's master. I wonder if my problem is related to item 2 in https://mariadb.com/kb/en/mariadb-maxscale-24-mariadb-monitor/#master-selec… which reads: 2. It has been down for more than failcount monitor passes and has no running slaves. Running slaves behind a downed relay count. Does the fact that the slaves of S1 (S2 and S3) are running make MaxScale consider S1 still valid despite not being accessible at all? More important: how can I make MaxScale change it's chosen master in a star topology replication when the current MaxScale master stops? Regards, Rodrigo Severo

1 1