June 2023 - discuss - lists.mariadb.org

[Maria-discuss] Restore from mysqldump fails with "Error in foreign key constraint"
by Alex 03 Jun '23

03 Jun '23

Hi, I'm trying to use mysqlbackup to backup a mariadb-10.5.19 database on fedora37 server using the following: # mysqldump --verbose -u root -ppass --result-file=/var/backup/mysql-backup/backup-lsalex-2023-06-03-13008.sql lsalex I usually use a more involved mysqlbackup command, but it also failed, so I figured it would be better to start out more simply as above. It fails with the following when restoring to a new, test database: # mysql -u root -p lstest < /var/backup/mysql-backup/backup-lsalex-2023-06-03-13008.sql Enter password: ERROR 1005 (HY000) at line 12884: Can't create table `lsalex`.`xu6gc_tj_notification_user_exclusions` (errno: 150 "Foreign key constraint is incorrectly formed") This is a backup/restore of a Joomla database. Am I using the wrong command to perform the backup or restore? This isn't a database that I created and I really have no idea how it works. I've also searched extensively for this error, and it appears to be a programming error, not a database error, but obviously I have no control over Joomla programming. Here's what I found from "SHOW ENGINE INNODB STATUS": LATEST FOREIGN KEY ERROR ------------------------ 2023-06-03 10:09:01 0x7f3a8d8516c0 Error in foreign key constraint of table `lstest`.`xu6gc_tj_notification_user_exclusions`: Create table `lstest`.`xu6gc_tj_notification_user_exclusions` with foreign key `xu6gc_tj_notification_user_exclusions_ibfk_1` constraint failed. Field type or character set for column 'provider' does not match referenced column 'provider'.------------ Here's the lines from the backup mentioned in the error message: 12884 CREATE TABLE `xu6gc_tj_notification_user_exclusions` ( 12885 `user_id` int(11) NOT NULL, 12886 `client` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL, 12887 `key` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL, 12888 `provider` varchar(100) CHARACTER SET utf8mb4 COLLATE utf8mb4_general_ci NOT NULL, 12889 KEY `client1` (`client`,`provider`(50),`key`), 12890 KEY `key` (`key`), 12891 KEY `provider` (`provider`), 12892 CONSTRAINT `xu6gc_tj_notification_user_exclusions_ibfk_1` FOREIGN KEY (`provider`) REFERENCES `xu6gc_tj_notification_providers` (`provider`) 12893 ) ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8_general_ci; Any ideas are greatly appreciated.

1 0

Re: [Maria-discuss] Backup on the replication server getting affected
by andrei.elkin＠pp.inet.fi 02 Jun '23

02 Jun '23

Howdy Ragul, > Hi Andrei, > > Do we have any procedures to reproduce the issue MDEV-30780? Thanks for posting the gdb bt:s. They rule out 30780 yet not suggesting to me enough about the hang reason. This is something new to me and does deserve filing an MDEV ticket. Still I'd defer that until one has confirmed the same issue is seen on the latest 10.6. So you could run your load against the most recent slave version that'd be at least the safest (for our time). It might be (a slave worker) Thread 80 spinning inside #6 0x000055de407a0a3c in log_write_up_to (lsn=<optimized out>, lsn@entry=216757233923297, flush_to_disk=flush_to_disk@entry=false, rotate_key=rotate_key@entry=false, a goto repeat "loop". That hopefully you can confirm any next time the hang appears back. Could you please check whether #6 calls iteratively indeed `group_commit_lock::release()`? (With e.g (gdb) br thd_decrement_pending_ops thread 80 of course the number may change:-)). All the other slave worker threads may be waiting for the 80 but I can't confirm that until more data gets available. Namely I need to see the output of (gdb) thr app all get_about_worker_thread where the latter is defined as define get_about_worker_thread if $_any_caller_is ("handle_rpl_parallel_thread", 50) bt p handle_rpl_parallel_thread::rpt if (handle_rpl_parallel_thread::rpt->thd->rgi_slave) p handle_rpl_parallel_thread::rpt->thd->rgi_slave p handle_rpl_parallel_thread::rpt->thd->rgi_slave->current_gtid p handle_rpl_parallel_thread::rpt->thd->rgi_slave->gtid_sub_id p handle_rpl_parallel_thread::rpt->thd->rgi_slave->worker_error end end end > Unable to reproduce the issue locally but it occurs at random. to require some more patience from us. I belive we can resolve it while you're helping so generously! Cheers, Andrei > > Regards, > Ragul > > On Mon, May 29, 2023 at 7:06 PM ragul rangarajan <ragulrangarajan(a)gmail.com> wrote: > > Thanks Andrei, > > Hope my issue is more related to the issue MDEV-30780 optimistic parallel slave hangs after hit an error > Trying to reproduce with a minimal database.

1 0

[Maria-discuss] FYI:10.5.15-MariaDB crash und recover
by Radisson97＠gmx.de 01 Jun '23

01 Jun '23

Hello I had a crash today, there was no problem with the hardware. Maybe someone is interessted or find some useful information. It is a production machine so no core file. have fun. btw: Linux 5.10.0-17-amd64 #1 SMP Debian 5.10.136-1 == mariadb.log == 230601 8:22:09 [ERROR] mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.5.15-MariaDB-0+deb11u1-log key_buffer_size=134217728 read_buffer_size=131072 max_used_connections=11 max_threads=252 thread_count=11 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 685818 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x7faf440061d8 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7fafa439bd38 thread_stack 0x49000 ??:0(my_print_stacktrace)[0x55ebc2f0954e] ??:0(handle_fatal_signal)[0x55ebc2a08f65] sigaction.c:0(__restore_rt)[0x7fb11f670140] ??:0(_ma_state_info_write)[0x55ebc2bfdc73] ??:0(_ma_state_info_write)[0x55ebc2bff737] ??:0(_ma_state_info_write)[0x55ebc2c0746c] ??:0(handler::ha_write_row(unsigned char const*))[0x55ebc2a15aa8] ??:0(MyCTX_nopad::finish(unsigned char*, unsigned int*))[0x55ebc2c420da] ??:0(handler::ha_write_row(unsigned char const*))[0x55ebc2a15aa8] ??:0(write_record(THD*, TABLE*, st_copy_info*, select_result*))[0x55ebc27d587d] ??:0(mysql_insert(THD*, TABLE_LIST*, List<Item>&, List<List<Item> >&, List<Item>&, List<Item>&, enum_duplicates, bool, select_result*))[0x55ebc 27dd8a4] ??:0(mysql_execute_command(THD*))[0x55ebc2810716] ??:0(mysql_parse(THD*, char*, unsigned int, Parser_state*, bool, bool))[0x55ebc28145db] ??:0(dispatch_command(enum_server_command, THD*, char*, unsigned int, bool, bool))[0x55ebc2816a5d] ??:0(do_command(THD*))[0x55ebc28182de] ??:0(do_handle_one_connection(CONNECT*, bool))[0x55ebc2909fb2] ??:0(handle_one_connection)[0x55ebc290a22d] ??:0(MyCTX_nopad::finish(unsigned char*, unsigned int*))[0x55ebc2c4611b] nptl/pthread_create.c:478(start_thread)[0x7fb11f664ea7] x86_64/clone.S:97(__GI___clone)[0x7fb11f27bdef] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (0x7faf44014860): INSERT INTO wetter_daten VALUES ( 190600010 , '2023-06-01 06:00:00' , 0 , 0 ) Connection ID (thread ID): 5569194 Status: NOT_KILLED Optimizer switch: index_merge=on,index_merge_union=on,index_merge_sort_union=on,index_merge_intersection=on,index_merge_sort_intersection=off,e ngine_condition_pushdown=off,index_condition_pushdown=on,derived_merge=on,derived_with_keys=on,firstmatch=on,loosescan=on,materialization=on,in _to_exists=on,semijoin=on,partial_match_rowid_merge=on,partial_match_table_scan=on,subquery_cache=on,mrr=off,mrr_cost_based=off,mrr_sort_keys=o ff,outer_join_with_cache=on,semijoin_with_cache=on,join_cache_incremental=on,join_cache_hashed=on,join_cache_bka=on,optimize_join_buffer_size=o n,table_elimination=on,extended_keys=on,exists_to_in=on,orderby_uses_equalities=on,condition_pushdown_for_derived=on,split_materialized=on,cond ition_pushdown_for_subquery=on,rowid_filter=on,condition_pushdown_from_having=on,not_null_range_scan=off The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /home/kpc/kpc.dbs Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size 0 unlimited bytes Max resident set unlimited unlimited bytes Max processes 127967 127967 processes Max open files 32313 32313 files Max locked memory 65536 65536 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 127967 127967 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: core 230601 08:22:10 mysqld_safe Number of processes running now: 0 230601 08:22:10 mysqld_safe mysqld restarted 2023-06-01 8:22:11 0 [Note] /usr/sbin/mariadbd (mysqld 10.5.15-MariaDB-0+deb11u1-log) starting as process 24005 ... 2023-06-01 8:22:11 0 [Note] mariadbd: Aria engine: starting recovery recovered pages: 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% (0.1 seconds); tables to flush: 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 (0.4 seconds); 2023-06-01 8:22:11 0 [Note] mariadbd: Aria engine: recovery done 2023-06-01 8:22:11 0 [Note] InnoDB: Uses event mutexes 2023-06-01 8:22:11 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2023-06-01 8:22:11 0 [Note] InnoDB: Number of pools: 1 2023-06-01 8:22:11 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions 2023-06-01 8:22:11 0 [Note] InnoDB: Using Linux native AIO 2023-06-01 8:22:11 0 [Note] InnoDB: Initializing buffer pool, total size = 5368709120, chunk size = 134217728 2023-06-01 8:22:11 0 [Note] InnoDB: Completed initialization of buffer pool 2023-06-01 8:22:11 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=463015889782,463015889782 2023-06-01 8:22:13 0 [Note] InnoDB: Starting final batch to recover 2019 pages from redo log. 2023-06-01 8:22:15 0 [Note] InnoDB: 128 rollback segments are active. 2023-06-01 8:22:15 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1" 2023-06-01 8:22:15 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2023-06-01 8:22:15 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2023-06-01 8:22:15 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2023-06-01 8:22:15 0 [Note] InnoDB: 10.5.15 started; log sequence number 463033688604; transaction id 19549881 2023-06-01 8:22:15 0 [Note] InnoDB: Loading buffer pool(s) from /home/kpc/kpc.dbs/ib_buffer_pool 2023-06-01 8:22:15 0 [Note] Plugin 'FEEDBACK' is disabled. 2023-06-01 8:22:15 0 [Note] Server socket created on IP: '::'. 2023-06-01 8:22:16 0 [Note] Reading of all Master_info entries succeeded 2023-06-01 8:22:16 0 [Note] Added new Master_info '' to hash table 2023-06-01 8:22:16 0 [Note] /usr/sbin/mariadbd: ready for connections. Version: '10.5.15-MariaDB-0+deb11u1-log' socket: '/run/mysqld/mysqld.sock' port: 3306 Debian 11 2023-06-01 8:22:18 0 [Note] InnoDB: Buffer pool(s) load completed at 230601 8:22:18

2 1