- discuss - lists.mariadb.org

[Maria-discuss] New Question: mariadb 10.1.12 mysql_install_db aborts on unkown file 'test'
by AskMonty KB 11 Mar '16

11 Mar '16

Hello, A new question has been asked in "News and Information" by stuart_zurcher_g. Please answer it at http://mariadb.com/kb/en/mariadb-10112-mysql_install_db-aborts-on-unkown-fi… as the person asking the question may not be subscribed to the mailing list. -------------------------------- using Docker container with -v /data:/var/lib/mysql \\ xtrabackup-v2 (2.4) 999:docker /data \\ chown mysql:mysql /var/lib/mysql\\ Initializing\\ {{{ 2016-03-11 13:59:18 139887411787712 [Note] /usr/sbin/mysqld (mysqld 10.1.12-MariaDB-1~jessie) starting as process 54 ... 2016-03-11 13:59:18 139887411787712 [Note] WSREP: Read nil XID from storage engines, skipping position init 2016-03-11 13:59:18 139887411787712 [Note] WSREP: wsrep_load(): loading provider library 'none' 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Memory barrier is not used 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Using Linux native AIO 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Using SSE crc32 instructions 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Initializing buffer pool, size = 400.0M 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Completed initialization of buffer pool 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: The first specified data file ./ibdata1 did not exist: a new database to be created! 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Setting file ./ibdata1 size to 12 MB 2016-03-11 13:59:18 139887411787712 [Note] InnoDB: Database physically writes the file full: wait... 2016-03-11 13:59:19 139887411787712 [Note] InnoDB: Setting log file ./ib_logfile101 size to 48 MB 2016-03-11 13:59:25 139887411787712 [Note] InnoDB: Setting log file ./ib_logfile1 size to 48 MB 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 2016-03-11 13:59:27 139887411787712 [Warning] InnoDB: New log files created, LSN=45883 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Doublewrite buffer not found: creating new 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Doublewrite buffer created 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-11 13:59:27 139887411787712 [Warning] InnoDB: Creating foreign key constraint system tables. 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Foreign key constraint system tables created 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Creating tablespace and datafile system tables. 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Tablespace and datafile system tables created. 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Waiting for purge to start 2016-03-11 13:59:27 139887411787712 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 0 2016-03-11 13:59:27 139886535374592 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-11 13:59:27 139887411550976 [Warning] Failed to load slave replication state from table mysql.gtid_slave_pos: 1146: Table 'mysql.gtid_slave_pos' doesn't exist 2016-03-11 13:59:31 139640839899072 [Note] /usr/sbin/mysqld (mysqld 10.1.12-MariaDB-1~jessie) starting as process 83 ... 2016-03-11 13:59:31 139640839899072 [Note] WSREP: Read nil XID from storage engines, skipping position init 2016-03-11 13:59:31 139640839899072 [Note] WSREP: wsrep_load(): loading provider library 'none' 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Memory barrier is not used 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Using Linux native AIO 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Using SSE crc32 instructions 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Initializing buffer pool, size = 400.0M 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Completed initialization of buffer pool 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Waiting for purge to start 2016-03-11 13:59:31 139640839899072 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 1616799 2016-03-11 13:59:31 139639968990976 [Note] InnoDB: Dumping buffer pool(s) not yet started 2016-03-11 13:59:34 140650620151744 [Note] /usr/sbin/mysqld (mysqld 10.1.12-MariaDB-1~jessie) starting as process 113 ... 2016-03-11 13:59:34 140650620151744 [Note] WSREP: Read nil XID from storage engines, skipping position init 2016-03-11 13:59:34 140650620151744 [Note] WSREP: wsrep_load(): loading provider library 'none' 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Using mutexes to ref count buffer pool pages 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: The InnoDB memory heap is disabled 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Memory barrier is not used 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Compressed tables use zlib 1.2.8 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Using Linux native AIO 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Using SSE crc32 instructions 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Initializing buffer pool, size = 400.0M 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Completed initialization of buffer pool 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Highest supported file format is Barracuda. 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: 128 rollback segment(s) are active. 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Waiting for purge to start 2016-03-11 13:59:35 140650620151744 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.6.28-76.1 started; log sequence number 1616809 2016-03-11 13:59:35 140649751873280 [Note] InnoDB: Dumping buffer pool(s) not yet started ERROR: 1049 Unknown database 'test' 2016-03-11 13:59:35 140650620151744 [ERROR] Aborting }}} \\ **my.cnf** {{{ mysqld] # # * Basic Settings # skip-host-cache skip-name-resolve bind-address = 0.0.0.0 port = 3306 # basedir = /usr datadir = /var/lib/mysql tmpdir = /tmp socket =/var/run/mysqld/mysqld.sock user = mysql lc_messages_dir = /usr/share/mysql lc_messages = en_US skip-external-locking # # * Fine Tuning # max_connections = 100 connect_timeout = 5 wait_timeout = 600 max_allowed_packet = 16M thread_cache_size = 128 sort_buffer_size = 4M bulk_insert_buffer_size = 16M tmp_table_size = 32M max_heap_table_size = 32M # # * MyISAM # # This replaces the startup script and checks MyISAM tables if needed # the first time they are touched. On error, make copy and try a repair. myisam_recover_options = BACKUP key_buffer_size = 128M #open-files-limit = 2000 table_open_cache = 400 myisam_sort_buffer_size = 512M concurrent_insert = 2 read_buffer_size = 2M read_rnd_buffer_size = 1M # Error logging goes to syslog due to /etc/mysql/conf.d/mysqld_safe_syslog.cnf. # # we do want to know about network errors and such log-error =/dev/stderr log_warnings = 3 # # Enable the slow query log to see queries with especially long duration #slow_query_log[={0|1}] slow_query_log_file = /var/log/mysql/mariadb-slow.log long_query_time = 10 expire_logs_days = 10 max_binlog_size = 100M # InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/. # Read the manual for more InnoDB related options. There are many! default_storage_engine = InnoDB innodb_log_file_size = 48M innodb_log_buffer_size = 8M innodb_file_per_table = 1 innodb_buffer_pool_size = 400M innodb_open_files = 400 innodb_io_capacity = 400 innodb_flush_method = O_DIRECT innodb-doublewrite =1 innodb-autoinc-lock-mode=2 innodb-flush-log-at-trx-commit=0 innodb_data_file_path =ibdata1:12M:autoextend log-bin =ON binlog-format =ROW wsrep-provider =/usr/lib/galera/libgalera_smm.so wsrep-sst-method =xtrabackup-v2 wsrep_on =ON query-cache-size=0 query_cache_type=0 read_buffer_size=1G # following to be changed by docker-entrypoint.sh before mysql_install_db wsrep-node-address= wsrep-node-name= wsrep-cluster-name= wsrep-cluster-address= wsrep-sst-auth= wsrep-sst-donor= # xtrabackup Configuration [sst] progress=1 compressor="gzip" decompressor="gzip -dc" rebuild=ON compact=ON encrypt =0 }}} \\ mysql_install_db --user=mysql --datadir="$DATADIR" --rpm -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/mariadb-10112-mysql_install_db-aborts-on-unkown-fi…

1 0

[Maria-discuss] MariaDB replication-manager 0.6.0 release
by Guillaume Lefranc 11 Mar '16

11 Mar '16

Hi, I just released the latest version of my replication manager utility for MariaDB. It has some tremendous improvements over the last version, so if you are using it please upgrade, or check it out at https://github.com/mariadb-corporation/replication-manager Main features: - Agentless utility - Works over standard mysql protocol - Easy to deploy: single binary for all 64-bit systems - Failover - Switchover - Pre and post scripts - Seamless interaction with Maxscale, HAProxy, ProxySQL... - Interactive and non-interactive modes - Designed to work with MariaDB GTID Not supported yet by this version, but might be in the future: - Clustering - Conf file - Semi sync support - Multi-master support - Positional replication - Multiple GTID domains Regards, Guillaume

1 0

[Maria-discuss] New Question: Will MariaDB add json components like MySQL recently announced
by AskMonty KB 11 Mar '16

11 Mar '16

Hello, A new question has been asked in "What is in the Different MariaDB Releases?" by patb(a)mindkicks.com. Please answer it at http://mariadb.com/kb/en/will-mariadb-add-json-components-like-mysql-recent… as the person asking the question may not be subscribed to the mailing list. -------------------------------- MySQL has released components specifically for json. As a web developer I need to know if MariaDB will also add features for json? -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/will-mariadb-add-json-components-like-mysql-recent…

1 0

[Maria-discuss] The insert performance issue
by 林澤宇 11 Mar '16

11 Mar '16

Hi ALL , I test the MariaDB performance of insert command . I use a file include 100000 insert command statements to test the insert performanc . On local server ,the Mariadb spent about 20 second to insert data;but on remote server ,the MariaDB spent about 30 second to insert data . I execute the command " mysql -h db1 -utest -ptest -D IST < insert_file.sql" on local and remote servers . Why the MariaDB has about 10 second gap ? Maybe the network should to cause some latancy ,but the time should not have so long . What issue to cause the gap ?

7 9

Re: [Maria-discuss] The insert performance issue
by Federico Razzoli 11 Mar '16

11 Mar '16

That could be a problem if DNS is not reliable, but I never heard of a 10 seconds DNS request. I'd strongly recommend to assign more memory to the buffer pool. If InnoDB is the main storage engine you use, 1.5G should be ok. Swap is evil for a database, so you should make sure that loading a dump does not cause swapping. Federico -------------------------------------------- Gio 10/3/16, Jerry Lin <jerry08291021(a)gmail.com> ha scritto: Oggetto: Re: [Maria-discuss] The insert performance issue A: "Sergei Golubchik" <serg(a)mariadb.org> Cc: maria-discuss(a)lists.launchpad.net Data: Giovedì 10 marzo 2016, 11:20 Hi ,My MariaDB original setting has include "skip-name-resolve" . 2016-03-10 16:48 GMT+08:00 Sergei Golubchik <serg(a)mariadb.org>: Hi, 林澤宇! On Mar 10, 林澤宇 wrote: > Hi ALL , > > I test the MariaDB performance of insert command . > I use a file include 100000 insert command statements to test the insert > performanc . > On local server ,the Mariadb spent about 20 second to insert data;but on > remote server ,the MariaDB spent about 30 second to insert data . > I execute the command " mysql -h db1 -utest -ptest -D IST < > insert_file.sql" on local and remote servers . > > Why the MariaDB has about 10 second gap ? > Maybe the network should to cause some latancy ,but the time should not > have so long . > > What issue to cause the gap ? May be hostname resolution? As far as I understand the default resolver timeout is 5 seconds (man resolv.conf) - two failed name lookups gives you exactly 10 seconds. Try --skip-name-resolve on the remote mariadb server and make sure you only use IP adresses when granting privileges and when connecting to the server. Regards, Sergei Chief Architect MariaDB and security(a)mariadb.org -----Segue allegato----- _______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss(a)lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp

3 2

[Maria-discuss] New Question: Table and Column
by AskMonty KB 10 Mar '16

10 Mar '16

Hello, A new question has been asked in "MariaDB Community" by Redman Companies. Please answer it at http://mariadb.com/kb/en/table-and-column/ as the person asking the question may not be subscribed to the mailing list. -------------------------------- I have created a new table called 'B' using a table called 'A'. My question is, how do I create three new columns in table B and populate them with data from table A? Your help would be greatly appreciated. Thank you in advance. (See example below) Ex.tables--- A ------------ B columns a, a1, a2... b , b1, b2... c, c1, c2... x, y, z, a b c a1 b1 c1 a2 b2 c2 . . . a8 b8 c8 Put all of the data from a...a8 into column x line by line Put all of the data from b..b8. into column y line by line Put all of the data from c...c8 into column z line by line -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/table-and-column/

1 0

[Maria-discuss] R: The insert performance issue
by Federico Razzoli 10 Mar '16

10 Mar '16

林澤宇, there is clearly some difference between your servers. Same version? Same storage engine (InnoDB)? Same indexes? Memory is full, maybe swapping? If all these things are ok, check your settings (SHOW VARIABLES). Federico -------------------------------------------- Gio 10/3/16, 林澤宇 <jerry08291021(a)gmail.com> ha scritto: Oggetto: [Maria-discuss] The insert performance issue A: maria-discuss(a)lists.launchpad.net Data: Giovedì 10 marzo 2016, 04:52 Hi ALL , I test the MariaDB performance of insert command .I use a file include 100000 insert command statements to test the insert performanc .On local server ,the Mariadb spent about 20 second to insert data;but on remote server ,the MariaDB spent about 30 second to insert data .I execute the command " mysql -h db1 -utest -ptest -D IST < insert_file.sql" on local and remote servers . Why the MariaDB has about 10 second gap ?Maybe the network should to cause some latancy ,but the time should not have so long . What issue to cause the gap ? -----Segue allegato----- _______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss(a)lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp

2 1

[Maria-discuss] R: The insert performance issue
by Federico Razzoli 10 Mar '16

10 Mar '16

林澤宇, there is clearly some difference between your servers. Same version? Same storage engine (InnoDB)? Same indexes? Memory is full, maybe swapping? If all these things are ok, check your settings (SHOW VARIABLES). Federico -------------------------------------------- Gio 10/3/16, 林澤宇 <jerry08291021(a)gmail.com> ha scritto: Oggetto: [Maria-discuss] The insert performance issue A: maria-discuss(a)lists.launchpad.net Data: Giovedì 10 marzo 2016, 04:52 Hi ALL , I test the MariaDB performance of insert command .I use a file include 100000 insert command statements to test the insert performanc .On local server ,the Mariadb spent about 20 second to insert data;but on remote server ,the MariaDB spent about 30 second to insert data .I execute the command " mysql -h db1 -utest -ptest -D IST < insert_file.sql" on local and remote servers . Why the MariaDB has about 10 second gap ?Maybe the network should to cause some latancy ,but the time should not have so long . What issue to cause the gap ? -----Segue allegato----- _______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss(a)lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp

1 0

[Maria-discuss] Question about MariaDB global reference In high complexity app and big DB Size
by Seung Hoon Yoo 09 Mar '16

09 Mar '16

hi I am some question, i want some opinion below question We planning ERP solution convert oracle to mariaDB so erp application pattern and BIG DB SIZING IS ISSUE. Our IT background & goal 1) Apppliciation Complexity & Pattern: ERP Level complexity (high , OLTP & many batch) 2) DB SIZE : 10 TB Over (Single DB , NO sharding) 3) replication Gap issue ** My Question ** 1) Any Global reference is in MariaDB (on ERP level complexity and application pattern) 2) Any some reference in BIG DATA SIZING ? (EX: 5TB DB Exists in XX COMPARY e-commerce soluntion..) IS Only solution is DB Sharding? no big data global reference ?? 3) Replication performance : Our test result 2MB/SEC binlog written in master , so slave node get replication lag glorwing. (in row binlog format) ( 1master - 1 slave ) Any Body have experience some reference max transaction in no replication gap ? ( ex : 20MB / SEC but no replication gap our application experience..) : parellel slave thread is good performance in single domain-id and ordered method replicaiton ? ( how much better performance in parallel replication? (ex single repliation 2MB/SEC BINLOG => Replication GAP GROW but, parellel replicaiton is good in 10MB/Sec binlog write Environment) thanks a lot. regards, seung hoon yoo.

3 6

[Maria-discuss] New Question: SST smethod: rsync_wan
by AskMonty KB 09 Mar '16

09 Mar '16

Hello, A new question has been asked in "MariaDB Galera Cluster" by gijs. Please answer it at http://mariadb.com/kb/en/sst-smethod-rsync_wan/ as the person asking the question may not be subscribed to the mailing list. -------------------------------- I'm looking for an option to make my SST faster. I tried using xtrabackup-v2 but this currently doesn't support GTID clusters. I read that there is a rsync SST method that is customized for WAN usage. It makes use of delta transfers to reduce the data that has to be send over the WAN. I've tried: wsrep_sst_method=rsync-wan wsrep_sst_method=rsync_wan But neither of them work, nor can I find any official documentation about this feature for MariaDB. I did find: http://galeracluster.com/documentation-webpages/statetransfer.html http://galeracluster.com/documentation-webpages/sst.html http://galeracluster.com/documentation-webpages/mysqlwsrepoptions.html#wsre… https://blog.adminfactory.net/mariadb-and-galera-on-aws-amazon-linux.html My question is how can I enable the delta transfer for rsync with MariaDB 10.1.12? If this is not possible with MariaDB I'd like to know if there are any plans to implement it and if there are any plans to make xtrabackup-v2 support GTID clusters. -------------------------------- To view or answer this question please visit: http://mariadb.com/kb/en/sst-smethod-rsync_wan/

1 0