- discuss - lists.mariadb.org

[Maria-discuss] Maybe OT: we have clients from Centos 7.8 sporadically connecting via 'strange' ipv6 address
by Thomas Plant 08 May '20

08 May '20

Hello, do not know if this is the right place to ask, we have, since updating to Centos 7.8 from 7.7, some PHP Webs which try to connect to the MySQL server with the following IPv6 as address in the addresspart of the user: 'user'@[::ffff:10.11.12.13] They get access denied as the real user is 'user'@'10.11.12.13'. Is this a PHP problem or a MySQL client setting i can set to disable this IPv6 thing? Disabling IPv6 on the interface can be done but I'd rather would not. Regards, Thomas

1 0

Re: [Maria-discuss] Problems copy database files
by Ling, Andy 07 May '20

07 May '20

I’ve been doing a bit more investigation and it looks like the FLUSH TABLES FOR EXPORT isn’t flushing to disk. I monitor the modified time of the .MAD file for a table. If I make a change to the table the modified date doesn’t change. If I do FLUSH TABLES FOR EXPORT the modified time still doesn’t change. If I do a FLUSH TABLES the modified time does change. So adding the FOR EXPORT option seems to stop the data being flushed to disk. Is this expected behaviour? It certainly isn’t how I read the documentation. Regards Andy Ling From: Ling, Andy Sent: Wed 06 May 2020 12:12 To: 'Roberto Spadim' <roberto(a)spadim.com.br> Subject: RE: [EXTERNAL] Re: Re: [Maria-discuss] Problems copy database files As I said, there is no destination server in this simple test. It is all done within the same machine and the same instance of MariaDB server. In the full system where I first noticed the problem the copied files are checked with the aria_chk command and the mysqlcheck command and apart from the “zero filling” message are OK. Still the data is missing. It looks like the FLUSH command isn’t flushing all the way to disk. Regards Andy Ling From: Roberto Spadim [mailto:roberto@spadim.com.br] Sent: Wed 06 May 2020 12:06 To: Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> Subject: [EXTERNAL] Re: Re: [Maria-discuss] Problems copy database files there's an aria journaling file too, maybe it's not being sync before you copy, but from what i remember this should work, try to flush table at destination server and open table again just to check if it's not something at destination server Em qua., 6 de mai. de 2020 às 07:59, Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> escreveu: They are the same. I’m actually doing this simple test on a single machine (and disk). So the files are just being copied from the original database folder to a backup folder on the same disk drive. Regards Andy Ling From: Roberto Spadim [mailto:roberto@spadim.com.br<mailto:roberto@spadim.com.br>] Sent: Wed 06 May 2020 11:55 To: Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> Cc: Mailing-List mariadb <maria-discuss(a)lists.launchpad.net<mailto:maria-discuss@lists.launchpad.net>> Subject: [EXTERNAL] Re: [Maria-discuss] Problems copy database files what about file size on both servers? Em qua., 6 de mai. de 2020 às 07:35, Ling, Andy <Andy.Ling(a)grassvalley.com<mailto:Andy.Ling@grassvalley.com>> escreveu: Hi, I am having problems copying database files. I am using MariaDB 10.4.12 on Windows server 2019. And all the tables use the Aria engine A simple set of operations that reproduces the problem is… Add some data to a table FLUSH TABLE “table” FOR EXPORT Copy the .FRM, .MAI, .MAD files for the table to a backup folder. UNLOCK TABLES switch to the database in the backup folder and check the contents of the copied table. I doesn’t contain the data just added. So it looks like the data is not being flushed to disk. The documentation suggests this should work, so are there some settings I need to change to make sure the data is flushed before I do the file copies. Thanks for any help Andy Ling _______________________________________________ Mailing list: https://launchpad.net/~maria-discuss<https://urldefense.proofpoint.com/v2/url?u=https-3A__launchpad.net_-7Emaria…> Post to : maria-discuss(a)lists.launchpad.net<mailto:maria-discuss@lists.launchpad.net> Unsubscribe : https://launchpad.net/~maria-discuss<https://urldefense.proofpoint.com/v2/url?u=https-3A__launchpad.net_-7Emaria…> More help : https://help.launchpad.net/ListHelp<https://urldefense.proofpoint.com/v2/url?u=https-3A__help.launchpad.net_Lis…> -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira ________________________________ DISCLAIMER: Privileged and/or Confidential information may be contained in this message. If you are not the addressee of this message, you may not copy, use or deliver this message to anyone. In such event, you should destroy the message and kindly notify the sender by reply e-mail. It is understood that opinions or conclusions that do not relate to the official business of the company are neither given nor endorsed by the company. Thank You. -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira ********************************************************************** DISCLAIMER: Privileged and/or Confidential information may be contained in this message. If you are not the addressee of this message, you may not copy, use or deliver this message to anyone. In such event, you should destroy the message and kindly notify the sender by reply e-mail. It is understood that opinions or conclusions that do not relate to the official business of the company are neither given nor endorsed by the company. Thank You.

1 0

[Maria-discuss] Problems copy database files
by Ling, Andy 06 May '20

06 May '20

Hi, I am having problems copying database files. I am using MariaDB 10.4.12 on Windows server 2019. And all the tables use the Aria engine A simple set of operations that reproduces the problem is... Add some data to a table FLUSH TABLE "table" FOR EXPORT Copy the .FRM, .MAI, .MAD files for the table to a backup folder. UNLOCK TABLES switch to the database in the backup folder and check the contents of the copied table. I doesn't contain the data just added. So it looks like the data is not being flushed to disk. The documentation suggests this should work, so are there some settings I need to change to make sure the data is flushed before I do the file copies. Thanks for any help Andy Ling

2 1

[Maria-discuss] Redisql
by Roberto Spadim 20 Apr '20

20 Apr '20

Hi folks There’s a module, redisql That allow redis server execute sqlite like queries Could be possible a engine with this tool? It’s looks very interesting to pub sub (stream) data from mysql to redis streamers https://github.com/RedBeardLab/rediSQL -- Roberto Spadim SPAEmpresarial - Software ERP/Scada Eng. Automação e Controle, Eng. Financeira

2 1

Re: [Maria-discuss] backup from any cluster member can't be restarted and restored
by Jeff Dyke 18 Apr '20

18 Apr '20

Thanks Justin, Sorry Karl. That was indeed a typo in the email. One thing i didn't mention is that both of these clusters were updated to 10.4.12 about a month apart. They have identical versions of mariadb(mysqld) and mariabackup on both servers. I tried it also with --extended-validation with no warnings or errors. The way its been leading, my leading two ideas are that there is some corrupted data that can't be read by mariabackup, or it gets corrupted with saving local. mariabackup and mariadb-server has been uninstalled and re-installed a couple of times. On Sat, Apr 18, 2020 at 12:45 PM Justin Swanhart <greenlion(a)gmail.com> wrote: > His point was it is it is misspelled so you aren't deleting anything which > could be a problem. > > On Sat, Apr 18, 2020, 12:25 PM Jeff Dyke <jeff.dyke(a)gmail.com> wrote: > >> Thanks Karl, that is just there so everything under mysql is deleted and >> not the directory itself as mariabackup needs the datadir clean. And i'm >> using the same "script" on both VPCs. >> >> Appreciate the read! >> >> On Sat, Apr 18, 2020 at 6:01 AM Karl Erik Levik <karl.levik(a)gmail.com> >> wrote: >> >>> Hi Jeff, >>> >>> Probably not helpful, but I dunno if this is a typo just in your email >>> or also in the script? >>> >>> > sudo rm -rf /var/lib/mysl/* >>> >>> Cheers, >>> Karl >>> >>> On Thu, 16 Apr 2020 at 00:47, Jeff Dyke <jeff.dyke(a)gmail.com> wrote: >>> >>>> This has biting me for a bit, and i have tried a litany of things. >>>> Here is the issue: >>>> VPC 1: (prod) >>>> Mariadb 10.4.12 - galera in a 3 node cluster, cluster functioning >>>> perfectly >>>> >>>> VPC 2: (staging) >>>> Mariadb 10.4.12 galera in a 3 node cluster also running smoothly. >>>> >>>> -- backup script (clipped for only the essentials) -- >>>> set -e >>>> DIR="/home/jeff/restore" >>>> rm -rf $DIR >>>> mkdir $DIR >>>> AUTH='--defaults-extra-file=/root/db.cnf -u root' >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_desync = ON;" >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_on = OFF"; >>>> sudo mariabackup ${AUTH} --backup --binlog-info=ON >>>> --target-dir="${DIR}" 2>&1 | grep -vE "Copying|done|log scanned" >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_on = ON;" >>>> sudo mysql ${AUTH} -e "SET GLOBAL wsrep_desync = OFF"; >>>> >>>> -- end script -- >>>> >>>> -- restore process -- >>>> sudo service mariadb stop (or kill -9 PID only when the server won't >>>> start) >>>> sudo rm -rf /var/lib/mysl/* >>>> sudo mariabackup --prepare --target-dir=restore >>>> sudo mariabackup --copy-back --target-dir=restore >>>> sudo chown -R mysql:mysql /var/lib/mysql/* >>>> sudo service mariadb start >>>> -- end restore -- >>>> >>>> I can run this on any of the script and backup process on any of the >>>> *staging* nodes and restore them to a freshly built server within that >>>> VPC. I can also take the backup from *staging* and load in into a >>>> newly build machine on the *prod* VPC. >>>> >>>> What i can not do is run the script on any of the prod members and >>>> restore it to a newly built server, regardless of location. (really the >>>> locations don't matter at all) >>>> >>>> The following is the log from a failing restore from a proddb backup >>>> and restore: >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Using Linux native AIO >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Mutexes and rw_locks use GCC >>>> atomic builtins >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Uses event mutexes >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Number of pools: 1 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Using SSE2 crc32 instructions >>>> 2020-04-15 22:11:10 0 [Note] mysqld: O_TMPFILE is not supported on /tmp >>>> (disabling future attempts) >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Initializing buffer pool, total >>>> size = 2G, instances = 8, chunk size = 128M >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Completed initialization of buffer >>>> pool >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: If the mysqld execution user is >>>> authorized, page cleaner thread priority can be changed. See the man page >>>> of setpriority(). >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Setting log file ./ib_logfile101 >>>> size to 50331648 bytes >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Setting log file ./ib_logfile1 >>>> size to 50331648 bytes >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Renaming log file ./ib_logfile101 >>>> to ./ib_logfile0 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: New log files created, >>>> LSN=42006460184 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: 128 out of 128 rollback segments >>>> are active. >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Creating shared tablespace for >>>> temporary tables >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 >>>> MB. Physically writing the file full; Please wait ... >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Waiting for purge to start >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: 10.4.12 started; log sequence >>>> number 42006460428; transaction id 23858673 >>>> 2020-04-15 22:11:10 0 [Note] InnoDB: Loading buffer pool(s) from >>>> /var/lib/mysql/ib_buffer_pool >>>> 2020-04-15 22:11:10 0 [Note] Plugin 'FEEDBACK' is disabled. >>>> 2020-04-15 22:11:11 0 [Note] InnoDB: Buffer pool(s) load completed at >>>> 200415 22:11:11 >>>> -- hangs here for about an hour before timing out -- >>>> >>>> >>>> Logfile from a successful start >>>> >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Using Linux native AIO >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Mutexes and rw_locks use GCC >>>> atomic builtins >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Uses event mutexes >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Number of pools: 1 >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Using SSE2 crc32 instructions >>>> 2020-04-15 23:13:15 0 [Note] mysqld: O_TMPFILE is not supported on /tmp >>>> (disabling future attempts) >>>> 2020-04-15 23:13:15 0 [Note] InnoDB: Initializing buffer pool, total >>>> size = 2G, instances = 8, chunk size = 128M >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Completed initialization of buffer >>>> pool >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: If the mysqld execution user is >>>> authorized, page cleaner thread priority can be changed. See the man page >>>> of setpriority(). >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Setting log file ./ib_logfile101 >>>> size to 50331648 bytes >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Setting log file ./ib_logfile1 >>>> size to 50331648 bytes >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Renaming log file ./ib_logfile101 >>>> to ./ib_logfile0 >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: New log files created, >>>> LSN=43323668550 >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: 128 out of 128 rollback segments >>>> are active. >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Creating shared tablespace for >>>> temporary tables >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 >>>> MB. Physically writing the file full; Please wait ... >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Waiting for purge to start >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: 10.4.12 started; log sequence >>>> number 43323669004; transaction id 22422468 >>>> 2020-04-15 23:13:16 0 [Note] InnoDB: Loading buffer pool(s) from >>>> /var/lib/mysql/ib_buffer_pool >>>> 2020-04-15 23:13:16 0 [Note] Plugin 'FEEDBACK' is disabled. >>>> 2020-04-15 23:13:16 0 [Note] Server socket created on IP: '0.0.0.0'. >>>> 2020-04-15 23:13:16 0 [Note] Reading of all Master_info entries >>>> succeeded >>>> 2020-04-15 23:13:16 0 [Note] Added new Master_info '' to hash table >>>> 2020-04-15 23:13:16 0 [Note] /usr/sbin/mysqld: ready for connections. >>>> Version: '10.4.12-MariaDB-1:10.4.12+maria~bionic' socket: >>>> '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary >>>> distribution >>>> 2020-04-15 23:13:22 0 [Note] InnoDB: Buffer pool(s) load completed at >>>> 200415 23:13:22 >>>> >>>> ------------------------ >>>> The main difference between the two is that: >>>> - the server socket is logged >>>> - master_info is logged >>>> - and it binds to the port/socket >>>> >>>> Before they *both* end with >>>> 2020-04-15 23:13:22 0 [Note] InnoDB: Buffer pool(s) load completed at >>>> 200415 23:13:22 >>>> >>>> -- Other Notes -- >>>> - Config files are the same except for ips, both on newly built servers >>>> as the cluster as they are managed through salt. I ran a diff -r against >>>> prod vs staging and only saw >>>> >>>> There has to be some corruption in the mariabackup output, but still >>>> reported OK. Since i can put a staging backup on a prod server, but i can >>>> not put a prod backup on a staging server. >>>> >>>> If you've gotten this far, thank you. If you have any ideas on what i >>>> could try, i'd be grateful. aria_chk and all other table checks return >>>> correctly. I'm not sure what makes a server write out the master_info, so >>>> possibly that is a pointer. >>>> >>>> I'm happy to answer any questions, i've tried way to many things to >>>> post here as i didn't want to write until i had enough of dumb stuff >>>> figured out. I could rebuild the prod cluster but am really looking to >>>> understand this. I don't really want to build my own with debug info on >>>> b/c why would they be different between the two vpcs. >>>> >>>> >>>> _______________________________________________ >>>> Mailing list: https://launchpad.net/~maria-discuss >>>> Post to : maria-discuss(a)lists.launchpad.net >>>> Unsubscribe : https://launchpad.net/~maria-discuss >>>> More help : https://help.launchpad.net/ListHelp >>>> >>> _______________________________________________ >>> Mailing list: https://launchpad.net/~maria-discuss >>> Post to : maria-discuss(a)lists.launchpad.net >>> Unsubscribe : https://launchpad.net/~maria-discuss >>> More help : https://help.launchpad.net/ListHelp >>> >> _______________________________________________ >> Mailing list: https://launchpad.net/~maria-discuss >> Post to : maria-discuss(a)lists.launchpad.net >> Unsubscribe : https://launchpad.net/~maria-discuss >> More help : https://help.launchpad.net/ListHelp >> >

1 0

[Maria-discuss] How to make Maxscale change master?
by Rodrigo Severo - Fábrica 17 Apr '20

17 Apr '20

Hi, How can I make Maxscale change from it's current master to another one when it's current master stops? Here Maxscale gets stuck at: 28271 2020-04-15 11:54:32 error : Monitor was unable to connect to server S1 : 'Can't connect to MySQL server on 'S1' (115)' 28272 2020-04-15 11:54:32 warning: [mariadbmon] 'S2' is a better master candidate than the current master 'S1'. Master will change when 'S1' is no longer a valid master. and nevers changes to S2. Regards, Rodrigo Severo

1 0

[Maria-discuss] Maxscale not changing to other viable masters
by Rodrigo Severo - Fábrica 15 Apr '20

15 Apr '20

Hi, I'm not sure this is the right mailing list to talk about MaxScale. Please let me know if there is a better place. My problem is that MaxScale is not using another server as MaxScale's master when the previous master get inaccessible. More details: I'm running MaxScale 2.4.5 and my MariaDB servers are a mixture of 10.3.21 and 10.3.22. I have three MariaDB servers with a star topology replication GTID based setup: each server is a slave of the other 2. Let's call them S1, S2, and S3. When starting the whole cluster MaxScale chooses S1 as it's master (the one where MaxScale will send the change data INSERT/UPDATE/DELETE) as S1 is the first one listed in MaxScale's config. When I stop S1 I expect MaxScale to choose another server as it's new master but instead I get: 28271 2020-04-15 11:54:32 error : Monitor was unable to connect to server S1 : 'Can't connect to MySQL server on 'S1' (115)' 28272 2020-04-15 11:54:32 warning: [mariadbmon] 'S2' is a better master candidate than the current master 'S1'. Master will change when 'S1' is no longer a valid master. but S2 is never promoted to MaxScale's master, even after ((monitor_interval + backend_connect_timeout) * failcount) seconds as mentioned in https://mariadb.com/kb/en/mariadb-maxscale-24-mariadb-monitor/#failcount As I have default values for monitor_interval, backend_connect_timeout and failcount - 2s, 3s, 5 retries respectively - I would expect that in 25 seconds I would have a new master selected but, unfortunately, MaxScale gets stuck in the above situation until I restart the S1 server, when S1 resumes it's hole as MaxScale's master. I wonder if my problem is related to item 2 in https://mariadb.com/kb/en/mariadb-maxscale-24-mariadb-monitor/#master-selec… which reads: 2. It has been down for more than failcount monitor passes and has no running slaves. Running slaves behind a downed relay count. Does the fact that the slaves of S1 (S2 and S3) are running make MaxScale consider S1 still valid despite not being accessible at all? More important: how can I make MaxScale change it's chosen master in a star topology replication when the current MaxScale master stops? Regards, Rodrigo Severo

1 1

[Maria-discuss] Some records come out after some time
by Armando B. 13 Apr '20

13 Apr '20

Hi all, i have a MariaDB Server (*10.1.35*) with an InnoDB and a table with an Autoincrement ID field and some other data (no foreign keys but only index). This table have few records (~10000) that are increased with a csv import each some weeks. I saw that sometimes, after import process, some records are hidden and come out after some time (also 40 min.) could you help me ? Armando -- Themonospot http://github.com/armando-basile/themonospot/ Monosim http://github.com/armando-basile/monosim/ Comex-Project http://github.com/armando-basile/comex-project/ ViviVasto app https://play.google.com/store/apps/details?id=com.armandobasile.vivivasto vdr-getchannels - https://github.com/armando-basile/vdr-getchannels vdr-scripts - https://github.com/armando-basile/vdr-scripts

2 4

[Maria-discuss] transactional sql update patch system ?
by launchpad＠rupat.de 28 Feb '20

28 Feb '20

Hello, we want, that a sql patch file can ONLY be applied if all commands in it can applied successful ! so our first try was: START TRANSACTION; statement1 statement2 statement3 statement4 .... COMMIT; problem: this is not working because an statement can also create table, which is an ddl command and which do an commit ! (https://mariadb.com/kb/en/start-transaction/#autocommit) .... DDL statements (CREATE, ALTER, DROP) and administrative statements (FLUSH, RESET, OPTIMIZE, ANALYZE, CHECK, REPAIR, CACHE INDEX), and LOAD DATA INFILE, cause an implicit COMMIT and start a new transaction. the result is that all before an failing create table statement will be applied ! so this is no solution. so how can i garantee that only whole files can be applied ?! Here is an sample: CREATE TABLE test (number int); START TRANSACTION; INSERT INTO test (number) VALUES (1); COMMIT; START TRANSACTION; INSERT INTO test (number) VALUES (2); COMMIT; START TRANSACTION; INSERT INTO test (number) VALUES (3); CREATE TABLE test (thiswillfail int); COMMIT; And the logs from mariadb: 8 Connect root@localhost as anonymous on arcus 8 Query CREATE TABLE test (number int) 8 Query START TRANSACTION 8 Query INSERT INTO test (number) VALUES (1) 8 Query COMMIT 8 Query START TRANSACTION 8 Query INSERT INTO test (number) VALUES (2) 8 Query COMMIT 8 Query START TRANSACTION 8 Query INSERT INTO test (number) VALUES (3) 8 Query CREATE TABLE test (thiswillfail int) 8 Quit And with another connection the table test SELECT * FROM test; 1 2 3 So we can see value 3 were persistet although there was no COMMIT !!!! because of autocommit when do an create table. But i want that nothing is applied from my sql file when something fail ! Greetings Robert

3 3

[Maria-discuss] Re-configuring BIND DNS Servers for CentOS Web Panel Web Hosting Control Panel on Amazon AWS Cloud
by Turritopsis Dohrnii Teo En Ming 27 Feb '20

27 Feb '20

Subject: Re-configuring BIND DNS Servers for CentOS Web Panel Web Hosting Control Panel on Amazon AWS Cloud Author: Mr. Turritopsis Dohrnii Teo En Ming, Singapore Date: 27 Feb 2020 Thursday Rationale for Re-configuration of BIND DNS Servers for CentOS Web Panel ======================================================================= I have originally followed the approach for cPanel where there are 2 DNS-ONLY servers and one or more cPanel webservers. However, CentOS Web Panel implements DNS Clusters differently. Hence I have to re-configure BIND DNS Servers for CentOS Web Panel web hosting control panel. PREREQUISITES ============= Part 1 of the series: Mr. Teo En Ming's Guide to Deploying CentOS Web Panel (CWP) Web Hosting Control Panel on Amazon AWS Cloud Redundant Blogger and Wordpress blog links: [1] https://tdtemcerts.blogspot.com/2020/02/mr-teo-en-mings-guide-to-deploying.… [2] https://tdtemcerts.wordpress.com/2020/02/23/mr-teo-en-mings-guide-to-deploy… Part 2 of the series: Setting Up Mail Server Operation for CentOS Web Panel Web Hosting Control Panel on Amazon AWS Cloud Redundant Blogger and Wordpress blog links: [1] https://tdtemcerts.blogspot.com/2020/02/setting-up-mail-server-operation-fo… [2] https://tdtemcerts.wordpress.com/2020/02/25/setting-up-mail-server-operatio… THIS guide is Part 3 of the series. EXTREMELY DETAILED INSTRUCTIONS OF TEO EN MING'S GUIDE ====================================================== Login to Amazon AWS Console. Setting Up Secondary/Slave DNS Server ===================================== On the EC2 Dashboard, click Instances. Click Launch Instance. Search for centos in the AWS Markpetplace. Select CentOS 7 (x86_64) - with Updates HVM (free tier eligible). Click Continue. Select t2.micro (free tier eligible). Click Next: Configure Instance Details. Network: Teo En Ming VPC Subnet: Public subnet | us-east-2a Click Protect against accidental termination. Click Next: Add Storage Size (GiB): 8 Click Next: Add Tags Key = Name Value = slave Click Next: Configure Security Group Click Select an existing security group Select NameServers Click Review and Launch. Click Launch. Select Choose an existing key pair. Key pair name: cwp Click Launch Instances. Click Instances. Select slave, right click and select Networking > Manage IP Addresses. Click Allocate an elastic IP to this instance. Click Allocate. Click Associate this Elastic IP Address. Instance: slave Click Associate. IPv4 address of Secondary/Slave DNS server is 3.12.224.179 $ ssh -i cwp.pem centos(a)3.12.224.179 $ sudo passwd $ su - # yum -y update && yum -y install wget # hostnamectl set-hostname ns2.teo-en-ming.com # cd /usr/local/src && wget http://centos-webpanel.com/cwp-el7-latest && sh cwp-el7-latest Started installing CentOS Web Panel at 9:00 PM on 26 Feb 2020 Wed. Completed installing CentOS Web Panel at 9:05 PM on 26 Feb 2020 Wed. Total duration: 5 mins. ############################# # CWP Installed # ############################# Go to CentOS WebPanel Admin GUI at http://SERVER_IP:2030/ http://3.12.224.179:2030 SSL: https://3.12.224.179:2031 --------------------- Username: root Password: ssh server root password MySQL root Password: ######################################################### CentOS Web Panel MailServer Installer ######################################################### SSL Cert name (hostname): ns2.teo-en-ming.com SSL Cert file location /etc/pki/tls/ private|certs ######################################################### Visit for help: www.centos-webpanel.com Write down login details and press ENTER for server reboot! Please reboot the server! Reboot command: shutdown -r now # reboot REFERENCE ========= Guide: Slave DNS Server & Manager - DNS Cluster Link: https://wiki.centos-webpanel.com/slave-dns-server-manager-dns-cluster REFERENCE ========= Guide: Slave DNS Server & Manager download version Link: https://wiki.centos-webpanel.com/slave-dns-server-manager-download-version Login to the CentOS Web Panel Admin Panel on the Slave. >From the left menu, click on CWP Settings, then select Edit Settings. Admin Email: ceo(a)teo-en-ming-corp.com Check Activate NAT-ed network configuration. Click Save Changes. Create a New Account on the Secondary/Slave DNS Server ====================================================== >From the left menu, click User Accounts, then click New Account. Domain name: teo-en-ming.com Username: slave Package: default Click Create. Download Slave DNS Manager and upload it to public_html folder on the Secondary/Slave DNS Server ================================================================================================ ssh -i cwp.pem centos(a)3.12.224.179 su - cd /home/slave/public_html wget http://dl1.centos-webpanel.com/files/cwp/addons/cwp-slave_dns.zip unzip cwp-slave_dns.zip mv slave_dns/* . rm -f index.html Fix file permissions on the Slave DNS Server ============================================ chown -R slave.slave /home/slave/public_html/* MySQL: Create User and Database on the Slave DNS Server ======================================================= >From the left menu, click SQL Services, then click MySQL Manager. Click Create Database and User. New Database for user: slave Database Name: slave Click Create Database. Edit file /home/slave/public_html/inc/db_conn.php.sample and enter your database connection details # nano /home/slave/public_html/inc/db_conn.php.sample # mv inc/db_conn.php.sample inc/db_conn.php # mysql slave_slave < sql/slave_dns.sql # nano /etc/sudoers.d/slave slave ALL= NOPASSWD: /bin/systemctl start named slave ALL= NOPASSWD: /bin/systemctl stop named slave ALL= NOPASSWD: /bin/systemctl restart named slave ALL= NOPASSWD: /bin/systemctl reload named slave ALL= NOPASSWD: /bin/systemctl status named slave ALL= NOPASSWD: /bin/systemctl is-active named # touch /etc/named/slave.conf # chmod 771 /etc/named # usermod -a -G named slave # chown slave.named /etc/named/slave.conf # mkdir /var/named/slave # chown named.named /var/named/slave Edit File: /etc/named.conf and add this in options section before closing } masterfile-format text; Add after options{} where other include lines are specifed //Slave dns configuration include "/etc/named/slave.conf"; Now you can login to Slave DNS Manager GUI by using a domain link of the account you have created. Go to http://3.12.224.179/~slave/index.php?login Default login for Slave DNS Manager GUI admin/root Username: root Password: FX8QKxvQ * Please change the default password after the first login Adding WebServers to Slave DNS Manager ====================================== - On Slave DNS manager GUI create a new user for each server or use a single for all webservers if you plan to transfer accounts from one to another webserver. Click Add New User. Username: Password: Email: API Key: API Secret: Domain Limit: 1000000 Click Save. - On Master CentOS Web Panel WebServer go to DNS Functions -> Slave DNS Manager Buy CWPPro license first. It is only USD$1.49 compared to USD$20 for the license of cPanel. I can't afford to buy the license for cPanel, hence I have to settle for CentOS Web Panel. Then ssh into your Master CentOS Web Panel Webserver. # sh /scripts/update_cwp You have successfully upgraded to CWPpro. On the Master CentOS Web Panel, Go to DNS Functions -> Slave DNS Manager API Key: Secret Key: Base URL: http://3.12.224.179/~slave Master Server IP's: 3.21.30.127 Click Submit. Master CentOS Web Panel WebServer configuration =============================================== Edit File: /etc/named.conf and add this in options section before closing } //Slave dns configuration allow-transfer {3.12.224.179;}; allow-recursion {3.12.224.179;}; also-notify {3.12.224.179;}; masterfile-format text; # named-checkconf # systemctl restart named REFERENCE ========= Guide: How to setup DNS cluster on CWP 1 – Install DNS Manager Link: https://opentechy.com/how-to-setup-dns-cluster-on-cwp/ REFERENCE ========= Guide: How to setup DNS cluster on CWP 2 – Add webservers to DNS cluster Link: https://opentechy.com/how-to-setup-dns-cluster-on-cwp-2-add-webservers-to-d… CONFIGURING CUSTOM NAME SERVERS AT YOUR DOMAIN REGISTRAR ======================================================== Go to Advanced Features > Hostnames Host: ns1 IP Addresses: 3.21.30.127 Host: ns2 IP Addresses: 3.12.224.179 Nameservers: Using custom nameservers ns1.teo-en-ming.com ns2.teo-en-ming.com CONFIGURING NAME SERVERS ON THE MASTER CENTOS WEB PANEL WEBSERVER ================================================================== >From the left menu, click DNS Functions, then click Edit Nameservers IPs. Name Server 1: ns1.teo-en-ming.com 3.21.30.127 Name Server 2: ns2.teo-en-ming.com 3.12.224.179 Click Save changes. # systemctl restart named BIND DNS CONFIGURATION ON THE MASTER CENTOS WEB PANEL WEBSERVER =============================================================== File /etc/named.conf: // // named.conf // // Provided by Red Hat bind package to configure the ISC BIND named(8) DNS // server as a caching only nameserver (as a any DNS resolver only). // // See /usr/share/doc/bind*/sample/ for example named configuration files. // // See the BIND Administrator's Reference Manual (ARM) for details about the // configuration located in /usr/share/doc/bind-{version}/Bv9ARM.html options { listen-on port 53 { any; }; listen-on-v6 port 53 { ::1; }; directory "/var/named"; dump-file "/var/named/data/cache_dump.db"; statistics-file "/var/named/data/named_stats.txt"; memstatistics-file "/var/named/data/named_mem_stats.txt"; recursing-file "/var/named/data/named.recursing"; secroots-file "/var/named/data/named.secroots"; allow-query { any; }; /* - If you are building an AUTHORITATIVE DNS server, do NOT enable recursion. - If you are building a RECURSIVE (caching) DNS server, you need to enable recursion. - If your recursive DNS server has a public IP address, you MUST enable access control to limit queries to your legitimate users. Failing to do so will cause your server to become part of large scale DNS amplification attacks. Implementing BCP38 within your network would greatly reduce such attack surface */ // recursion no; dnssec-enable yes; dnssec-validation yes; /* Path to ISC DLV key */ bindkeys-file "/etc/named.root.key"; managed-keys-directory "/var/named/dynamic"; pid-file "/run/named/named.pid"; session-keyfile "/run/named/session.key"; //Slave dns configuration allow-transfer {3.12.224.179;}; allow-recursion {3.12.224.179;}; also-notify {3.12.224.179;}; masterfile-format text; }; logging { channel default_debug { file "data/named.run"; severity dynamic; }; }; zone "." IN { type hint; file "named.ca"; }; include "/etc/named.rfc1912.zones"; include "/etc/named.root.key"; zone "ns1.teo-en-ming.com" {type master;file "/var/named/ns1.teo-en-ming.com.db";}; zone "ns2.teo-en-ming.com" {type master;file "/var/named/ns2.teo-en-ming.com.db";}; // zone teo-en-ming.com zone "teo-en-ming.com" {type master; file "/var/named/teo-en-ming.com.db";}; // zone_end teo-en-ming.com File /var/named/ns1.teo-en-ming.com.db: ; Panel %version% ; Zone file for ns1.teo-en-ming.com $TTL 14400 ns1.teo-en-ming.com. 86400 IN SOA ns1.teo-en-ming.com. info.centos-webpanel.com. ( 2013071600 ;serial, todays date+todays 86400 ;refresh, seconds 7200 ;retry, seconds 3600000 ;expire, seconds 86400 ;minimum, seconds ) ns1.teo-en-ming.com. 86400 IN NS ns1.teo-en-ming.com. ns1.teo-en-ming.com. 86400 IN NS ns2.teo-en-ming.com. ns1.teo-en-ming.com. 14400 IN A 3.21.30.127 File /var/named/ns2.teo-en-ming.com.db: ; Panel %version% ; Zone file for ns2.teo-en-ming.com $TTL 14400 ns2.teo-en-ming.com. 86400 IN SOA ns1.teo-en-ming.com. info.centos-webpanel.com. ( 2013071600 ;serial, todays date+todays 86400 ;refresh, seconds 7200 ;retry, seconds 3600000 ;expire, seconds 86400 ;minimum, seconds ) ns2.teo-en-ming.com. 86400 IN NS ns1.teo-en-ming.com. ns2.teo-en-ming.com. 86400 IN NS ns2.teo-en-ming.com. ns2.teo-en-ming.com. 14400 IN A 3.12.224.179 File /var/named/teo-en-ming.com.db: ; Generated by CWP ; Zone file for teo-en-ming.com $TTL 14400 @ 86400 IN SOA ns1.teo-en-ming.com. ceo.teo-en-ming-corp.com. ( 2020022453 ; serial, todays date+todays 3600 ; refresh, seconds 7200 ; retry, seconds 1209600 ; expire, seconds 86400 ) ; minimum, seconds @ 86400 IN NS ns1.teo-en-ming.com. @ 86400 IN NS ns2.teo-en-ming.com. @ IN A 3.21.30.127 localhost.teo-en-ming.com. IN A 127.0.0.1 @ IN MX 0 teo-en-ming.com. mail 14400 IN CNAME teo-en-ming.com. smtp 14400 IN CNAME teo-en-ming.com. pop 14400 IN CNAME teo-en-ming.com. pop3 14400 IN CNAME teo-en-ming.com. imap 14400 IN CNAME teo-en-ming.com. webmail 14400 IN A 3.21.30.127 cpanel 14400 IN A 3.21.30.127 cwp 14400 IN A 3.21.30.127 www 14400 IN CNAME teo-en-ming.com. ftp 14400 IN CNAME teo-en-ming.com. _dmarc 14400 IN TXT "v=DMARC1; p=none" @ 14400 IN TXT "v=spf1 +a +mx +ip4:3.21.30.127 ~all" ns1.teo-en-ming.com. 14400 IN A 3.21.30.127 ns2.teo-en-ming.com. 14400 IN A 3.12.224.179 default._domainkey 14400 IN TXT "v=DKIM1; k=rsa; p=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQDEXk5wQIfKJPjTkkj0yHGX8yIJOOrsOsvAqbqVaEBFBWhRlF7YxyGzchaAdWEVQkozcsWPIL5DgJ7vWBoJIGqfNOT7vO/lStqNcXC+2hYVIF7MTB8i6tBW1/UDEuL8oammKWDq8P9Fpduk6JppV7rtKXeFzrYj35ydIhDIKUABcwIDAQAB" BIND DNS CONFIGURATION ON THE SLAVE DNS MANAGER =============================================== File /etc/named.conf: // // named.conf // // Provided by Red Hat bind package to configure the ISC BIND named(8) DNS // server as a caching only nameserver (as a any DNS resolver only). // // See /usr/share/doc/bind*/sample/ for example named configuration files. // // See the BIND Administrator's Reference Manual (ARM) for details about the // configuration located in /usr/share/doc/bind-{version}/Bv9ARM.html options { listen-on port 53 { any; }; listen-on-v6 port 53 { ::1; }; directory "/var/named"; dump-file "/var/named/data/cache_dump.db"; statistics-file "/var/named/data/named_stats.txt"; memstatistics-file "/var/named/data/named_mem_stats.txt"; recursing-file "/var/named/data/named.recursing"; secroots-file "/var/named/data/named.secroots"; allow-query { any; }; /* - If you are building an AUTHORITATIVE DNS server, do NOT enable recursion. - If you are building a RECURSIVE (caching) DNS server, you need to enable recursion. - If your recursive DNS server has a public IP address, you MUST enable access control to limit queries to your legitimate users. Failing to do so will cause your server to become part of large scale DNS amplification attacks. Implementing BCP38 within your network would greatly reduce such attack surface */ recursion no; dnssec-enable yes; dnssec-validation yes; /* Path to ISC DLV key */ bindkeys-file "/etc/named.root.key"; managed-keys-directory "/var/named/dynamic"; pid-file "/run/named/named.pid"; session-keyfile "/run/named/session.key"; masterfile-format text; }; logging { channel default_debug { file "data/named.run"; severity dynamic; }; }; zone "." IN { type hint; file "named.ca"; }; include "/etc/named.rfc1912.zones"; include "/etc/named.root.key"; // zone teo-en-ming.com // zone "teo-en-ming.com" {type master; file "/var/named/teo-en-ming.com.db";}; // zone_end teo-en-ming.com //Slave dns configuration include "/etc/named/slave.conf"; File /var/named/teo-en-ming.com.db (WRONG, DON'T USE): ; Generated by CWP ; Zone file for teo-en-ming.com $TTL 14400 @ 86400 IN SOA ns1.centos-webpanel.com. ceo.teo-en-ming-corp.com. ( 2020022660 ; serial, todays date+todays 3600 ; refresh, seconds 7200 ; retry, seconds 1209600 ; expire, seconds 86400 ) ; minimum, seconds @ 86400 IN NS ns1.centos-webpanel.com. @ 86400 IN NS ns2.centos-webpanel.com. @ IN A 3.12.224.179 localhost.teo-en-ming.com. IN A 127.0.0.1 @ IN MX 0 teo-en-ming.com. mail 14400 IN CNAME teo-en-ming.com. smtp 14400 IN CNAME teo-en-ming.com. pop 14400 IN CNAME teo-en-ming.com. pop3 14400 IN CNAME teo-en-ming.com. imap 14400 IN CNAME teo-en-ming.com. webmail 14400 IN A 3.12.224.179 cpanel 14400 IN A 3.12.224.179 cwp 14400 IN A 3.12.224.179 www 14400 IN CNAME teo-en-ming.com. ftp 14400 IN CNAME teo-en-ming.com. _dmarc 14400 IN TXT "v=DMARC1; p=none" @ 14400 IN TXT "v=spf1 +a +mx +ip4:3.12.224.179 ~all" default._domainkey 14400 IN TXT "v=DKIM1; k=rsa; p=MIGfMA0GCSqGSIb3DQEBAQUAA4GNADCBiQKBgQCktDYpEtFO7dyJeErMbjHvyfJYU8RqDeS7WVqQnjH4fP42JSqPmxEFX+QytFTlGqd6ndlz9Tjqi1iZsD0ajB/+0Pkwq/KtL6NVo2TIqnXj8VebV9+FEcx+FGvLA/b5zz+Hfn0Bf+w/2T2bSwUm+tJoHilmANCFGlcGmpO9/lXvAwIDAQAB" File /etc/named/slave.conf: zone "teo-en-ming.com" { type slave; file "slave/db.teo-en-ming.com"; masters { 3.21.30.127; };}; //username:enming That's all folks! -----BEGIN EMAIL SIGNATURE----- The Gospel for all Targeted Individuals (TIs): [The New York Times] Microwave Weapons Are Prime Suspect in Ills of U.S. Embassy Workers Link: https://www.nytimes.com/2018/09/01/science/sonic-attack-cuba-microwave.html ******************************************************************************************** Singaporean Mr. Turritopsis Dohrnii Teo En Ming's Academic Qualifications as at 14 Feb 2019 and refugee seeking attempts at the United Nations Refugee Agency Bangkok (21 Mar 2017), in Taiwan (5 Aug 2019) and Australia (25 Dec 2019 to 9 Jan 2020): [1] https://tdtemcerts.wordpress.com/ [2] https://tdtemcerts.blogspot.sg/ [3] https://www.scribd.com/user/270125049/Teo-En-Ming -----END EMAIL SIGNATURE-----

1 0