- developers - lists.mariadb.org

[Maria-developers] WL#226 New (by Monty): Replace the MYISAM mysql.* tables with Aria / XtraDB
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Replace the MYISAM mysql.* tables with Aria / XtraDB CREATION DATE..: Thu, 30 Jun 2011, 18:06 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-BackLog TASK ID........: 226 (http://askmonty.org/worklog/?tid=226) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 120 (hours remain) ORIG. ESTIMATE.: 120 PROGRESS NOTES: DESCRIPTION: Replace the MYISAM mysql.* tables with Aria / XtraDB We need to get these files crash safe. There is some unknown (for me) reasons why it's hard to use XtraDB for these tables. Using crash safe Aria tables should however be possible. To use Aria, we should first fix that one can use aria_chk to change page size for Aria tables, as otherwise there will be problems with the system tables if one want's to change the aria page size. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#225 New (by Monty): Cache VIEW's
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Cache VIEW's CREATION DATE..: Thu, 30 Jun 2011, 17:58 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-BackLog TASK ID........: 225 (http://askmonty.org/worklog/?tid=225) VERSION........: Server-5.7 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 40 (hours remain) ORIG. ESTIMATE.: 40 PROGRESS NOTES: DESCRIPTION: Views are read from file and parsed for every access. We should fix this in two stages: This task: Cache the VIEW file in memory (easy task) Later: Store a pre-parsed view in memory (hard task) ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#224 New (by Monty): Handle milions of users & roles.
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Handle milions of users & roles. CREATION DATE..: Thu, 30 Jun 2011, 17:54 SUPERVISOR.....: Sergei IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-BackLog TASK ID........: 224 (http://askmonty.org/worklog/?tid=224) VERSION........: Server-5.7 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: The database should be able to work fine with one million users, one million roles. Do not keep all data in memory, load the required info on login into a cache (size changeable without restart). On login, load the requested data, if it is not in cache already. Example: SET GLOBAL USERNAME_CACHE = 1000000; SET GLOBAL ROLE_CACHE = 1000000; ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#223 New (by Monty): Handle millions of tables (add dictionary)
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Handle millions of tables (add dictionary) CREATION DATE..: Thu, 30 Jun 2011, 17:48 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-Sprint TASK ID........: 223 (http://askmonty.org/worklog/?tid=223) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 200 (hours remain) ORIG. ESTIMATE.: 200 PROGRESS NOTES: DESCRIPTION: Information_schema falls apart when there is millions of tables. Fix is to add a table dictionary of the existing files into a mysql.dict file and use this instead of the file system to return information schema queries that doesn't require a table to be opened. When we try to access a table that doesn't exists in the dictionary, we should open it to see if the .frm file exists and if yes, add it to the dictionary. In a similar fashion, if a table that should exist doesn't, we should remove it from the dictionary. We would also need a refresh command to update the dict from the .frm file (to be used if one copies a table over an old table with different information). ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#222 New (by Monty): Make all innodb variables changeable without server restart
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Make all innodb variables changeable without server restart CREATION DATE..: Thu, 30 Jun 2011, 17:41 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-Sprint TASK ID........: 222 (http://askmonty.org/worklog/?tid=222) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: Make all XtraDB variables changeable without server restart. "About every second innodb config change requires a server restart to be picked up" ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#221 New (by Monty): move InnoDB data files between servers
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: move InnoDB data files between servers CREATION DATE..: Thu, 30 Jun 2011, 17:34 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 221 (http://askmonty.org/worklog/?tid=221) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: Add ALTER TABLE ... DETACH/ATTACH commands (or similar) to XtraDB/InnoDB to allow one to easily copy tables between servers. (Aria can already do this) ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#220 New (by Monty): Dissallow table scan in SELECT
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Dissallow table scan in SELECT CREATION DATE..: Thu, 30 Jun 2011, 17:28 SUPERVISOR.....: Monty IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 220 (http://askmonty.org/worklog/?tid=220) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 16 (hours remain) ORIG. ESTIMATE.: 16 PROGRESS NOTES: DESCRIPTION: Add a variable SQL_FORCE_INDEX_USAGE= 0 | 1 | 2 0 is normal. 1 would give an error if you are not specifying a usable index for all tables. It would still allow MariaDB to do a table scan if that's the best method. 2 Give an error for any SELECT's that would use a table scan on a normal (not internal temporary) table. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#219 New (by Monty): Query statistics
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Query statistics CREATION DATE..: Thu, 30 Jun 2011, 17:08 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 219 (http://askmonty.org/worklog/?tid=219) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 120 (hours remain) ORIG. ESTIMATE.: 120 PROGRESS NOTES: DESCRIPTION: Log skeletons for queries in server (live from parser) but without constants with statistics. Things to consider: * Should use a fixed memory size. Queries should be removed as FIFO * Small CPU overhead * IN(a,b,c) should be equal recorded as IN(#) (One constant) * multi row inserts needs to be handled as one insert. We also need a method to do regular expression replacement for table names. This is needed to be able to recognize similar tables like log tables with a _YYMMDD prefix. Statistics to collect per query: - Number of times executed - Total time executed (in microseconds) - Rows read, inserted, updated and deleted. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#218 New (by Monty): Better EXPLAIN
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Better EXPLAIN CREATION DATE..: Thu, 30 Jun 2011, 16:58 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 218 (http://askmonty.org/worklog/?tid=218) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: This is a master task for all tasks that makes EXPLAIN better. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#217 New (by Monty): Get list of active GET_LOCK
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Get list of active GET_LOCK CREATION DATE..: Thu, 30 Jun 2011, 16:51 SUPERVISOR.....: Monty IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 217 (http://askmonty.org/worklog/?tid=217) VERSION........: Server-5.6 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 16 (hours remain) ORIG. ESTIMATE.: 16 PROGRESS NOTES: DESCRIPTION: Add a command SHOW GET_LOCKS to show all active GET_LOCK commands. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0