- developers - lists.mariadb.org

[Maria-developers] WL#224 New (by Monty): Handle milions of users & roles.
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Handle milions of users & roles. CREATION DATE..: Thu, 30 Jun 2011, 17:54 SUPERVISOR.....: Sergei IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-BackLog TASK ID........: 224 (http://askmonty.org/worklog/?tid=224) VERSION........: Server-5.7 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: The database should be able to work fine with one million users, one million roles. Do not keep all data in memory, load the required info on login into a cache (size changeable without restart). On login, load the requested data, if it is not in cache already. Example: SET GLOBAL USERNAME_CACHE = 1000000; SET GLOBAL ROLE_CACHE = 1000000; ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#223 New (by Monty): Handle millions of tables (add dictionary)
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Handle millions of tables (add dictionary) CREATION DATE..: Thu, 30 Jun 2011, 17:48 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-Sprint TASK ID........: 223 (http://askmonty.org/worklog/?tid=223) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 200 (hours remain) ORIG. ESTIMATE.: 200 PROGRESS NOTES: DESCRIPTION: Information_schema falls apart when there is millions of tables. Fix is to add a table dictionary of the existing files into a mysql.dict file and use this instead of the file system to return information schema queries that doesn't require a table to be opened. When we try to access a table that doesn't exists in the dictionary, we should open it to see if the .frm file exists and if yes, add it to the dictionary. In a similar fashion, if a table that should exist doesn't, we should remove it from the dictionary. We would also need a refresh command to update the dict from the .frm file (to be used if one copies a table over an old table with different information). ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#222 New (by Monty): Make all innodb variables changeable without server restart
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Make all innodb variables changeable without server restart CREATION DATE..: Thu, 30 Jun 2011, 17:41 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-Sprint TASK ID........: 222 (http://askmonty.org/worklog/?tid=222) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: Make all XtraDB variables changeable without server restart. "About every second innodb config change requires a server restart to be picked up" ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#221 New (by Monty): move InnoDB data files between servers
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: move InnoDB data files between servers CREATION DATE..: Thu, 30 Jun 2011, 17:34 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 221 (http://askmonty.org/worklog/?tid=221) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: Add ALTER TABLE ... DETACH/ATTACH commands (or similar) to XtraDB/InnoDB to allow one to easily copy tables between servers. (Aria can already do this) ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#220 New (by Monty): Dissallow table scan in SELECT
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Dissallow table scan in SELECT CREATION DATE..: Thu, 30 Jun 2011, 17:28 SUPERVISOR.....: Monty IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 220 (http://askmonty.org/worklog/?tid=220) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 16 (hours remain) ORIG. ESTIMATE.: 16 PROGRESS NOTES: DESCRIPTION: Add a variable SQL_FORCE_INDEX_USAGE= 0 | 1 | 2 0 is normal. 1 would give an error if you are not specifying a usable index for all tables. It would still allow MariaDB to do a table scan if that's the best method. 2 Give an error for any SELECT's that would use a table scan on a normal (not internal temporary) table. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#219 New (by Monty): Query statistics
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Query statistics CREATION DATE..: Thu, 30 Jun 2011, 17:08 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 219 (http://askmonty.org/worklog/?tid=219) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 120 (hours remain) ORIG. ESTIMATE.: 120 PROGRESS NOTES: DESCRIPTION: Log skeletons for queries in server (live from parser) but without constants with statistics. Things to consider: * Should use a fixed memory size. Queries should be removed as FIFO * Small CPU overhead * IN(a,b,c) should be equal recorded as IN(#) (One constant) * multi row inserts needs to be handled as one insert. We also need a method to do regular expression replacement for table names. This is needed to be able to recognize similar tables like log tables with a _YYMMDD prefix. Statistics to collect per query: - Number of times executed - Total time executed (in microseconds) - Rows read, inserted, updated and deleted. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#218 New (by Monty): Better EXPLAIN
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Better EXPLAIN CREATION DATE..: Thu, 30 Jun 2011, 16:58 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 218 (http://askmonty.org/worklog/?tid=218) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 0 (hours remain) ORIG. ESTIMATE.: 0 PROGRESS NOTES: DESCRIPTION: This is a master task for all tasks that makes EXPLAIN better. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#217 New (by Monty): Get list of active GET_LOCK
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Get list of active GET_LOCK CREATION DATE..: Thu, 30 Jun 2011, 16:51 SUPERVISOR.....: Monty IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 217 (http://askmonty.org/worklog/?tid=217) VERSION........: Server-5.6 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 16 (hours remain) ORIG. ESTIMATE.: 16 PROGRESS NOTES: DESCRIPTION: Add a command SHOW GET_LOCKS to show all active GET_LOCK commands. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#216 New (by Monty): Make aria_pack an internal command in mysqld
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Make aria_pack an internal command in mysqld CREATION DATE..: Thu, 30 Jun 2011, 16:45 SUPERVISOR.....: IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-RawIdeaBin TASK ID........: 216 (http://askmonty.org/worklog/?tid=216) VERSION........: WorkLog-4.0 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 40 (hours remain) ORIG. ESTIMATE.: 40 PROGRESS NOTES: DESCRIPTION: Make aria_pack an internal command in mysqld Add the aria_pack source inside mysqld and add a new handler commands 'compress table' and 'uncompress table' ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0

[Maria-developers] WL#215 New (by Monty): Add functional indexes
by worklog-noreply＠askmonty.org 30 Jun '11

30 Jun '11

----------------------------------------------------------------------- WORKLOG TASK -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- TASK...........: Add functional indexes CREATION DATE..: Thu, 30 Jun 2011, 16:17 SUPERVISOR.....: Monty IMPLEMENTOR....: COPIES TO......: CATEGORY.......: Server-Sprint TASK ID........: 215 (http://askmonty.org/worklog/?tid=215) VERSION........: Server-5.6 STATUS.........: Un-Assigned PRIORITY.......: 60 WORKED HOURS...: 0 ESTIMATE.......: 200 (hours remain) ORIG. ESTIMATE.: 200 PROGRESS NOTES: DESCRIPTION: Add support for functional indexes. This is needed for MWL#34 Dynamic columns. The idea would be to extend the handler interface with a callback function that provides the handler with a key in normal key-read format of the index entry. In addition we need to enhance the optimizer to recognize the function used for the functional index parts so that it can use the index. ESTIMATED WORK TIME ESTIMATED COMPLETION DATE ----------------------------------------------------------------------- WorkLog (v4.0.0)

1 0