[Maria-discuss] sharding with mariadb?
I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
Instead of using Vitess, can't we use maxscale? Can anyone provide me comparision of Vitess Vs Maxscale. Thank you. On Wed, Oct 5, 2016 at 11:21 PM, l vic <lvic4594@gmail.com> wrote:
I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
Isn't Maxscale a loadbalancer? Failed to see how you'd use it for db sharding. On Wed, Oct 5, 2016 at 3:19 PM, Karthick Subramanian < ksubramanian@paycommerce.com> wrote:
Instead of using Vitess, can't we use maxscale?
Can anyone provide me comparision of Vitess Vs Maxscale. Thank you.
On Wed, Oct 5, 2016 at 11:21 PM, l vic <lvic4594@gmail.com> wrote:
I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
MaxScale does have a simple sharding module: https://mariadb.com/kb/en/mariadb-maxscale-14/maxscale-routers-schemarouter-... Markus On 05/10/16 22:36, l vic wrote:
Isn't Maxscale a loadbalancer? Failed to see how you'd use it for db sharding.
On Wed, Oct 5, 2016 at 3:19 PM, Karthick Subramanian <ksubramanian@paycommerce.com <mailto:ksubramanian@paycommerce.com>> wrote:
Instead of using Vitess, can't we use maxscale?
Can anyone provide me comparision of Vitess Vs Maxscale. Thank you.
On Wed, Oct 5, 2016 at 11:21 PM, l vic <lvic4594@gmail.com <mailto:lvic4594@gmail.com>> wrote:
I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss <https://launchpad.net/%7Emaria-discuss> Post to : maria-discuss@lists.launchpad.net <mailto:maria-discuss@lists.launchpad.net> Unsubscribe : https://launchpad.net/~maria-discuss <https://launchpad.net/%7Emaria-discuss> More help : https://help.launchpad.net/ListHelp <https://help.launchpad.net/ListHelp>
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
-- Markus Mäkelä, Software Engineer MariaDB Corporation t: +358 40 7740484 | Skype: markus.j.makela
What are your sharding requirements? Do you plan to report or aggregate the data across shards? Do you need parallelism when accessing more than one shard (or more than one partition in a table)? Do you need to push down aggregation, filtering, and joins? Joins between sharded and un-sharded tables? Consider using Shard-Query if you answered yes to any of those questions. Otherwise you should probably consider MySQL Fabric for pure OLTP sharding if that meets your requirements. In any case, a shard would be three or more servers in a synchronous replication architecture. It is usually possible to use master/master replication for un-sharded tables, and you could need to use this "on top of" the sync replication clusters if needed, for un sharded (replicated on all nodes) tables. Note: I'm the author of Shard-Query. Sent from my iPhone
On Oct 5, 2016, at 3:47 PM, Markus Mäkelä <markus.makela@mariadb.com> wrote:
MaxScale does have a simple sharding module: https://mariadb.com/kb/en/mariadb-maxscale-14/maxscale-routers-schemarouter-...
Markus
On 05/10/16 22:36, l vic wrote: Isn't Maxscale a loadbalancer? Failed to see how you'd use it for db sharding.
On Wed, Oct 5, 2016 at 3:19 PM, Karthick Subramanian <ksubramanian@paycommerce.com> wrote: Instead of using Vitess, can't we use maxscale?
Can anyone provide me comparision of Vitess Vs Maxscale. Thank you.
On Wed, Oct 5, 2016 at 11:21 PM, l vic <lvic4594@gmail.com> wrote: I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
-- Markus Mäkelä, Software Engineer MariaDB Corporation t: +358 40 7740484 | Skype: markus.j.makela _______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
I don't have requirements that specific, It's more like i am looking for solution to manage(scale) large size datasets for MariaDB/ Galera clusters... On Wed, Oct 5, 2016 at 4:05 PM, Justin Swanhart <greenlion@gmail.com> wrote:
What are your sharding requirements?
Do you plan to report or aggregate the data across shards? Do you need parallelism when accessing more than one shard (or more than one partition in a table)? Do you need to push down aggregation, filtering, and joins? Joins between sharded and un-sharded tables? Consider using Shard-Query if you answered yes to any of those questions.
Otherwise you should probably consider MySQL Fabric for pure OLTP sharding if that meets your requirements.
In any case, a shard would be three or more servers in a synchronous replication architecture. It is usually possible to use master/master replication for un-sharded tables, and you could need to use this "on top of" the sync replication clusters if needed, for un sharded (replicated on all nodes) tables.
Note: I'm the author of Shard-Query.
Sent from my iPhone
On Oct 5, 2016, at 3:47 PM, Markus Mäkelä <markus.makela@mariadb.com> wrote:
MaxScale does have a simple sharding module: https://mariadb.com/kb/en/ mariadb-maxscale-14/maxscale-routers-schemarouter-router/
Markus
On 05/10/16 22:36, l vic wrote:
Isn't Maxscale a loadbalancer? Failed to see how you'd use it for db sharding.
On Wed, Oct 5, 2016 at 3:19 PM, Karthick Subramanian < ksubramanian@paycommerce.com> wrote:
Instead of using Vitess, can't we use maxscale?
Can anyone provide me comparision of Vitess Vs Maxscale. Thank you.
On Wed, Oct 5, 2016 at 11:21 PM, l vic <lvic4594@gmail.com> wrote:
I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
-- Markus Mäkelä, Software Engineer MariaDB Corporation t: +358 40 7740484 | Skype: markus.j.makela
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
Hi, Not sure, whether this sharding you are looking for or more complicated one, below is simple sharding example: https://mariadb.com/kb/en/mariadb-enterprise/mariadb-maxscale-14/maxscale-si... On Thu, Oct 6, 2016 at 1:06 AM, l vic <lvic4594@gmail.com> wrote:
Isn't Maxscale a loadbalancer? Failed to see how you'd use it for db sharding.
On Wed, Oct 5, 2016 at 3:19 PM, Karthick Subramanian < ksubramanian@paycommerce.com> wrote:
Instead of using Vitess, can't we use maxscale?
Can anyone provide me comparision of Vitess Vs Maxscale. Thank you.
On Wed, Oct 5, 2016 at 11:21 PM, l vic <lvic4594@gmail.com> wrote:
I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
All, sorry for late reply to this thread. My outlook didn't refreshed properly with new messages. On Thu, Oct 6, 2016 at 9:43 AM, Karthick Subramanian < ksubramanian@paycommerce.com> wrote:
Hi,
Not sure, whether this sharding you are looking for or more complicated one, below is simple sharding example:
https://mariadb.com/kb/en/mariadb-enterprise/mariadb- maxscale-14/maxscale-simple-sharding-with-two-servers/
On Thu, Oct 6, 2016 at 1:06 AM, l vic <lvic4594@gmail.com> wrote:
Isn't Maxscale a loadbalancer? Failed to see how you'd use it for db sharding.
On Wed, Oct 5, 2016 at 3:19 PM, Karthick Subramanian < ksubramanian@paycommerce.com> wrote:
Instead of using Vitess, can't we use maxscale?
Can anyone provide me comparision of Vitess Vs Maxscale. Thank you.
On Wed, Oct 5, 2016 at 11:21 PM, l vic <lvic4594@gmail.com> wrote:
I wonder how to use sharding with symmetric replication... Does that mean I have to partition every database instance? Does it work with third-party tools, like Vitess (http://vitess.io/)? Thanks
_______________________________________________ Mailing list: https://launchpad.net/~maria-discuss Post to : maria-discuss@lists.launchpad.net Unsubscribe : https://launchpad.net/~maria-discuss More help : https://help.launchpad.net/ListHelp
participants (4)
-
Justin Swanhart -
Karthick Subramanian -
l vic -
Markus Mäkelä