Hi Marko,

The workload aligns with your comments on two fronts - yes to InnoDB and yes to using partitions (based on time) that start empty every few hours.

How would I tune mariadb as per your comments for emergency flushing/ib_logfile0?

From: Marko Mäkelä <marko.makela@mariadb.com>
Sent: Saturday, 14 November 2020 1:39 AM
To: martin doc <db1280@hotmail.com>
Cc: maria-discuss@lists.launchpad.net <maria-discuss@lists.launchpad.net>
Subject: Re: [Maria-discuss] Increase in IOPS between 5.5 and 10.4
 
If you are using the InnoDB storage engine, the explanation could be
MDEV-12288. A fix is underway in MDEV-515, for speeding up inserts
into empty tables or partitions.

The recent MariaDB 10.5.8 release includes significant improvements to
write performance (MDEV-23399 and MDEV-23855). If you do not mind some
variance in the throughput and latency, you might want to configure
the database so that InnoDB will only perform 'emergency flushing',
and basically only perform sequential writes to ib_logfile0 most of
the time.

With best regards,

Marko
--
Marko Mäkelä, Lead Developer InnoDB
MariaDB Corporation