Hi,
I come across similar situation today:
server version: 10.1.21-MariaDB
character_set_database | utf8
character_set_filesystem | binary
Initially when I tried to create Unique Index on below columns, I got error as max key length 762 bytes error:
col_1 varchar(500)
col_2 varchar(250)
col_3 varchar(5)
So I have changed the innodb_large_prefix=ON and innodb_file_format from Antelop to Baracuda.
Even after changing to above settings, Still I am getting 762 bytes limitation error. Even I tried to recreate the table with different name to make sure the settings will apply to new tables, but still get the error. So not sure what's really going on.
So I tried to change the col_1 datatype varchar(500) to varchar(250), its successfully created. I thought the length calc will be on total keys (i.e. 3 column added together), but it doesn't seem to be.
Any thought on this,please.