back to the question
    What *should* COLUMN_JSON() do when a dynamic column contains BINARY values?

today what should be expect? 
return "wrong" (incompatible with json specs) json value?
return null+warning?
return "wrong"+warning?

i think it's a 'sql_mode' that should be set to strict or not