unorm an streaming

[jeromew]

Hello,

Have you considered bringing a streaming API to unorm ? do you think that it is technically feasible (is normalization only a 'local' operation where you only need to know a few characters before taking a decision ?) or do you stricly need the whole buffer string before starting to normalize ?

[phadej]

It's technically possible, but that would require rewriting of the internals.

[jeromew]

would it make sense to have a shared library between a streaming & non streaming library ?

I suspect that a lot of code could be shared (char detection, length, replacements, ..) but maybe if they are refactored into re-usable parts for a streaming solution it could lead to a performance hit on unorm.

is performance currently a critical goal of unorm ?

I am trying to see if a streaming-unorm should just take inspiration from unorm or rather spring from a unorm refactoring.