src: implement FastByteLengthUtf8 with simdutf::utf8_length_from_latin1
This PR proposes to replace the conventional FastByteLengthUtf8 implementation by simdutf::utf8_length_from_latin1. Internally, the simdutf library implements specific functions. The results are presented in the following blog posts...
- Computing the UTF-8 size of a Latin 1 string quickly (ARM NEON edition)
- Computing the UTF-8 size of a Latin 1 string quickly (AVX edition)
The speed can be 30x better in some instances.
This PR actually reduces the total number of lines of code.