The text package finally with UTF-8
summary
text package now uses UTF-8 internally and ships as text 2.0 with GHC 9.4 support after replacing implicit stream fusion with direct buffer APIs and adding three UTF‑8 validators including optional simdutf and a pure C validator. benchmarks show a 3x faster geometric mean with hotspots up to 20x faster slicing and concatenation and decode/encode improvements up to 10x. a lightweight tasty‑bench runner and extensive CI across many OSes and architectures validate the changes.
AI-written summary · about
chapters (11)
- 0:00Start
- 5:09Recap
- 7:34Unicode Standard
- 13:26Utf-16
- 15:59Decoding of Utf-8
- 26:58Haskell Foundation Proposal To Migrate Text from Utf-16 to Vtf8
- 32:17Why Is a Test Framework Used
- 37:12Continuous Integration
- 38:47Quick Utf-8 Validation
- 53:55Is There a Glorious Future Where String Has a Deprecation Warning and Text Is Built into Ghc
- 56:41Did Switching from Utf-16 to Utf-8 Um Impact the Performance
