Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Unicode 16.0 #8

Closed
wants to merge 1 commit into from
Closed

Support Unicode 16.0 #8

wants to merge 1 commit into from

Conversation

data-man
Copy link

But one test didn't pass :(

-------------------------------------------------------------------------------
Script extension
-------------------------------------------------------------------------------
/home/dataman/Projects/C/cpp-unicodelib_my/test/test.cpp:359
...............................................................................

/home/dataman/Projects/C/cpp-unicodelib_my/test/test.cpp:360: FAILED:
  REQUIRE( is_script(Script::Hiragana, U'ー') )
with expansion:
  false

===============================================================================
test cases:     39 |     38 passed | 1 failed
assertions: 414868 | 414867 passed | 1 failed

@yhirose
Copy link
Owner

yhirose commented Oct 12, 2024

@data-man thanks for the heads-up! I took a look at the new Unicode character database (UCD), and I found there is a major format change in ScriptExtensions.txt. So the following functions can't generate _script_extension_ids and _script_extension_properties_for_id any more...

  • genScriptExtensionIdTable(ucd)
  • genScriptExtensionPropertyForIdTable(ucd)

Also we have to compare manually the new Unicode 16.0.0 spec with the previous 15.1.0 (especially the chapter 3 'Conformance', and UAX #29 'Unicode Text Segmentation'), and apply any changes between them to 'unicodelib.h'.

I'll take a look at it this weekend. Thanks!

@yhirose
Copy link
Owner

yhirose commented Oct 12, 2024

I have updated scripts/gen_table.py to support the new ScriptExtensions.txt format at #9.

@data-man
Copy link
Author

Thank you!

@data-man data-man closed this Oct 13, 2024
@data-man data-man deleted the ucd_16 branch October 13, 2024 11:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants