查看: 4723|回复: 3
打印 上一主题 下一主题

[资料] Unicode 7.0发布

[复制链接]

该用户从未签到

12

主题

324

回帖

8872

积分

进士

Rank: 8Rank: 8

积分
8872

小蜜蜂章笑傲江湖章灌水大神章

跳转到指定楼层
1
发表于 2014-6-17 22:46:39 | 只看该作者 回帖奖励 |倒序浏览 |阅读模式


计算机文字编码标准Unicode发布了v7.0。7.0新增了2834个新字符;23种全新文字(主要是扩展支持北美、中国、印度等地较少使用的文字和历史文字);两种新的货币符号——阿塞拜疆使用的马纳特(Manat)和俄罗斯等国使用的卢布;增加约250个图形表情符号(如图);增强婆罗米系文字属性,约3000个新的广东话发音条目,等等。

Unicode 7.0.0
This page summarizes the important changes for the Unicode Standard, Version 7.0.0. This version supersedes all previous versions of the Unicode Standard.

The core specification for Version 7.0 of the Unicode Standard is pending publication, due to the extensive editorial work required for the new content additions to Version 7.0. The planned date of publication is October 15, 2014. Until final publication, the links to individual chapters of the core specification have not been activated. However, a link to the current draft of the Table of Contents of the core specification is provided, for reference. An announcement will be made when the core specification for Version 7.0 is available. In the meantime, implementers can continue to reference the relevant sections of most recent version of the core specification.
A. Summary
B. Technical Overview
C. Stability Policy Update
D. Textual Changes and Character Additions
E. Conformance Changes
F. Changes in the Unicode Character Database
G. Changes in the Unicode Standard Annexes
H. Changes in Synchronized Unicode Technical Standards
M. Implications for Migration
A. Summary

Unicode 7.0 adds a total of 2,834 characters, encompassing 23 new scripts and many new symbols, as well as character additions to many existing scripts. Notable character additions include the following:

Two newly adopted currency symbols: the manat, used in Azerbaijan, and the ruble, used in Russia and other countries
Pictographic symbols (including many emoji), geometric symbols, arrows, and ornaments originating from the Wingdings and Webdings sets
Twenty-three new lesser-used and historic scripts extending support for written languages of North America, China, India, other Asian countries, and Africa
Letters used in Teuthonista and other transcriptional systems, and a new notational set, Duployan
Other important updates in Unicode Version 7.0 include:

Significant reorganization of the chapters and layout of the core specification, and a new page size tailored for easy viewing on e-readers and other mobile devices
Alignment with updates to the Unicode Bidirectional Algorithm
Further clarification of the case pair stability policy, and a new stability policy for Numeric_Type
Significant updates to Unihan with the addition of nearly 3,000 new Cantonese pronunciation entries
Major enhancements to the Indic script properties that lay the foundation for improved, more interoperable display of these scripts
Synchronization

Two other important Unicode specifications are maintained in synchrony with the Unicode Standard, and include updates for the repertoire additions made in Version 7.0, as well as other modifications:

UTS #10, Unicode Collation Algorithm
UTS #46, Unicode IDNA Compatibility Processing
This version of the Unicode Standard is synchronized with ISO/IEC 10646:2012, plus Amendments 1 and 2. Additionally, it includes the accelerated publication of U+20BD RUBLE SIGN.

See Sections D through H below for additional details regarding the changes in this version of the Unicode Standard, its associated annexes, and the other synchronized Unicode specifications.

B. Technical Overview

Version 7.0 of the Unicode Standard consists of the core specification, the delta and archival code charts for this version, the Unicode Standard Annexes, and the Unicode Character Database (UCD).

The core specification gives the general principles, requirements for conformance, and guidelines for implementers. The code charts show representative glyphs for all the Unicode characters. The Unicode Standard Annexes supply detailed normative information about particular aspects of the standard. The Unicode Character Database supplies normative and informative data for implementers to allow them to implement the Unicode Standard.

A complete specification of the contributory files for Unicode 7.0 is found on the page Components for 7.0.0. That page also provides the recommended reference format for Unicode Standard Annexes. For examples of how to cite particular portions of the Unicode Standard, see also the Reference Examples.

The navigation bar on the left of this page provides links to both the core specification as a single file, as well as to individual chapters, and the appendices. Also provided are links to the code charts, the radical-stroke indices to CJK ideographs, the Unicode Standard Annexes and the data files for Version 7.0 of the Unicode Character Database.

Version Specification

Version 7.0.0 of the Unicode Standard should be referenced as:

The Unicode Consortium. The Unicode Standard, Version 7.0.0, (Mountain View, CA: The Unicode Consortium, 2014. ISBN 978-1-936213-09-2)
http://www.unicode.org/versions/Unicode7.0.0/

The terms “Version 7.0” or “Unicode 7.0” are abbreviations for the full version reference, Version 7.0.0.

The citation and permalink for the latest published version of the Unicode Standard is:

The Unicode Consortium. The Unicode Standard.
http://www.unicode.org/versions/latest/

Code Charts

Several sets of code charts are available. They serve different purposes:

The latest set of code charts for the Unicode Standard are available online. Those charts are always the most current code charts available, and may be updated at any time. The charts are organized by scripts and blocks for easy reference. An online index by character name is also provided.
For Unicode 7.0.0 in particular two additional sets of code chart pages are provided:

A set of delta code charts showing the blocks in which characters were added for Unicode 7.0.0. The new characters are visually highlighted in the charts.
A set of archival code charts that represent the entire set of characters, names and representative glyphs at the time of publication of Unicode 7.0.0.
The delta and archival code charts are a stable part of this release of the Unicode Standard. They will never be updated.

Errata

Errata incorporated into Unicode 7.0 are listed by date in a separate table. For corrigenda and errata after the release of Unicode 7.0, see the list of current Updates and Errata.

C. Stability Policy Update

The case pair stability policy has been augmented with further clarification.
A property value stability policy has been added for Numeric_Type=Digit.
D. Textual Changes and Character Additions

The block descriptions in the core spec were reorganized significantly. Twenty-three new scripts were added with accompanying new block descriptions:

Bassa Vah        Mahajani        Pahawh Hmong
Caucasian Albanian        Manichaean        Palmyrene
Duployan        Mende Kikakui        Pau Cin Hau
Elbasan         Modi         Psalter Pahlavi
Grantha        Mro        Siddham
Khojki        Nabataean        Tirhuta
Khudawadi        Old North Arabian        Warang Citi
Linear A        Old Permic         
With Version 7.0, support for lesser-used languages was extended worldwide, including:

Arabic additions for languages of Pakistan and for the African languages Berber and Fulfulde
Cyrillic additions for languages of Russia
Myanmar additions for the Tai Laing, Shan Pali, and Shwe Palaung languages
Letters used in Teuthonista and other transcriptional systems and a new notational set, Duployan, used for writing certain shorthands and Native American languages were added. Many symbols originating from the Wingdings and Webdings sets were also added, as well as more emoji and other pictographic symbols.

Changes in the Unicode Standard Annexes are listed in Section G.

Character Assignment Overview

327 characters have been added to the BMP, while 2,507 characters have been added to Plane 1. Most character additions are in new blocks, but there are also character additions to a number of existing blocks.

New Blocks

The newly-defined blocks in Version 7.0 are:
Range
Block Name
1AB0..1AFF
Combining Diacritical Marks Extended
A9E0..A9FF
Myanmar Extended-B
AB30..AB6F
Latin Extended-E
102E0..102FF
Coptic Epact Numbers
10350..1037F
Old Permic
10500..1052F
Elbasan
10530..1056F
Caucasian Albanian
10600..1077F
Linear A
10860..1087F
Palmyrene
10880..108AF
Nabataean
10A80..10A9F
Old North Arabian
10AC0..10AFF
Manichaean
10B80..10BAF
Psalter Pahlavi
11150..1117F
Mahajani
111E0..111FF
Sinhala Archaic Numbers
11200..1124F
Khojki
112B0..112FF
Khudawadi
11300..1137F
Grantha
11480..114DF
Tirhuta
11580..115FF
Siddham
11600..1165F
Modi
118A0..118FF
Warang Citi
11AC0..11AFF
Pau Cin Hau
16A40..16A6F
Mro
16AD0..16AFF
Bassa Vah
16B00..16B8F
Pahawh Hmong
1BC00..1BC9F
Duployan
1BCA0..1BCAF
Shorthand Format Controls
1E800..1E8DF
Mende Kikakui
1F650..1F67F
Ornamental Dingbats
1F780..1F7FF
Geometric Shapes Extended
1F800..1F8FF
Supplemental Arrows-C
E. Conformance Changes

Minor changes were made to reflect updates to the Bidirectional Algorithm in Version 6.3 of the Unicode Standard.
Corrigendum #9 was applied to D14 (Noncharacter).
The changes from Version 6.3 of the Unicode Standard were incorporated in D136 (Case-ignorable) in the updated core specification.
F. Changes in the Unicode Character Database

The detailed listing of all changes to the contributory data files of the Unicode Character Database for Version 7.0 can be found in UAX #44, Unicode Character Database. The changes listed there include character additions and property revisions to existing characters that will affect implementations. Some of the important impacts on implementations migrating from earlier versions of the standard are highlighted in Section M.

There were several changes to Unihan data, including the addition of nearly 3,000 new Cantonese pronunciation entries, significant modification to the syntax for kIICore, and the relocation of  kRSUnicode and kCompatibilityVariant  to Unihan_IRGSources.txt.

Major enhancements were made to the Indic script properties. New property values were added to enable a more algorithmic approach to rendering Indic scripts. These include values for joining behavior, new classes for numbers, and a further division of the syllabic categories of viramas and rephas. With these enhancements, the default rendering for newly added Indic scripts can be significantly improved.

Other updates include changes to the derivations of the Alphabetic and Case_Ignorable properties, and a number of updates to the Script and Script_Extensions property assignments. Also, the conventions for defining default property values for ranges of code points using “@missing” directives was regularized.

G. Changes in the Unicode Standard Annexes

In Version 7.0, some of the Unicode Standard Annexes have had significant revisions. The most important of these changes are listed below. For the full details of all changes, see the Modifications section of each UAX, linked directly from the following list of UAXes.

Unicode Standard Annex        Changes
UAX #9
Unicode Bidirectional Algorithm        No significant changes in this version.
UAX #11
East Asian Width        No significant changes in this version.
UAX #14
Unicode Line Breaking Algorithm        No significant changes in this version.
UAX #15
Unicode Normalization Forms        Corrected note for Table 3, Notational Conventions.
UAX #24
Unicode Script Property        No significant changes in this version.
UAX #29
Unicode Text Segmentation        Added U+AA7D MYANMAR SIGN TAI LAING TONE-5 to the exception list for SpacingMark in Table 2, Grapheme_Cluster_Break Property Values. Added a note to clarify that Format and Extend characters are not joined to separators like LF, as well as a note about the fact that words can span a sentence break in Section 5.1 Default Sentence Boundary Specification.
UAX #31
Unicode Identifier and Pattern Syntax        Added many new scripts to Table 4, Candidate Characters for Exclusion from Identifiers. The text on natural-language identifiers was changed to have a stronger recommendation for including the exception characters, and include the Catalan MIDDLE DOT.
UAX #34
Unicode Named Character Sequences        Added definitions for Unicode namespace and the Unicode namespace for character names. Major rewrite of Section 4, Names.
UAX #38
Unicode Han Database (Unihan)        The syntax for the kIICore field has been changed. The kCompatibilityVariant and kRSUnicode fields have been moved to Unihan_IRGSources.txt.
UAX #41
Common References for Unicode Standard Annexes        No significant changes in this version.
UAX #42
Unicode Character Database in XML        Added the value 7.0 for the age attribute, and new values for the attributes blk, jg, sc, KIICore, kIRG_GSource, and InSC.
UAX #44
Unicode Character Database        Updated the derivation of the Alphabetic property and of the Case_Ignorable property. Simplified the discussion of @missing in Section 4.2.10 @missing Conventions, to reflect the revised conventions in the UCD data files, which eliminated special edge cases. Corrected statement about aliases for provisional properties in Section 5.8 Property and Property Value Aliases.
UAX #45
U-Source Ideographs        Clarified meaning of status field.
H. Changes in Synchronized Unicode Technical Standards

There are also significant revisions in the Unicode Technical Standards whose versions are synchronized with the Unicode Standard. The most important of these changes are listed below. For the full details of all changes, see the Modifications section of each UTS, linked directly from the following list of UTSes.

Unicode Technical Standard        Changes
UTS #10
Unicode Collation Algorithm        Changed the text to discuss collation weights more generically, with fewer references to the 16-bit weights used in the DUCET, and Section 6.3.2, Large Values for Secondary or Tertiary Weights was merged into Section 6.2, Large Weight Values.
UTS #46
Unicode IDNA Compatibility Processing        Updated statistics for 7.0.0 in Table 4, IDNA Comparisons. Section 4 has been modified to clarify the input and results for each major step in the algorithm. In Section 5 IDNA Mapping Table, added a new value for field 3, XV8,with example. In Section 8.1 Format, made the definition of NV8 consistent with Section 5 IDNA Mapping Table.
M. Implications for Migration

There are a significant number of changes in Unicode 7.0 which may impact implementations which are upgrading to Version 7.0 from earlier versions of the standard. The most important of these are listed and explained here, to help focus on the issues most likely to cause unexpected trouble during upgrades.

Script-related Changes

Version 7.0 adds many new scripts, so implementations which process script data should be carefully checked. In particular:

The large number of additional scripts (23) may cause overflows for implementations which make hard-coded assumptions about the number of scripts in the standard. As of Unicode 7.0, there are now 127 values of the Script property, which may break implementations that have stored Script property values in bit fields or a signed byte.
There have been significant additions and changes to the Script_Extensions property. Implementations which use the scx property values should check the new data carefully, especially for common-use characters which may be shared across several scripts.
The Script property value of U+061C ARABIC LETTER MARK (ALM) was changed from Arabic to Common, for consistency with the similar directional controls U+200E LEFT-TO-RIGHT MARK (LRM) and U+200F RIGHT-TO-LEFT MARK (RLM). This change may not be expected for a character located in the Arabic block.
Rendering Issues

A number of the newly added scripts, and in particular, Manichaean and Psalter Pahlavi, have complex shaping behavior. For those two scripts, additional values related to joining behavior appear in ArabicShaping.txt, which may not be expected. In particular:

New Joining_Group values have been defined for Manichaean.
Two Manichaean letters have received the unusual Joining_Type value of L, which formerly had only been used for one Phags-pa letter.
The provisional properties defined in IndicSyllabicCategory.txt and IndicMatraCategory.txt were significantly overhauled. As part of the changes, the InSC property was further subdivided, with many new values added. These values are relevant to implementations of complex rendering in many Indic scripts and may impact implementations that were making use of these provisional properties.
Casing-related Changes

In addition to the usual scattering of new case pairs added for the Latin and Cyrillic scripts, there are noteworthy changes which impact casing behavior:

Several uppercase letters were added for Latin letters which formerly had no uppercase counterpart. In addition, an uppercase counterpart was added for the Greek letter jot.
Three ranges of enclosed capital Latin alphabetic symbols, U+1F130..U+1F149, U+1F150..U+1F169, and U+1F170..U+1F189, were assigned the contributory property Other_Uppercase and thus, by derivation, also the properties Uppercase, Alphabetic, and the corresponding values of various text segmentation properties. This was done to bring these relatively recently encoded alphabetic symbols into line with similar sets of circled alphabetic symbols that have long been present in the standard.
One of the newly encoded scripts, Pahawh Hmong, is bicameral. The appearance of a newly encoded bicameral script on Plane 1, with the attendant need for case mapping and case folding, may break certain assumptions baked into implementations of casing tables.
Segmentation-related Changes

Segmentation-related changes to existing property values were deliberately kept to a minimum for Version 7.0, and for the most part reflect just minor corrections to relatively rare characters. However, there was one significant set of changes impacting two fairly salient punctuation marks used in Arabic:

The General_Category and Line_Break properties for U+FD3E ORNATE LEFT PARENTHESIS and U+FD3F ORNATE RIGHT PARENTHESES were swapped: General_Category Ps ↔ Pe; Line_Break OP ↔ CL. This change was made because these two characters are the sole exceptions among paired bracket punctuation marks for bidirectional mirroring. They do not mirror in a bidirectional context, and are instead entered and edited based on their visual appearance. The property changes bring the General_Category and Line_Break values of these characters into line with their visual interpretation. Note that these changes do not affect the behavior of these characters for bidirectional layout per the Unicode Bidirectional Algorithm, but the changes may otherwise be unexpected for implementations of these characters.
CJK Changes

Nearly 10,000 kIICore values changed for this release. See UAX #38 for details. These changes may break some implementations.
There were nearly 3,000 additions of readings for kCantonese. The simple addition of readings should not cause problems for most implementations, but some may hit internal boundaries due to the number of changes.
There were 4 changes to kMandarin, for the characters 㐵, 𠦌, 掠 and 略. These updated kMandarin values may cause pinyin readings to change for implementations which use kMandarin to define them, and may also cause sort order changes for collations based on pinyin ordering. This applies, for example, to implementations using CLDR.
A kTraditionalVariant value was added for 䜤, to 鿁.
UCD File Format Changes

In general, the format of UCD data files is unchanged for Version 7.0. However, there were some minor updates which may impact some parsers.

The handling of @missing comment lines was modified somewhat. This may impact some parsers which choose to extract @missing information from the data files. For the most part, the changes were to minimize the number of distinct formats for these @missing lines and to make their locations more predictable and regular. The file most affected by these changes is PropertyValueAliases.txt. For more details, see UAX #44, Unicode Character Database.
Parsers of NamesList.txt should note that subhead fields in that data file now contain non-ASCII characters, which was not the case in earlier versions. See NamesList.html in the UCD for details about the format of NamesList.txt.


Announcing The Unicode Standard, Version 7.0
ruble signVersion 7.0 of the Unicode Standard is now available, adding 2,834 new characters. This latest version adds the new currency symbols for the Russian ruble and Azerbaijani manat, approximately 250 emoji (pictographic symbols), many other symbols, and 23 new lesser-used and historic scripts, as well as character additions to many existing scripts. These additions extend support for written languages of North America, China, India, other Asian countries, and Africa. For full details, see http://www.unicode.org/versions/Unicode7.0.0/.

Most of the new emoji characters derive from characters in long-standing and widespread use in Wingdings and Webdings fonts. Additions to emoji characters include, for example:



Major enhancements were made to the Indic script properties. New property values were added to enable a more algorithmic approach to rendering Indic scripts. These include properties for joining behavior, new classes for numbers, and a further division of the syllabic categories of viramas and rephas. With these enhancements, the default rendering for newly added Indic scripts can be significantly improved.

Unicode character properties were extended to the new characters. The old characters have enhancements to Script and Alphabetic properties, and casing and line-breaking behavior. There were also nearly 3,000 new Cantonese pronunciation entries, as well as new or clarified stability policies for promoting interoperable implementations.

Two other important Unicode specifications are maintained in synchrony with the Unicode Standard, and have updates for Version 7.0. These will be released at the same time:
UTS #10, Unicode Collation Algorithm — the standard for sorting Unicode text
UTS #46, Unicode IDNA Compatibility Processing — for processing of non-ASCII URLs (IDNs)

该用户从未签到

34

主题

755

回帖

2705

积分

解元

Rank: 5Rank: 5

积分
2705

灌水大神章小蜜蜂章笑傲江湖章

2
发表于 2014-6-18 01:26:18 | 只看该作者
不规则字符越多,检索和输入越成问题,看来以后会出现一批unicode字符专家。

该用户从未签到

20

主题

251

回帖

898

积分

禁止发言

积分
898
3
发表于 2014-6-18 23:42:03 | 只看该作者
现在unicode 到底是几个字节啊? 教科书上说双字节,可才65500个符号
  • TA的每日心情
    慵懒
    2023-3-2 10:50
  • 签到天数: 207 天

    [LV.7]常住居民III

    42

    主题

    1038

    回帖

    13万

    积分

    版主

    Rank: 10Rank: 10Rank: 10

    积分
    137827

    灌水大神章小蜜蜂章笑傲江湖章管理组专用章

    4
    发表于 2015-2-11 18:12:54 | 只看该作者
    unicode是把人类的全部字符都和编号一一对应起来,编号存到硬盘里有几种方式,一般是2~4字节不等。英文版维基百科解释很详细。