[ruby-cvs:73173] nagachika:r66073 (ruby_2_5): merge revision(s) 65954, 65955, 65958: [Backport #15337]

nagachika at ruby-lang.org nagachika at ruby-lang.org
Wed Nov 28 22:36:08 JST 2018


nagachika	2018-11-28 22:36:08 +0900 (Wed, 28 Nov 2018)

  New Revision: 66073

  https://svn.ruby-lang.org/cgi-bin/viewvc.cgi?view=revision&revision=66073

  Log:
    merge revision(s) 65954,65955,65958: [Backport #15337]
    
    Don't use single byte optimization on grapheme clusters
    
    Unicode Text Segmentation considers CRLF as a character. [Bug #15337]
    
    add tests using Unicode test data for grapheme clusters
    
    Add file test/ruby/enc/test_grapheme_breaks.rb to test String#each_grapheme_cluster
    and \X extended grapheme cluster matcher in regular expressions against test data
    provided by Unicode (ucd/auxiliary/GraphemeBreakTest.txt).
    
    Some lines in the data file are ignored, as follows:
    - Lines with a surrogate, because Ruby doesn't handle these
    - The case of "\r\n", because there is a bug (#15337) in the implementation
    
    remove guard against bug #15337, because it is fixed

  Added files:
    branches/ruby_2_5/test/ruby/enc/test_grapheme_breaks.rb
  Modified directories:
    branches/ruby_2_5/
  Modified files:
    branches/ruby_2_5/string.c
    branches/ruby_2_5/test/ruby/test_string.rb
    branches/ruby_2_5/version.h


More information about the ruby-cvs mailing list