Character Count of Unicode String

[tkaltschmidt]

Hi there,

i'm evaluating Purebasic and have to say: Very impressed so far!

Litte question: Is Purebasic capable of counting the perceived characters of a Unicode String? The following code returns 2 characters, but there is only one. Do i miss the correct function or is this a known limitation?

Code: Select all

EnableExplicit

Define MyString1$ = "😍"

Define MyLength.i=Len(MyString1$)

best, Thomas

[DarkDragon]

PureBasic uses Widechar/UCS-2 as internal string representation, so the unicode support is limited to the basic multilingual plane.

Your emoji is U+1F60D (outside the plane)

[miskox]

Maybe this might help: https://www.dostips.com/forum/viewtopic ... 258#p70258

Saso

[tkaltschmidt]

Thank you, Daniel and Saso!

[Fred]

This module should do exactly what you want: https://www.purebasic.fr/english/viewto ... ilit=Utf16

[tkaltschmidt]

Looks good, thank you, Fred!

[idle]

I just updated the UTF16.pb to expose strLen(string$) but if all you need is strlen

Code: Select all

Procedure StrLen_(str.s) 
  Protected *Char.Unicode
  Protected cnt
  *Char.Unicode = @str
  If *Char
    While *Char\u
      If *Char\u > $D7FF And *Char\u < $E000
        *Char + 4
      Else
        *Char + 2
      EndIf
      cnt + 1
    Wend
  EndIf
  ProcedureReturn cnt
EndProcedure
  
Define example$ = "😁A😁😁K😁" 
Debug StrLen_(example$) 

[tkaltschmidt]

That's awesome, thanks, idle!

May i ask: What is the difference between UTF16.pb and UTF16a.pb?

[idle]

Utf16a includes a mapping to strip accents.