• Charcter encoding nightmare. :)

    From Fabio Bizzi@2:335/364.1 to All on Sat Mar 9 12:15:34 2024
    Hello All!

    the recent discussions on utf-8 on this echo made me the intention to solve the character encoding issues on my point.

    So I'm here to kindly ask you hints about the configuration.

    I run my point on Linux Mint with this configuration:

    bizzi@bizzi:~$ locale
    LANG=it_IT.UTF-8
    LANGUAGE=it_IT:en
    LC_CTYPE="it_IT.UTF-8"
    LC_NUMERIC=it_IT.UTF-8
    LC_TIME=it_IT.UTF-8
    LC_COLLATE="it_IT.UTF-8"
    LC_MONETARY=it_IT.UTF-8
    LC_MESSAGES="it_IT.UTF-8"
    LC_PAPER=it_IT.UTF-8
    LC_NAME=it_IT.UTF-8
    LC_ADDRESS=it_IT.UTF-8
    LC_TELEPHONE=it_IT.UTF-8
    LC_MEASUREMENT=it_IT.UTF-8
    LC_IDENTIFICATION=it_IT.UTF-8
    LC_ALL=

    This is the golded.cfg part for the charcter encoding:

    // Path where the *.ESC and *.CHS files can be found.
    Xlatpath /home/bizzi/husky/golded/charset/

    XLATCHARSET CP850 UTF-8 850_UTF8.CHS
    XLATCHARSET UTF-8 CP850 UTF8_850.CHS

    GROUP UTF8
    xlatimport utf-8
    member utf-8
    xlatexport utf-8
    origin UTF-8 enthousiast
    ENDGROUP

    If I start golded from a xfce terminal the accented characters shows as a double "?" with inverted color.

    If I start golded from putty with the ISO-8859-1 charcter encoding I see the correct characters in golded, but all other people see garbage in my messages.

    The golded configuration is taken from a well know article by Michiel van der Vlist : "Training Golded to play UTF-8", so I suppose it should be right. :)

    Any hint? :)

    Many thanks to all.

    Ciao!
    Fabio

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: ]\/[imac Rebirth Boss Point (2:335/364.1)
  • From Vitaliy Aksyonov@1:104/117 to Fabio Bizzi on Sat Mar 9 17:21:00 2024
    Hello Fabio.

    09 Mar 24 12:15, you wrote to All:

    the recent discussions on utf-8 on this echo made me the intention to solve the character encoding issues on my point.

    First of all. GoldEd is not designed to work with Unicode. Period.
    Some people make it kinda work, but I don't recommend it.

    So I'm here to kindly ask you hints about the configuration.

    I run my point on Linux Mint with this configuration:

    bizzi@bizzi:~$ locale
    LANG=it_IT.UTF-8
    LANGUAGE=it_IT:en
    LC_CTYPE="it_IT.UTF-8"
    LC_NUMERIC=it_IT.UTF-8
    LC_TIME=it_IT.UTF-8
    LC_COLLATE="it_IT.UTF-8"
    LC_MONETARY=it_IT.UTF-8
    LC_MESSAGES="it_IT.UTF-8"
    LC_PAPER=it_IT.UTF-8
    LC_NAME=it_IT.UTF-8
    LC_ADDRESS=it_IT.UTF-8
    LC_TELEPHONE=it_IT.UTF-8
    LC_MEASUREMENT=it_IT.UTF-8
    LC_IDENTIFICATION=it_IT.UTF-8
    LC_ALL=

    Do not use UTF-8 locale for GoldEd. You shall either use some one-byte charset for GoldEd or run it under luit/screen.

    something like:

    LANG=it_IT.cp850 luit -encoding cp850 gedlnx -C/path/to/your/config
    ^^^^^________________^^^^^ - those shall be your locale. I'm not sure which one used in Italy.

    or configure you terminal to use that locale and run golded directly without luit.

    luit may be more convenient, because you don't need to mess with terminal settings.

    This is the golded.cfg part for the charcter encoding:

    // Path where the *.ESC and *.CHS files can be found.
    Xlatpath /home/bizzi/husky/golded/charset/

    XLATCHARSET CP850 UTF-8 850_UTF8.CHS

    This line may work, ant you may even see messages in your Unicode terminal, but see what's happens next...

    XLATCHARSET UTF-8 CP850 UTF8_850.CHS

    GoldEd cannot convert from multibyte encodings. This line is useless. I'm also wondering where did you get UTF8_850.CHS file? It doesn't exist in GoldEd distribution.

    GROUP UTF8
    xlatimport utf-8

    xlatimport is used for messages which doesn't have kludge CHRS or CHARSET. And even if then it's useless, because GoldEd can't convert from UTF-8.

    member utf-8
    xlatexport utf-8

    This might work depending on what xlatlocalset you have.

    origin UTF-8 enthousiast
    ENDGROUP

    If I start golded from a xfce terminal the accented characters shows
    as a double "?" with inverted color.

    If I start golded from putty with the ISO-8859-1 charcter encoding I
    see the correct characters in golded, but all other people see garbage
    in my messages.

    Most of the European echoes uses cp437. You better set your xlatexport to cp437.

    The golded configuration is taken from a well know article by Michiel
    van der Vlist : "Training Golded to play UTF-8", so I suppose it
    should be right. :)

    Any hint? :)

    Don't mess with UTF-8. It's not supported even if it "works" for some. Use one-byte charset and you'll have no issues.

    Vitaliy

    ... 640K ought to be enough for anybody
    --- GoldED+/LNX 1.1.5-b20240305-beta
    * Origin: Aurora, Colorado (1:104/117)
  • From Fabio Bizzi@2:335/364.1 to Vitaliy Aksyonov on Sun Mar 10 09:56:36 2024
    Hello Vitaliy!

    Saturday March 09 2024 17:21, you wrote to me:

    First of all. GoldEd is not designed to work with Unicode. Period.
    Some people make it kinda work, but I don't recommend it.

    Ok, got it.

    LANG=it_IT.cp850 luit -encoding cp850 gedlnx -C/path/to/your/config
    ^^^^^________________^^^^^ - those shall be your locale.
    I'm not sure which one used in Italy.

    Ok, I built the LATIN-1 (it should be it_IT.iso88591) locale and I started golded with your suggestion:

    LANG=it_IT.iso88591 luit -encoding iso88591 /home/bizzi/husky/bin/gedlnx

    luit may be more convenient, because you don't need to mess with
    terminal settings.

    I agree! :)

    Carlos gave me other hints and now my golded.cfg is this:

    XLATLOCALSET LATIN-1
    XLATCHARSET LATIN-1 UTF-8 iso_utf8.chs
    XLATCHARSET UTF-8 LATIN-1 utf8_iso.chs
    XLATEXPORT UTF-8

    Now in a standard xfce terminal i see the corrected italian accented letters:

    àèéìòù

    But I don't know if I exported them in the right way.

    I'm used to build golded from the git repository, I'm trying to look at the documentation for the character translations but the golded.html is empty also after the "make docs" command.
    Please can you tell me where I can find and updated documentation for Golded, or if I have to do something else to get it from the git tree?

    Many thanks. :)

    Ciao!
    Fabio

    --- GoldED+/LNX 1.1.5-b20180707
    * Origin: ]\/[imac Rebirth Boss Point (2:335/364.1)