Re: Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Re: Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

Laura Arjona Reina-4
Dear Turkish Translation team,

While working on rebuilding the Debian website [1] within stretch and
buster, Cyril Brulebois detected that the Turkish subdirectory doesn't
build in buster, apparently due to possible locale issues.

[1] https://salsa.debian.org/webmaster-team/webwml

The .wmlrc file in that folder orders to build the site using the tr_TR
locale:

turkish/.wmlrc:-D CUR_LOCALE=tr_TR

But Perl complains about that:

     wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml
     ePerl:Error: Perl runtime error (interpreter rc=0)

     ---- Contents of STDERR channel: ---------
     Locale 'tr_TR' may not work well.
     The following characters (and maybe others) may not have the same
meaning as the Perl program expects:
     I i
     ; codeset=ISO-8859-9
     ------------------------------------------
     ** WML:Break: Error in Pass 3 (rc=1).

More details on bug report #924365

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=924365

I've done a "file" command on all the .po and .wml files in the /turkish
folder of the website and all of them seem to be UTF-8 encoded
(charset=utf-8), so I guess it's safe to change the .wmlrc file to tell
the site to build using tr_TR.UTF-8 locale.

Could you confirm?

Kind regards,
--
Laura Arjona Reina
https://wiki.debian.org/LauraArjona

Reply | Threaded
Open this post in threaded view
|

Re: Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

Omer Ozarslan
Hello Laura,

I'm not sure if I missed some steps, but I couldn't reproduce this issue. Yet, I hit another one:

[snipped]

root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1 USE_SAMPLE_FILES=1
make: Entering directory '/webwml/turkish'
make -C po install
make[1]: Entering directory '/webwml/turkish/po'
make[1]: Leaving directory '/webwml/turkish/po'
make -C CD
make[1]: Entering directory '/webwml/turkish/CD'
make -C http-ftp
make[2]: Entering directory '/webwml/turkish/CD/http-ftp'
make[2]: *** No rule to make target '../../../english/CD/http-ftp/cdimage_mirrors.list', needed by 'index.tr.html'.  Stop.
make[2]: Leaving directory '/webwml/turkish/CD/http-ftp'
make[1]: *** [../../Makefile.common:79: http-ftp] Error 2
make[1]: Leaving directory '/webwml/turkish/CD'
make: *** [../Makefile.common:79: CD] Error 2
make: Leaving directory '/webwml/turkish'


Here is the verbose part I snipped for convenience:

root@a179023d59e0:/# cd webwml
root@a179023d59e0:/webwml# cat /var/log/apt/history.log | grep Commandline
Commandline: apt-get install -y build-essential vim gettext make perl wml git wget libxml-rss-perl
root@a179023d59e0:/webwml# git reset --hard
HEAD is now at c28ce7bbd78 (fr) DSA 4223-4225, initial translation
root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1 USE_SAMPLE_FILES=1
make: Entering directory '/webwml/turkish'
make -C po install
make[1]: Entering directory '/webwml/turkish/po'
msgmerge -q templates.tr.po ../../english/po/templates.pot | \
            msgfmt --statistics -o templates.mo -
91 translated messages, 16 fuzzy translations, 12 untranslated messages.
'templates.mo' -> '../../locale/tr/LC_MESSAGES/templates.mo'
msgmerge -q bugs.tr.po ../../english/po/bugs.pot | \
            msgfmt --statistics -o bugs.mo -
34 translated messages.
'bugs.mo' -> '../../locale/tr/LC_MESSAGES/bugs.mo'
msgmerge -q blends.tr.po ../../english/po/blends.pot | \
            msgfmt --statistics -o blends.mo -
0 translated messages, 18 untranslated messages.
'blends.mo' -> '../../locale/tr/LC_MESSAGES/blends.mo'
msgmerge -q cdimage.tr.po ../../english/po/cdimage.pot | \
            msgfmt --statistics -o cdimage.mo -
26 translated messages.
'cdimage.mo' -> '../../locale/tr/LC_MESSAGES/cdimage.mo'
msgmerge -q consultants.tr.po ../../english/po/consultants.pot | \
            msgfmt --statistics -o consultants.mo -
15 translated messages.
'consultants.mo' -> '../../locale/tr/LC_MESSAGES/consultants.mo'
msgmerge -q countries.tr.po ../../english/po/countries.pot | \
            msgfmt --statistics -o countries.mo -
104 translated messages.
'countries.mo' -> '../../locale/tr/LC_MESSAGES/countries.mo'
msgmerge -q date.tr.po ../../english/po/date.pot | \
            msgfmt --statistics -o date.mo -
38 translated messages.
'date.mo' -> '../../locale/tr/LC_MESSAGES/date.mo'
msgmerge -q distrib.tr.po ../../english/po/distrib.pot | \
            msgfmt --statistics -o distrib.mo -
46 translated messages.
'distrib.mo' -> '../../locale/tr/LC_MESSAGES/distrib.mo'
msgmerge -q doc.tr.po ../../english/po/doc.pot | \
            msgfmt --statistics -o doc.mo -
16 translated messages, 2 fuzzy translations, 14 untranslated messages.
'doc.mo' -> '../../locale/tr/LC_MESSAGES/doc.mo'
msgmerge -q l10n.tr.po ../../english/po/l10n.pot | \
            msgfmt --statistics -o l10n.mo -
21 translated messages.
'l10n.mo' -> '../../locale/tr/LC_MESSAGES/l10n.mo'
msgmerge -q langs.tr.po ../../english/po/langs.pot | \
            msgfmt --statistics -o langs.mo -
86 translated messages.
'langs.mo' -> '../../locale/tr/LC_MESSAGES/langs.mo'
msgmerge -q legal.tr.po ../../english/po/legal.pot | \
            msgfmt --statistics -o legal.mo -
25 translated messages.
'legal.mo' -> '../../locale/tr/LC_MESSAGES/legal.mo'
msgmerge -q mailinglists.tr.po ../../english/po/mailinglists.pot | \
            msgfmt --statistics -o mailinglists.mo -
20 translated messages.
'mailinglists.mo' -> '../../locale/tr/LC_MESSAGES/mailinglists.mo'
msgmerge -q newsevents.tr.po ../../english/po/newsevents.pot | \
            msgfmt --statistics -o newsevents.mo -
24 translated messages, 7 fuzzy translations, 37 untranslated messages.
'newsevents.mo' -> '../../locale/tr/LC_MESSAGES/newsevents.mo'
msgmerge -q organization.tr.po ../../english/po/organization.pot | \
            msgfmt --statistics -o organization.mo -
49 translated messages, 17 fuzzy translations, 22 untranslated messages.
'organization.mo' -> '../../locale/tr/LC_MESSAGES/organization.mo'
msgmerge -q partners.tr.po ../../english/po/partners.pot | \
            msgfmt --statistics -o partners.mo -
0 translated messages, 62 untranslated messages.
'partners.mo' -> '../../locale/tr/LC_MESSAGES/partners.mo'
msgmerge -q ports.tr.po ../../english/po/ports.pot | \
            msgfmt --statistics -o ports.mo -
26 translated messages.
'ports.mo' -> '../../locale/tr/LC_MESSAGES/ports.mo'
msgmerge -q security.tr.po ../../english/po/security.pot | \
            msgfmt --statistics -o security.mo -
25 translated messages, 1 untranslated message.
'security.mo' -> '../../locale/tr/LC_MESSAGES/security.mo'
msgmerge -q stats.tr.po ../../english/po/stats.pot | \
            msgfmt --statistics -o stats.mo -
0 translated messages, 53 untranslated messages.
'stats.mo' -> '../../locale/tr/LC_MESSAGES/stats.mo'
msgmerge -q vendors.tr.po ../../english/po/vendors.pot | \
            msgfmt --statistics -o vendors.mo -
13 translated messages.
'vendors.mo' -> '../../locale/tr/LC_MESSAGES/vendors.mo'
msgmerge -q vote.tr.po ../../english/po/vote.pot | \
            msgfmt --statistics -o vote.mo -
13 translated messages, 4 fuzzy translations, 46 untranslated messages.
'vote.mo' -> '../../locale/tr/LC_MESSAGES/vote.mo'
msgmerge -q wnpp.tr.po ../../english/po/wnpp.pot | \
            msgfmt --statistics -o wnpp.mo -
16 translated messages, 11 fuzzy translations, 2 untranslated messages.
'wnpp.mo' -> '../../locale/tr/LC_MESSAGES/wnpp.mo'
msgmerge -q others.tr.po ../../english/po/others.pot | \
            msgfmt --statistics -o others.mo -
48 translated messages, 10 fuzzy translations, 17 untranslated messages.
'others.mo' -> '../../locale/tr/LC_MESSAGES/others.mo'
make[1]: Leaving directory '/webwml/turkish/po'
(cd ./.. && ./build_vcs_cache.pl)
Initialising VCS cache for performance
 ... done
wml -q -D CUR_YEAR=2019 -o UNDEFuTR:social_contract.tr.html@g+w   social_contract.wml
wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml
wml -q -D CUR_YEAR=2019 -o UNDEFuTR:support.tr.html@g+w   support.wml
wml -q -D CUR_YEAR=2019 -o UNDEFuTR:social_contract.1.0.tr.html@g+w   social_contract.1.0.wml
make -C CD
make[1]: Entering directory '/webwml/turkish/CD'
wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml -I ../../english/CD/
make -C http-ftp
make[2]: Entering directory '/webwml/turkish/CD/http-ftp'
make[2]: *** No rule to make target '../../../english/CD/http-ftp/cdimage_mirrors.list', needed by 'index.tr.html'.  Stop.
make[2]: Leaving directory '/webwml/turkish/CD/http-ftp'
make[1]: *** [../../Makefile.common:79: http-ftp] Error 2
make[1]: Leaving directory '/webwml/turkish/CD'
make: *** [../Makefile.common:79: CD] Error 2
make: Leaving directory '/webwml/turkish'

On Sat, Apr 6, 2019 at 3:56 PM Laura Arjona Reina <[hidden email]> wrote:
Dear Turkish Translation team,

While working on rebuilding the Debian website [1] within stretch and
buster, Cyril Brulebois detected that the Turkish subdirectory doesn't
build in buster, apparently due to possible locale issues.

[1] https://salsa.debian.org/webmaster-team/webwml

The .wmlrc file in that folder orders to build the site using the tr_TR
locale:

turkish/.wmlrc:-D CUR_LOCALE=tr_TR

But Perl complains about that:

     wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml
     ePerl:Error: Perl runtime error (interpreter rc=0)

     ---- Contents of STDERR channel: ---------
     Locale 'tr_TR' may not work well.
     The following characters (and maybe others) may not have the same
meaning as the Perl program expects:
     I i
     ; codeset=ISO-8859-9
     ------------------------------------------
     ** WML:Break: Error in Pass 3 (rc=1).

More details on bug report #924365

https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=924365

I've done a "file" command on all the .po and .wml files in the /turkish
folder of the website and all of them seem to be UTF-8 encoded
(charset=utf-8), so I guess it's safe to change the .wmlrc file to tell
the site to build using tr_TR.UTF-8 locale.

Could you confirm?

Kind regards,
--
Laura Arjona Reina
https://wiki.debian.org/LauraArjona

Reply | Threaded
Open this post in threaded view
|

Re: Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

Laura Arjona Reina-4
Hello Ömer

To avoid such errors you need to make the english folder first, I think

make -j1 -C english STRICT_ERROR_CHECKS=1 USE_SAMPLE_FILES=1

and then

make -j1 -C turkish STRICT_ERROR_CHECKS=1 USE_SAMPLE_FILES=1

I cannot reproduce the error in Stretch, the error happens only in Buster.

Kind regards,


El 7/4/19 a las 6:26, Omer Ozarslan escribió:

> Hello Laura,
>
> I'm not sure if I missed some steps, but I couldn't reproduce this
> issue. Yet, I hit another one:
>
> [snipped]
>
> root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1
> USE_SAMPLE_FILES=1
> make: Entering directory '/webwml/turkish'
> make -C po install
> make[1]: Entering directory '/webwml/turkish/po'
> make[1]: Leaving directory '/webwml/turkish/po'
> make -C CD
> make[1]: Entering directory '/webwml/turkish/CD'
> make -C http-ftp
> make[2]: Entering directory '/webwml/turkish/CD/http-ftp'
> make[2]: *** No rule to make target
> '../../../english/CD/http-ftp/cdimage_mirrors.list', needed by
> 'index.tr.html'.  Stop.
> make[2]: Leaving directory '/webwml/turkish/CD/http-ftp'
> make[1]: *** [../../Makefile.common:79: http-ftp] Error 2
> make[1]: Leaving directory '/webwml/turkish/CD'
> make: *** [../Makefile.common:79: CD] Error 2
> make: Leaving directory '/webwml/turkish'
>
> Here is the verbose part I snipped for convenience:
>
> root@a179023d59e0:/# cd webwml
> root@a179023d59e0:/webwml# cat /var/log/apt/history.log | grep Commandline
> Commandline: apt-get install -y build-essential vim gettext make perl
> wml git wget libxml-rss-perl
> root@a179023d59e0:/webwml# git reset --hard
> HEAD is now at c28ce7bbd78 (fr) DSA 4223-4225, initial translation
> root@a179023d59e0:/webwml# make -j1 -C turkish STRICT_ERROR_CHECKS=1
> USE_SAMPLE_FILES=1
> make: Entering directory '/webwml/turkish'
> make -C po install
> make[1]: Entering directory '/webwml/turkish/po'
> msgmerge -q templates.tr.po ../../english/po/templates.pot | \
>             msgfmt --statistics -o templates.mo -
> 91 translated messages, 16 fuzzy translations, 12 untranslated messages.
> 'templates.mo' -> '../../locale/tr/LC_MESSAGES/templates.mo'
> msgmerge -q bugs.tr.po ../../english/po/bugs.pot | \
>             msgfmt --statistics -o bugs.mo -
> 34 translated messages.
> 'bugs.mo' -> '../../locale/tr/LC_MESSAGES/bugs.mo'
> msgmerge -q blends.tr.po ../../english/po/blends.pot | \
>             msgfmt --statistics -o blends.mo -
> 0 translated messages, 18 untranslated messages.
> 'blends.mo' -> '../../locale/tr/LC_MESSAGES/blends.mo'
> msgmerge -q cdimage.tr.po ../../english/po/cdimage.pot | \
>             msgfmt --statistics -o cdimage.mo -
> 26 translated messages.
> 'cdimage.mo' -> '../../locale/tr/LC_MESSAGES/cdimage.mo'
> msgmerge -q consultants.tr.po ../../english/po/consultants.pot | \
>             msgfmt --statistics -o consultants.mo -
> 15 translated messages.
> 'consultants.mo' -> '../../locale/tr/LC_MESSAGES/consultants.mo'
> msgmerge -q countries.tr.po ../../english/po/countries.pot | \
>             msgfmt --statistics -o countries.mo -
> 104 translated messages.
> 'countries.mo' -> '../../locale/tr/LC_MESSAGES/countries.mo'
> msgmerge -q date.tr.po ../../english/po/date.pot | \
>             msgfmt --statistics -o date.mo -
> 38 translated messages.
> 'date.mo' -> '../../locale/tr/LC_MESSAGES/date.mo'
> msgmerge -q distrib.tr.po ../../english/po/distrib.pot | \
>             msgfmt --statistics -o distrib.mo -
> 46 translated messages.
> 'distrib.mo' -> '../../locale/tr/LC_MESSAGES/distrib.mo'
> msgmerge -q doc.tr.po ../../english/po/doc.pot | \
>             msgfmt --statistics -o doc.mo -
> 16 translated messages, 2 fuzzy translations, 14 untranslated messages.
> 'doc.mo' -> '../../locale/tr/LC_MESSAGES/doc.mo'
> msgmerge -q l10n.tr.po ../../english/po/l10n.pot | \
>             msgfmt --statistics -o l10n.mo -
> 21 translated messages.
> 'l10n.mo' -> '../../locale/tr/LC_MESSAGES/l10n.mo'
> msgmerge -q langs.tr.po ../../english/po/langs.pot | \
>             msgfmt --statistics -o langs.mo -
> 86 translated messages.
> 'langs.mo' -> '../../locale/tr/LC_MESSAGES/langs.mo'
> msgmerge -q legal.tr.po ../../english/po/legal.pot | \
>             msgfmt --statistics -o legal.mo -
> 25 translated messages.
> 'legal.mo' -> '../../locale/tr/LC_MESSAGES/legal.mo'
> msgmerge -q mailinglists.tr.po ../../english/po/mailinglists.pot | \
>             msgfmt --statistics -o mailinglists.mo -
> 20 translated messages.
> 'mailinglists.mo' -> '../../locale/tr/LC_MESSAGES/mailinglists.mo'
> msgmerge -q newsevents.tr.po ../../english/po/newsevents.pot | \
>             msgfmt --statistics -o newsevents.mo -
> 24 translated messages, 7 fuzzy translations, 37 untranslated messages.
> 'newsevents.mo' -> '../../locale/tr/LC_MESSAGES/newsevents.mo'
> msgmerge -q organization.tr.po ../../english/po/organization.pot | \
>             msgfmt --statistics -o organization.mo -
> 49 translated messages, 17 fuzzy translations, 22 untranslated messages.
> 'organization.mo' -> '../../locale/tr/LC_MESSAGES/organization.mo'
> msgmerge -q partners.tr.po ../../english/po/partners.pot | \
>             msgfmt --statistics -o partners.mo -
> 0 translated messages, 62 untranslated messages.
> 'partners.mo' -> '../../locale/tr/LC_MESSAGES/partners.mo'
> msgmerge -q ports.tr.po ../../english/po/ports.pot | \
>             msgfmt --statistics -o ports.mo -
> 26 translated messages.
> 'ports.mo' -> '../../locale/tr/LC_MESSAGES/ports.mo'
> msgmerge -q security.tr.po ../../english/po/security.pot | \
>             msgfmt --statistics -o security.mo -
> 25 translated messages, 1 untranslated message.
> 'security.mo' -> '../../locale/tr/LC_MESSAGES/security.mo'
> msgmerge -q stats.tr.po ../../english/po/stats.pot | \
>             msgfmt --statistics -o stats.mo -
> 0 translated messages, 53 untranslated messages.
> 'stats.mo' -> '../../locale/tr/LC_MESSAGES/stats.mo'
> msgmerge -q vendors.tr.po ../../english/po/vendors.pot | \
>             msgfmt --statistics -o vendors.mo -
> 13 translated messages.
> 'vendors.mo' -> '../../locale/tr/LC_MESSAGES/vendors.mo'
> msgmerge -q vote.tr.po ../../english/po/vote.pot | \
>             msgfmt --statistics -o vote.mo -
> 13 translated messages, 4 fuzzy translations, 46 untranslated messages.
> 'vote.mo' -> '../../locale/tr/LC_MESSAGES/vote.mo'
> msgmerge -q wnpp.tr.po ../../english/po/wnpp.pot | \
>             msgfmt --statistics -o wnpp.mo -
> 16 translated messages, 11 fuzzy translations, 2 untranslated messages.
> 'wnpp.mo' -> '../../locale/tr/LC_MESSAGES/wnpp.mo'
> msgmerge -q others.tr.po ../../english/po/others.pot | \
>             msgfmt --statistics -o others.mo -
> 48 translated messages, 10 fuzzy translations, 17 untranslated messages.
> 'others.mo' -> '../../locale/tr/LC_MESSAGES/others.mo'
> make[1]: Leaving directory '/webwml/turkish/po'
> (cd ./.. && ./build_vcs_cache.pl <http://build_vcs_cache.pl>)
> Initialising VCS cache for performance
>  ... done
> wml -q -D CUR_YEAR=2019 -o UNDEFuTR:social_contract.tr.html@g+w  
> social_contract.wml
> wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml
> wml -q -D CUR_YEAR=2019 -o UNDEFuTR:support.tr.html@g+w   support.wml
> wml -q -D CUR_YEAR=2019 -o UNDEFuTR:social_contract.1.0.tr.html@g+w  
> social_contract.1.0.wml
> make -C CD
> make[1]: Entering directory '/webwml/turkish/CD'
> wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml -I
> ../../english/CD/
> make -C http-ftp
> make[2]: Entering directory '/webwml/turkish/CD/http-ftp'
> make[2]: *** No rule to make target
> '../../../english/CD/http-ftp/cdimage_mirrors.list', needed by
> 'index.tr.html'.  Stop.
> make[2]: Leaving directory '/webwml/turkish/CD/http-ftp'
> make[1]: *** [../../Makefile.common:79: http-ftp] Error 2
> make[1]: Leaving directory '/webwml/turkish/CD'
> make: *** [../Makefile.common:79: CD] Error 2
> make: Leaving directory '/webwml/turkish'
>
> On Sat, Apr 6, 2019 at 3:56 PM Laura Arjona Reina <[hidden email]
> <mailto:[hidden email]>> wrote:
>
>     Dear Turkish Translation team,
>
>     While working on rebuilding the Debian website [1] within stretch and
>     buster, Cyril Brulebois detected that the Turkish subdirectory doesn't
>     build in buster, apparently due to possible locale issues.
>
>     [1] https://salsa.debian.org/webmaster-team/webwml
>
>     The .wmlrc file in that folder orders to build the site using the tr_TR
>     locale:
>
>     turkish/.wmlrc:-D CUR_LOCALE=tr_TR
>
>     But Perl complains about that:
>
>          wml -q -D CUR_YEAR=2019 -o UNDEFuTR:index.tr.html@g+w   index.wml
>          ePerl:Error: Perl runtime error (interpreter rc=0)
>
>          ---- Contents of STDERR channel: ---------
>          Locale 'tr_TR' may not work well.
>          The following characters (and maybe others) may not have the same
>     meaning as the Perl program expects:
>          I i
>          ; codeset=ISO-8859-9
>          ------------------------------------------
>          ** WML:Break: Error in Pass 3 (rc=1).
>
>     More details on bug report #924365
>
>     https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=924365
>
>     I've done a "file" command on all the .po and .wml files in the /turkish
>     folder of the website and all of them seem to be UTF-8 encoded
>     (charset=utf-8), so I guess it's safe to change the .wmlrc file to tell
>     the site to build using tr_TR.UTF-8 locale.
>
>     Could you confirm?
>
>     Kind regards,
>     --
>     Laura Arjona Reina
>     https://wiki.debian.org/LauraArjona
>

--
Laura Arjona Reina
https://wiki.debian.org/LauraArjona

Reply | Threaded
Open this post in threaded view
|

Re: Bug#924365: www.debian.org: FTBFS in buster: turkish vs. tr_TR locale

Omer Ozarslan
Hi Laura,

I tried it again after building english directory first, but I still didn't see any errors. I attached Dockerfile and its build output as well.

Nevertheless, I didn't spot any significant changes in translation text after changing locale to tr_TR.UTF-8 as Cyril suggested. So, there shouldn't be any issues with changing it. I attached the diff as well.

Best,
Ömer

ps. Thanks for accents in your salutation. It felt good to see those dots over my initial unexpectedly. :-)


webwml.Dockerfile (1K) Download Attachment
docker-build.log.gz (151K) Download Attachment
tr.diff (111K) Download Attachment