glibc/localedata
Maciej W. Rozycki b692181703 stdio-common: Don't read real input beyond the field width in scanf
Fix a code pattern that repeats across '__vfscanf_internal' where the
remaining field width of 0 is incorrectly interpreted as no width limit,
which in turn results in reading input beyond the limit requested.  The
lack of width limit is indicated by the field width of -1 rather than 0,
set earlier on in the function.

The problematic code pattern is used for both integer and floating-point
conversions, but in the former case a corresponding conditional earlier
on prevents the field width from being 0 when executing the pattern.  It
does trigger in the latter case, where the decimal point is a multibyte
character or for multibyte digit characters.

Fix the code pattern by using 'width > 0' comparison, and apply the fix
throughout even to code handling integer conversions so as to interpret
the field width consistently and avoid people's confusion even if width
cannot be 0 at those places.

For multibyte digit characters there is an additional issue that causes
code to push back a partially fetched multibyte character multiple times
as execution proceeds through matching data retrieved against individual
digits that have to be rejected due to the field width limit preventing
the rest of the multibyte character from being retrieved.  It is because
code relies on 'ungetc' ignoring a request to push back EOF, however in
the out-of-limit field width condition the data held is not EOF but the
previously retrieved character byte instead.

Fix this issue by artificially assigning EOF to the character byte
storage variable where the out-of-limit field width condition prevents
further processing, and also apply the fix throughout except for the
decimal point/thousands separator case, which uses different code.

Add test cases accordingly.

Reviewed-by: Adhemerval Zanella <adhemerval.zanella@linaro.org>
2025-08-11 17:42:12 +01:00
..
charmaps Update to Unicode 16.0.0 [BZ #32168] 2024-09-27 14:43:38 +02:00
locales localedata: Add en_SE for ISO8601 dates 2025-08-08 17:53:13 +02:00
tests Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tests-mbwc localedata: Use hexadecimal character escape on tests 2024-12-22 13:01:08 +08:00
tst-fmon-locales
tst-localedef-hardlinks.root
unicode-gen Update copyright dates not handled by scripts/update-copyrights 2025-01-01 11:22:09 -08:00
C.UTF-8.in
Depend
Makefile stdio-common: Don't read real input beyond the field width in scanf 2025-08-11 17:42:12 +01:00
README
SUPPORTED localedata: Add en_SE for ISO8601 dates 2025-08-08 17:53:13 +02:00
am_ET.UTF-8.in
az_AZ.UTF-8.in
be_BY.UTF-8.in
ber_DZ.UTF-8.in
ber_MA.UTF-8.in
bg_BG.UTF-8.in
br_FR.UTF-8.in
bs_BA.UTF-8.in
bug-iconv-trans.c localedata: Use hexadecimal character escape on tests 2024-12-22 13:01:08 +08:00
bug-setlocale1-static.c
bug-setlocale1.c
bug-usesetlocale.c
ckb_IQ.UTF-8.in
cmn_TW.UTF-8.in
collate-test.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
crh_UA.UTF-8.in
cs_CZ.UTF-8.in
cs_CZ.in
csb_PL.UTF-8.in
cv_RU.UTF-8.in localedata: cv_RU: update translation 2024-05-23 14:39:35 +02:00
cy_GB.UTF-8.in
da_DK.ISO-8859-1.in
de_DE.ISO-8859-1.in
dsb_DE.UTF-8.in
dump-ctype.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
dz_BT.UTF-8.in
en_US.ISO-8859-1.in
en_US.UTF-8.in
eo.UTF-8.in
es_ES.UTF-8.in
et_EE.UTF-8.in
fa_IR.UTF-8.in
fi_FI.UTF-8.in
fil_PH.UTF-8.in
fr_CA.UTF-8.in
fr_FR.UTF-8.in
fur_IT.UTF-8.in
gen-locale.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
gez_ER.UTF-8@abegede.in
ha_NG.UTF-8.in
hr_HR.ISO-8859-2.in
hr_HR.UTF-8.in
hsb_DE.UTF-8.in
hu_HU.UTF-8.in
ig_NG.UTF-8.in
ik_CA.UTF-8.in
is_IS.UTF-8.in
kk_KZ.UTF-8.in
ku_TR.UTF-8.in
ky_KG.UTF-8.in
ln_CD.UTF-8.in
lt_LT.UTF-8.in
ltg_LV.UTF-8.in Define ISO 639-3 "ltg" (Latgalian) and add ltg_LV locale 2024-06-17 10:53:16 +02:00
lv_LV.UTF-8.in Change lv_LV collation to agree with the recent change in CLDR 2024-02-08 08:13:37 +01:00
mdf_RU.UTF-8.in localedata: add mdf_RU locale 2024-05-08 14:27:40 +02:00
mi_NZ.UTF-8.in
ml_IN.UTF-8.in
mn_MN.UTF-8.in
mr_IN.UTF-8.in
mt_MT.UTF-8.in
nan_TW.UTF-8@latin.in
nb_NO.UTF-8.in
om_KE.UTF-8.in
or_IN.UTF-8.in
os_RU.UTF-8.in
pl_PL.UTF-8.in
ps_AF.UTF-8.in
rif_MA.UTF-8.in
ro_RO.UTF-8.in
ru_RU.UTF-8.in
sah_RU.UTF-8.in
sc_IT.UTF-8.in
se_NO.UTF-8.in
show-ucs-data.c
si_LK.UTF-8.in
sort-test.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
sq_AL.UTF-8.in
sr_RS.UTF-8.in
sv_SE.ISO-8859-1.in
sv_SE.UTF-8.in
syr.UTF-8.in
szl_PL.UTF-8.in
tg_TJ.UTF-8.in
th_TH.UTF-8.in
tk_TM.UTF-8.in
tr_TR.UTF-8.in
tst-bz13988.c stdio-common: Also reject exp char w/o significand in i18n scanf [BZ #13988] 2025-03-28 12:35:53 +00:00
tst-c-utf8-consistency.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-ctype-de_DE.ISO-8859-1.in
tst-ctype.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-ctype.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-digits.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-fmon.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-fmon.data Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-fmon.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-iconv-emojis-trans.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-iconv-math-trans.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-langinfo-newlocale-static.c
tst-langinfo-newlocale.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-langinfo-setlocale-static.c
tst-langinfo-setlocale.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-langinfo-static.c
tst-langinfo.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-langinfo.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-leaks.c
tst-locale-loadlocale.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-locale.sh Correct spelling mistake in test file 2025-05-12 13:26:57 +02:00
tst-localedef-hardlinks.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-mbswcs1.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-mbswcs2.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-mbswcs3.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-mbswcs4.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-mbswcs5.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-mbswcs6.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-numeric.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-numeric.data Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-numeric.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-rpmatch.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-rpmatch.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-scanf-width-digit.c stdio-common: Don't read real input beyond the field width in scanf 2025-08-11 17:42:12 +01:00
tst-scanf-width-point.c stdio-common: Don't read real input beyond the field width in scanf 2025-08-11 17:42:12 +01:00
tst-setlocale.c
tst-setlocale2.c
tst-setlocale3.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-sscanf.c
tst-strfmon1.c
tst-trans.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-trans.sh Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-wctype.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
tst-wctype.input
tst-xlocale1.c localedata: Use hexadecimal character escape on tests 2024-12-22 13:01:08 +08:00
tst-xlocale2.c localedata: Use hexadecimal character escape on tests 2024-12-22 13:01:08 +08:00
tt_RU.UTF-8.in
tt_RU.UTF-8@iqtelif.in
ug_CN.UTF-8.in
uk_UA.UTF-8.in
uz_UZ.UTF-8.in
vi_VN.UTF-8.in
xfrm-test.c Update copyright dates with scripts/update-copyrights 2025-01-01 11:22:09 -08:00
yi_US.UTF-8.in
yo_NG.UTF-8.in
zh_CN.UTF-8.in

README

		       POSIX locale descriptions
				  and
		    POSIX character set descriptions

Ulrich Drepper			Time-stamp: <2004/11/27 13:06:54 drepper>
drepper@redhat.com


This directory contains the data needed to build the locale data files
to use the internationalization features of the GNU libc.

POSIX.2 describes the `localedef' utility which is part of the GNU libc.
You need this program to "compile" the locale description in a form
suitable for fast access by the GNU libc functions.  Any compilation is
based on a given character set.

Once you run `make install' for the GNU libc the data files are
automatically installed in the right place, ready for use by the
`localedef' program.

To compile the locale data files you simply have to decide which locale
(based on the location and the language) and which character set you
use.  E.g., French speaking Canadians would use the locale `fr_CA' and
the character set `ISO_8859-1,1987'.  Calling `localedef' to get the
desired data should happen like this:

	localedef -i fr_CA -f ISO-8859-1 fr_CA

This will place the 6 output files in the appropriate directory where
the GNU libc functions can find them.  Please note that you need
permission to write to this directory ($(prefix)/share/locale, where
$(prefix) is the value you specified while configuring GNU libc).  If
you do not have the necessary permissions, you can write the files into an
arbitrary directory by giving a path including a '/' character instead
of `fr_CA'.  E.g., to put the new files in a subdirectory of the
current directory simply use

	localedef -i fr_CA -f ISO-8859-1 ./fr_CA

How to use these data files is described in the GNU libc manual,
especially in the section describing the `setlocale' function.

All problems should be reported using

  https://sourceware.org/bugzilla/


One more note: the `POSIX' locale definition is not meant to be used
as an input file for `localedef'.  It is rather there to show the
values with are built in the libc binaries as default values when no
legal locale is found or the "C" or "POSIX" locale is selected.


		       The collation test suite
		       ########################

This package also contains a (beginning of a) test suite for the
collation functions in the GNU libc.  The files are provided sorted.
The test program shuffles the lines and sort them afterwards.

Some of the files are provided in 8bit form, i.e., not only ASCII
characters.  So the tools you use to process the files should be 8bit
clean.

To run the test program the appropriate locale information must be
installed.  Therefore the localedef program is used to generate this
data used the locale and charmap description files contained here.
Since we cannot run the localedef program in case of cross-compilation
no tests at all are performed.


~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Local Variables:
 mode:text
 eval:(load-library "time-stamp")
 eval:(make-local-variable 'write-file-hooks)
 eval:(add-hook 'write-file-hooks 'time-stamp)
 eval:(setq time-stamp-format '(time-stamp-yyyy/mm/dd time-stamp-hh:mm:ss user-login-name))
End: