This is an unofficial snapshot of the ISO/IEC JTC1 SC22 WG21
Core Issues List revision 112e.
See http://www.open-std.org/jtc1/sc22/wg21/ for the official
punctuator referenced but not defined
Section: 5.6 [lex.token]
Submitter: Richard Smith
The syntactic nonterminal punctuator appears in the grammar
for token in 5.6 [lex.token], but it is nowhere
defined. It should be merged with operator and given an
appropriate list of tokens as a definition for the merged term.
Proposed resolution (October, 2017):
Change 5.5 [lex.digraph] paragraph 2 as follows
In all respects of the language , each
alternative token behaves the same, respectively, as its primary token,
except for its spelling.18 The set of alternative tokens...
Change the grammar in 5.6 [lex.token] as follows:
Change 5.6 [lex.token] paragraph 1 as follows:
five kinds of tokens: identifiers,
keywords, literals,19 operators, and other separators
. Blanks, horizontal and vertical tabs, newlines,
formfeeds, and comments (collectively, “white space”), as
described below, are ignored except as they serve to separate
tokens. [Note: Some white space is required to separate otherwise
adjacent identifiers, keywords, numeric literals, and alternative tokens
containing alphabetic characters. —end note]
Delete the final sentence of 5.12 [lex.operators] paragraph 1.
Each preprocessing-op-or-punc is converted to a single token in
translation phase 7 (5.2 [lex.phases]).