clang::comments::TextTokenRetokenizer Class Reference

Re-lexes a sequence of tok::text tokens. More...

List of all members.

Classes
struct	Position
	A position in Toks.
Public Member Functions
	TextTokenRetokenizer (llvm::BumpPtrAllocator &Allocator, Parser &P)
bool	lexWord (Token &Tok)
	Extract a word -- sequence of non-whitespace characters.
bool	lexDelimitedSeq (Token &Tok, char OpenDelim, char CloseDelim)
void	putBackLeftoverTokens ()
	Put back tokens that we didn't consume.

---

Detailed Description

Re-lexes a sequence of tok::text tokens.

Definition at line 31 of file CommentParser.cpp.

---

Constructor & Destructor Documentation

clang::comments::TextTokenRetokenizer::TextTokenRetokenizer	(	llvm::BumpPtrAllocator &	Allocator,
		Parser &	P
	)		[inline]

Definition at line 147 of file CommentParser.cpp.

---

Member Function Documentation

bool clang::comments::TextTokenRetokenizer::lexDelimitedSeq	(	Token &	Tok,
		char	OpenDelim,
		char	CloseDelim
	)		[inline]

Definition at line 187 of file CommentParser.cpp.

References AttributeLangSupport::C, clang::diag::Error, and Position.

Referenced by clang::comments::Parser::parseParamCommandArgs().

bool clang::comments::TextTokenRetokenizer::lexWord

(

Token &

Tok

)

[inline]

Extract a word -- sequence of non-whitespace characters.

Definition at line 154 of file CommentParser.cpp.

References AttributeLangSupport::C, clang::isWhitespace(), and Position.

Referenced by clang::comments::Parser::parseBlockCommandArgs(), clang::comments::Parser::parseInlineCommand(), clang::comments::Parser::parseParamCommandArgs(), and clang::comments::Parser::parseTParamCommandArgs().

void clang::comments::TextTokenRetokenizer::putBackLeftoverTokens

(

)

[inline]

Put back tokens that we didn't consume.

Definition at line 234 of file CommentParser.cpp.

Referenced by clang::comments::Parser::parseBlockCommand(), and clang::comments::Parser::parseInlineCommand().

---

The documentation for this class was generated from the following file:

• CommentParser.cpp