clang::ast_matchers::dynamic::Parser::CodeTokenizer Class Reference

Simple tokenizer for the parser. More...

List of all members.

Public Member Functions
	CodeTokenizer (StringRef MatcherCode, Diagnostics *Error)
	CodeTokenizer (StringRef MatcherCode, Diagnostics *Error, unsigned CodeCompletionOffset)
const TokenInfo &	peekNextToken () const
	Returns but doesn't consume the next token.
TokenInfo	consumeNextToken ()
	Consumes and returns the next token.
TokenInfo::TokenKind	nextTokenKind () const

---

Detailed Description

Simple tokenizer for the parser.

Definition at line 58 of file ASTMatchers/Dynamic/Parser.cpp.

---

Constructor & Destructor Documentation

clang::ast_matchers::dynamic::Parser::CodeTokenizer::CodeTokenizer	(	StringRef	MatcherCode,
		Diagnostics *	Error
	)		[inline, explicit]

Definition at line 60 of file ASTMatchers/Dynamic/Parser.cpp.

clang::ast_matchers::dynamic::Parser::CodeTokenizer::CodeTokenizer	(	StringRef	MatcherCode,
		Diagnostics *	Error,
		unsigned	CodeCompletionOffset
	)		[inline]

Definition at line 66 of file ASTMatchers/Dynamic/Parser.cpp.

---

Member Function Documentation

TokenInfo clang::ast_matchers::dynamic::Parser::CodeTokenizer::consumeNextToken

(

)

[inline]

Consumes and returns the next token.

Definition at line 77 of file ASTMatchers/Dynamic/Parser.cpp.

TokenInfo::TokenKind clang::ast_matchers::dynamic::Parser::CodeTokenizer::nextTokenKind

(

)

const [inline]

Definition at line 83 of file ASTMatchers/Dynamic/Parser.cpp.

References clang::ast_matchers::dynamic::Parser::TokenInfo::Kind.

const TokenInfo& clang::ast_matchers::dynamic::Parser::CodeTokenizer::peekNextToken

(

)

const [inline]

Returns but doesn't consume the next token.

Definition at line 74 of file ASTMatchers/Dynamic/Parser.cpp.

Referenced by clang::ast_matchers::dynamic::Parser::parseExpression().

---

The documentation for this class was generated from the following file:

• ASTMatchers/Dynamic/Parser.cpp