public class CLikeLanguageTokenizer extends LanguageTokenizer
CLikeLanguageTokenizer class parses a text into
"tokens". The text should represent a program of C,
C++, or Java.| 修飾子とタイプ | フィールドと説明 |
|---|---|
static Set |
CKeywords
The keywords of the C language.
|
static Set |
CPPKeywords
The keywords of the C++ language.
|
static Set |
JavaKeywords
The keywords of the Java language.
|
protected int |
keywordBegin |
protected int |
keywordEnd |
protected Set |
keywords |
COMMENT, CONSTANT, EOT, inMultiLineComment, inMultiLineConstant, KEYWORD, MULTILINE_COMMENT, MULTILINE_CONSTANT, OTHER, tokenBegin, tokenEnd| コンストラクタと説明 |
|---|
CLikeLanguageTokenizer(Text text,
int begin,
int end)
Construct a
CLikeLanguageTokenizer with the specified
text and range. |
| 修飾子とタイプ | メソッドと説明 |
|---|---|
boolean |
isCMode()
Checks if this tokenizer parses the C language.
|
boolean |
isCPPMode()
Checks if this tokenizer parses the C++ language.
|
boolean |
isJavaMode()
Checks if this tokenizer parses the Java language.
|
int |
nextToken()
Parses the next token from the text of this tokenizer.
|
void |
setCMode()
Makes this tokenizer parse the C language.
|
void |
setCPPMode()
Makes this tokenizer parse the C++ language.
|
void |
setJavaMode()
Makes this tokenizer parse the Java language.
|
getPosition, getPreferredParseBegin, getPreferredParseEnd, isDigit, isLetter, isLetterOrDigit, isLowerLetter, peek, pushBack, read, setPositionclone, current, equals, first, getBeginIndex, getEndIndex, getIndex, getText, hashCode, last, next, previous, setIndexprotected Set keywords
protected int keywordBegin
protected int keywordEnd
public static final Set JavaKeywords
public static final Set CKeywords
public static final Set CPPKeywords
public CLikeLanguageTokenizer(Text text, int begin, int end)
CLikeLanguageTokenizer with the specified
text and range.text - the text to be parsed.begin - the beginning index to parse, inclusive.end - the ending index to parse, exclusive.public boolean isJavaMode()
setJavaMode()public void setJavaMode()
isJavaMode()public boolean isCMode()
setCMode()public void setCMode()
isCMode()public boolean isCPPMode()
setCPPMode()public void setCPPMode()
isCPPMode()public int nextToken()
nextToken クラス内 LanguageTokenizerLanguageTokenizer.EOT,
LanguageTokenizer.OTHER,
LanguageTokenizer.KEYWORD,
LanguageTokenizer.CONSTANT,
LanguageTokenizer.MULTILINE_CONSTANT,
LanguageTokenizer.COMMENT,
LanguageTokenizer.MULTILINE_COMMENT