LanguageTokenizer (kfc 1.2.0 API)

java.lang.Object
- jp.kyasu.graphics.TextCharacterIterator
- - jp.kyasu.awt.util.LanguageTokenizer

すべての実装されたインタフェース:

java.io.Serializable, java.lang.Cloneable, java.text.CharacterIterator

直系の既知のサブクラス:

CLikeLanguageTokenizer, SmalltalkTokenizer
```
public abstract class LanguageTokenizer
extends TextCharacterIterator
implements java.io.Serializable
```
The LangTokenizer class is an abstract base class for all objects that parse a text into "tokens". The text should represent a program.

関連項目:

直列化された形式

フィールドのサマリー

フィールド
修飾子とタイプ	フィールドと説明
`static int`	`COMMENT` A constant indicating that a comment token has been read.
`static int`	`CONSTANT` A constant indicating that a constant token has been read.
`static int`	`EOT` A constant indicating that the end of the array has been read.
`boolean`	`inMultiLineComment` True, if the parsing context is in the multiline comment.
`boolean`	`inMultiLineConstant` True, if the parsing context is in the multiline constant.
`static int`	`KEYWORD` A constant indicating that a keyword token has been read.
`static int`	`MULTILINE_COMMENT` A constant indicating that a multiline comment token has been read.
`static int`	`MULTILINE_CONSTANT` A constant indicating that a multiline constant token has been read.
`static int`	`OTHER` A constant indicating that a token has been read.
`int`	`tokenBegin` The beginning index of the token, inclusive.
`int`	`tokenEnd` The ending index of the token, exclusive.

クラスから継承されたフィールド jp.kyasu.graphics.TextCharacterIterator
array, begin, end, pos, text

インタフェースから継承されたフィールド java.text.CharacterIterator
DONE

コンストラクタのサマリー

コンストラクタ
コンストラクタと説明
`LanguageTokenizer(Text text, int begin, int end)` Construct a `LanguageTokenizer` with the specified text and range.

メソッドのサマリー

すべてのメソッド staticメソッドインスタンス・メソッド abstractメソッド concreteメソッド
修飾子とタイプ	メソッドと説明
`protected int`	`getPosition()`
`static int`	`getPreferredParseBegin(Text text, int tokenType, int tokenBegin, int changeBefore)` Returns the preferred beginning index to parse after the specified text has been changed.
`static int`	`getPreferredParseEnd(Text text, int tokenType, int tokenEnd, int changeAfter)` Returns the preferred ending index to parse after the specified text has been changed.
`protected boolean`	`isDigit(int c)`
`protected boolean`	`isLetter(int c)`
`protected boolean`	`isLetterOrDigit(int c)`
`protected boolean`	`isLowerLetter(int c)`
`abstract int`	`nextToken()` Parses the next token from the text of this tokenizer.
`protected int`	`peek()`
`protected void`	`pushBack()`
`protected int`	`read()`
`protected void`	`setPosition(int pos)`

クラスから継承されたメソッド jp.kyasu.graphics.TextCharacterIterator
clone, current, equals, first, getBeginIndex, getEndIndex, getIndex, getText, hashCode, last, next, previous, setIndex

クラスから継承されたメソッド java.lang.Object
finalize, getClass, notify, notifyAll, toString, wait, wait, wait

- フィールドの詳細
  - tokenBegin
```
public int tokenBegin
```
    The beginning index of the token, inclusive.
  - tokenEnd
```
public int tokenEnd
```
    The ending index of the token, exclusive.
  - inMultiLineConstant
```
public boolean inMultiLineConstant
```
    True, if the parsing context is in the multiline constant.
  - inMultiLineComment
```
public boolean inMultiLineComment
```
    True, if the parsing context is in the multiline comment.
  - EOT
```
public static final int EOT
```
    A constant indicating that the end of the array has been read.
    
    関連項目:
    
    定数フィールド値
  - OTHER
```
public static final int OTHER
```
    A constant indicating that a token has been read.
    
    関連項目:
    
    定数フィールド値
  - KEYWORD
```
public static final int KEYWORD
```
    A constant indicating that a keyword token has been read.
    
    関連項目:
    
    定数フィールド値
  - CONSTANT
```
public static final int CONSTANT
```
    A constant indicating that a constant token has been read.
    
    関連項目:
    
    定数フィールド値
  - MULTILINE_CONSTANT
```
public static final int MULTILINE_CONSTANT
```
    A constant indicating that a multiline constant token has been read.
    
    関連項目:
    
    定数フィールド値
  - COMMENT
```
public static final int COMMENT
```
    A constant indicating that a comment token has been read.
    
    関連項目:
    
    定数フィールド値
  - MULTILINE_COMMENT
```
public static final int MULTILINE_COMMENT
```
    A constant indicating that a multiline comment token has been read.
    
    関連項目:
    
    定数フィールド値
- コンストラクタの詳細
  - LanguageTokenizer
```
public LanguageTokenizer(Text text,
                         int begin,
                         int end)
```
    Construct a LanguageTokenizer with the specified text and range.
    
    パラメータ:
    
    text - the text to be parsed.
    
    begin - the beginning index to parse, inclusive.
    
    end - the ending index to parse, exclusive.
- メソッドの詳細
  - getPreferredParseBegin
```
public static int getPreferredParseBegin(Text text,
                                         int tokenType,
                                         int tokenBegin,
                                         int changeBefore)
```
    Returns the preferred beginning index to parse after the specified text has been changed.
    
    パラメータ:
    
    text - the text to be parsed.
    
    tokenType - the token type.
    
    tokenBegin - the beginning index of the token.
    
    changeBefore - the index before a change has been made.
  - getPreferredParseEnd
```
public static int getPreferredParseEnd(Text text,
                                       int tokenType,
                                       int tokenEnd,
                                       int changeAfter)
```
    Returns the preferred ending index to parse after the specified text has been changed.
    
    パラメータ:
    
    text - the text to be parsed.
    
    tokenType - the token type.
    
    tokenEnd - the ending index of the token.
    
    changeAfter - the index after a change has been made.
  - nextToken
```
public abstract int nextToken()
```
    Parses the next token from the text of this tokenizer.
    
    戻り値:
    
    the type of the token.
    
    関連項目:
    
    tokenBegin, tokenEnd, EOT, OTHER, KEYWORD, CONSTANT, MULTILINE_CONSTANT, COMMENT, MULTILINE_COMMENT
  - read
```
protected final int read()
```
  - peek
```
protected final int peek()
```
  - pushBack
```
protected final void pushBack()
```
  - getPosition
```
protected final int getPosition()
```
  - setPosition
```
protected final void setPosition(int pos)
```
  - isLowerLetter
```
protected final boolean isLowerLetter(int c)
```
  - isLetter
```
protected final boolean isLetter(int c)
```
  - isDigit
```
protected final boolean isDigit(int c)
```
  - isLetterOrDigit
```
protected final boolean isLetterOrDigit(int c)
```

クラス LanguageTokenizer

フィールドのサマリー

クラスから継承されたフィールド jp.kyasu.graphics.TextCharacterIterator

インタフェースから継承されたフィールド java.text.CharacterIterator

コンストラクタのサマリー

メソッドのサマリー

クラスから継承されたメソッド jp.kyasu.graphics.TextCharacterIterator

クラスから継承されたメソッド java.lang.Object

フィールドの詳細

tokenBegin

tokenEnd

inMultiLineConstant

inMultiLineComment

EOT

OTHER

KEYWORD

CONSTANT

MULTILINE_CONSTANT

COMMENT

MULTILINE_COMMENT

コンストラクタの詳細

LanguageTokenizer

メソッドの詳細

getPreferredParseBegin

getPreferredParseEnd

nextToken

read

peek

pushBack

getPosition

setPosition

isLowerLetter

isLetter

isDigit

isLetterOrDigit