Tokenizer (Apache Jena ARQ)

All Superinterfaces:

org.apache.jena.atlas.lib.Closeable, java.util.Iterator<Token>

All Known Implementing Classes:

PrintTokenizer, TokenizerJSON, TokenizerText, TokenizerWrapper
```
public interface Tokenizer
extends java.util.Iterator<Token>, org.apache.jena.atlas.lib.Closeable
```

Method Summary

All Methods Instance Methods Abstract Methods
Modifier and Type	Method	Description
`boolean`	`eof()`	End of tokens?
`long`	`getColumn()`
`long`	`getLine()`
`boolean`	`hasNext()`	Is there another token?
`Token`	`next()`	Move to next token
`Token`	`peek()`	Peek next token : null for no token.

Methods inherited from interface org.apache.jena.atlas.lib.Closeable
close

Methods inherited from interface java.util.Iterator
forEachRemaining, remove

- Method Detail
  - hasNext
```
boolean hasNext()
```
    Is there another token?
    
    Specified by:
    
    hasNext in interface java.util.Iterator<Token>
  - next
```
Token next()
```
    Move to next token
    
    Specified by:
    
    next in interface java.util.Iterator<Token>
  - peek
```
Token peek()
```
    Peek next token : null for no token.
  - eof
```
boolean eof()
```
    End of tokens?
  - getLine
```
long getLine()
```
  - getColumn
```
long getColumn()
```