org.apache.parquet.column.values.bytestreamsplit

Class ByteStreamSplitValuesWriter

java.lang.Object

org.apache.parquet.column.values.ValuesWriter

org.apache.parquet.column.values.bytestreamsplit.ByteStreamSplitValuesWriter

All Implemented Interfaces:

AutoCloseable

Direct Known Subclasses:

ByteStreamSplitValuesWriter.DoubleByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.FixedLenByteArrayByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.FloatByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.IntegerByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.LongByteStreamSplitValuesWriter

public abstract class ByteStreamSplitValuesWriter
extends ValuesWriter

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ByteStreamSplitValuesWriter.DoubleByteStreamSplitValuesWriter
static class	ByteStreamSplitValuesWriter.FixedLenByteArrayByteStreamSplitValuesWriter
static class	ByteStreamSplitValuesWriter.FloatByteStreamSplitValuesWriter
static class	ByteStreamSplitValuesWriter.IntegerByteStreamSplitValuesWriter
static class	ByteStreamSplitValuesWriter.LongByteStreamSplitValuesWriter

Field Summary

Fields

Modifier and Type	Field and Description
protected int	elementSizeInBytes
protected int	numStreams

Constructor Summary

Constructors

Constructor and Description
ByteStreamSplitValuesWriter(int elementSizeInBytes, int initialCapacity, int pageSize, ByteBufferAllocator allocator)

Method Summary

Modifier and Type	Method and Description
void	close() Called to close the values writer.
long	getAllocatedSize() ( > ValuesWriter.getBufferedSize() )
long	getBufferedSize() used to decide if we want to work to the next page
BytesInput	getBytes()
Encoding	getEncoding() called after getBytes() and before reset()
void	reset() called after getBytes() to reset the current buffer and start writing the next page
protected void	scatterBytes(byte[] bytes)

Methods inherited from class org.apache.parquet.column.values.ValuesWriter

memUsageString, resetDictionary, toDictPageAndClose, writeBoolean, writeByte, writeBytes, writeDouble, writeFloat, writeInteger, writeLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

numStreams

protected final int numStreams

elementSizeInBytes

protected final int elementSizeInBytes

Constructor Detail

ByteStreamSplitValuesWriter

public ByteStreamSplitValuesWriter(int elementSizeInBytes,
                                   int initialCapacity,
                                   int pageSize,
                                   ByteBufferAllocator allocator)

Method Detail

getBufferedSize

public long getBufferedSize()

Description copied from class: ValuesWriter

used to decide if we want to work to the next page

Specified by:

getBufferedSize in class ValuesWriter

Returns:

the size of the currently buffered data (in bytes)

getBytes

public BytesInput getBytes()

Specified by:

getBytes in class ValuesWriter

Returns:

the bytes buffered so far to write to the current page

getEncoding

public Encoding getEncoding()

Description copied from class: ValuesWriter

called after getBytes() and before reset()

Specified by:

getEncoding in class ValuesWriter

Returns:

the encoding that was used to encode the bytes

reset

public void reset()

Description copied from class: ValuesWriter

called after getBytes() to reset the current buffer and start writing the next page

Specified by:

reset in class ValuesWriter

close

public void close()

Description copied from class: ValuesWriter

Called to close the values writer. Any output stream is closed and can no longer be used. All resources are released.

Specified by:

close in interface AutoCloseable

Overrides:

close in class ValuesWriter

scatterBytes

protected void scatterBytes(byte[] bytes)

getAllocatedSize

public long getAllocatedSize()

Description copied from class: ValuesWriter

( > ValuesWriter.getBufferedSize() )

Specified by:

getAllocatedSize in class ValuesWriter

Returns:

the allocated size of the buffer