Package org.apache.parquet.column.values.bytestreamsplit

Class ByteStreamSplitValuesWriter

java.lang.Object

org.apache.parquet.column.values.ValuesWriter

org.apache.parquet.column.values.bytestreamsplit.ByteStreamSplitValuesWriter

Direct Known Subclasses:

ByteStreamSplitValuesWriter.DoubleByteStreamSplitValuesWriter, ByteStreamSplitValuesWriter.FloatByteStreamSplitValuesWriter

public abstract class ByteStreamSplitValuesWriter
extends ValuesWriter

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ByteStreamSplitValuesWriter.DoubleByteStreamSplitValuesWriter
static class	ByteStreamSplitValuesWriter.FloatByteStreamSplitValuesWriter

Field Summary

Fields

Modifier and Type	Field	Description
protected int	elementSizeInBytes
protected int	numStreams

Constructor Summary

Constructors

Constructor	Description
ByteStreamSplitValuesWriter(int elementSizeInBytes, int initialCapacity, int pageSize, org.apache.parquet.bytes.ByteBufferAllocator allocator)

Method Summary

Modifier and Type	Method	Description
void	close()	Called to close the values writer.
long	getAllocatedSize()	( > ValuesWriter.getBufferedSize() )
long	getBufferedSize()	used to decide if we want to work to the next page
org.apache.parquet.bytes.BytesInput	getBytes()
Encoding	getEncoding()	called after getBytes() and before reset()
void	reset()	called after getBytes() to reset the current buffer and start writing the next page
protected void	scatterBytes(byte[] bytes)

Methods inherited from class org.apache.parquet.column.values.ValuesWriter

memUsageString, resetDictionary, toDictPageAndClose, writeBoolean, writeByte, writeBytes, writeDouble, writeFloat, writeInteger, writeLong

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

numStreams

protected final int numStreams

elementSizeInBytes

protected final int elementSizeInBytes

Constructor Detail

ByteStreamSplitValuesWriter

public ByteStreamSplitValuesWriter(int elementSizeInBytes,
                                   int initialCapacity,
                                   int pageSize,
                                   org.apache.parquet.bytes.ByteBufferAllocator allocator)

Method Detail

getBufferedSize

public long getBufferedSize()

Description copied from class: ValuesWriter

used to decide if we want to work to the next page

Specified by:

getBufferedSize in class ValuesWriter

Returns:

the size of the currently buffered data (in bytes)

getBytes

public org.apache.parquet.bytes.BytesInput getBytes()

Specified by:

getBytes in class ValuesWriter

Returns:

the bytes buffered so far to write to the current page

getEncoding

public Encoding getEncoding()

Description copied from class: ValuesWriter

called after getBytes() and before reset()

Specified by:

getEncoding in class ValuesWriter

Returns:

the encoding that was used to encode the bytes

reset

public void reset()

Description copied from class: ValuesWriter

called after getBytes() to reset the current buffer and start writing the next page

Specified by:

reset in class ValuesWriter

close

public void close()

Description copied from class: ValuesWriter

Called to close the values writer. Any output stream is closed and can no longer be used. All resources are released.

Overrides:

close in class ValuesWriter

scatterBytes

protected void scatterBytes(byte[] bytes)

getAllocatedSize

public long getAllocatedSize()

Description copied from class: ValuesWriter

( > ValuesWriter.getBufferedSize() )

Specified by:

getAllocatedSize in class ValuesWriter

Returns:

the allocated size of the buffer