org.apache.parquet.column.impl

Class ColumnWriteStoreV1

java.lang.Object

org.apache.parquet.column.impl.ColumnWriteStoreV1

All Implemented Interfaces:

AutoCloseable, ColumnWriteStore

public class ColumnWriteStoreV1
extends Object

Constructor Summary

Constructors

Constructor and Description
ColumnWriteStoreV1(MessageType schema, PageWriteStore pageWriteStore, BloomFilterWriteStore bloomFilterWriteStore, ParquetProperties props)
ColumnWriteStoreV1(MessageType schema, PageWriteStore pageWriteStore, ParquetProperties props)
ColumnWriteStoreV1(PageWriteStore pageWriteStore, ParquetProperties props) Deprecated.

Method Summary

Modifier and Type	Method and Description
void	close() Close the related output stream and release any resources
void	endRecord() called to notify of record boundaries
void	flush() when we are done writing to flush to the underlying storage
long	getAllocatedSize() used for information
long	getBufferedSize() used to flush row groups to disk
Set<ColumnDescriptor>	getColumnDescriptors()
ColumnWriter	getColumnWriter(ColumnDescriptor path)
boolean	isColumnFlushNeeded() Returns whether flushing the possibly cached values (or nulls) to the underlying column writers is necessary, because the pages might be closed after the next invocation of ColumnWriteStore.endRecord().
long	maxColMemSize()
String	memUsageString() used for debugging purpose
String	toString()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

ColumnWriteStoreV1

public ColumnWriteStoreV1(MessageType schema,
                          PageWriteStore pageWriteStore,
                          ParquetProperties props)

ColumnWriteStoreV1

@Deprecated
public ColumnWriteStoreV1(PageWriteStore pageWriteStore,
                                      ParquetProperties props)

Deprecated.

ColumnWriteStoreV1

public ColumnWriteStoreV1(MessageType schema,
                          PageWriteStore pageWriteStore,
                          BloomFilterWriteStore bloomFilterWriteStore,
                          ParquetProperties props)

Method Detail

getColumnWriter

public ColumnWriter getColumnWriter(ColumnDescriptor path)

Specified by:

getColumnWriter in interface ColumnWriteStore

Parameters:

path - the column for which to create a writer

Returns:

the column writer for the given column

getColumnDescriptors

public Set<ColumnDescriptor> getColumnDescriptors()

toString

public String toString()

Overrides:

toString in class Object

getAllocatedSize

public long getAllocatedSize()

Description copied from interface: ColumnWriteStore

used for information

Specified by:

getAllocatedSize in interface ColumnWriteStore

Returns:

approximate size used in memory

getBufferedSize

public long getBufferedSize()

Description copied from interface: ColumnWriteStore

used to flush row groups to disk

Specified by:

getBufferedSize in interface ColumnWriteStore

Returns:

approximate size of the buffered encoded binary data

flush

public void flush()

Description copied from interface: ColumnWriteStore

when we are done writing to flush to the underlying storage

Specified by:

flush in interface ColumnWriteStore

memUsageString

public String memUsageString()

Description copied from interface: ColumnWriteStore

used for debugging purpose

Specified by:

memUsageString in interface ColumnWriteStore

Returns:

a formated string representing memory usage per column

maxColMemSize

public long maxColMemSize()

close

public void close()

Description copied from interface: ColumnWriteStore

Close the related output stream and release any resources

Specified by:

close in interface AutoCloseable

Specified by:

close in interface ColumnWriteStore

endRecord

public void endRecord()

Description copied from interface: ColumnWriteStore

called to notify of record boundaries

Specified by:

endRecord in interface ColumnWriteStore

isColumnFlushNeeded

public boolean isColumnFlushNeeded()

Description copied from interface: ColumnWriteStore

Returns whether flushing the possibly cached values (or nulls) to the underlying column writers is necessary, because the pages might be closed after the next invocation of ColumnWriteStore.endRecord().

Specified by:

isColumnFlushNeeded in interface ColumnWriteStore

Returns:

true if all the values shall be written to the underlying column writers before calling ColumnWriteStore.endRecord()