Package org.apache.parquet.internal.filter2.columnindex

Class ColumnIndexFilter

java.lang.Object

org.apache.parquet.internal.filter2.columnindex.ColumnIndexFilter

All Implemented Interfaces:

FilterPredicate.Visitor<RowRanges>

public class ColumnIndexFilter
extends Object
implements FilterPredicate.Visitor<RowRanges>

Filter implementation based on column indexes. No filtering will be applied for columns where no column index is available. Offset index is required for all the columns in the projection, therefore a ColumnIndexStore.MissingOffsetIndexException will be thrown from any visit methods if any of the required offset indexes is missing.

Method Summary

Modifier and Type	Method	Description
static RowRanges	calculateRowRanges(FilterCompat.Filter filter, ColumnIndexStore columnIndexStore, Set<org.apache.parquet.hadoop.metadata.ColumnPath> paths, long rowCount)	Calculates the row ranges containing the indexes of the rows might match the specified filter.
RowRanges	visit(Operators.And and)
<T extends Comparable<T>> RowRanges	visit(Operators.Eq<T> eq)
<T extends Comparable<T>> RowRanges	visit(Operators.Gt<T> gt)
<T extends Comparable<T>> RowRanges	visit(Operators.GtEq<T> gtEq)
<T extends Comparable<T>> RowRanges	visit(Operators.In<T> in)
<T extends Comparable<T>,U extends UserDefinedPredicate<T>> RowRanges	visit(Operators.LogicalNotUserDefined<T,U> udp)
<T extends Comparable<T>> RowRanges	visit(Operators.Lt<T> lt)
<T extends Comparable<T>> RowRanges	visit(Operators.LtEq<T> ltEq)
RowRanges	visit(Operators.Not not)
<T extends Comparable<T>> RowRanges	visit(Operators.NotEq<T> notEq)
<T extends Comparable<T>> RowRanges	visit(Operators.NotIn<T> notIn)
RowRanges	visit(Operators.Or or)
<T extends Comparable<T>,U extends UserDefinedPredicate<T>> RowRanges	visit(Operators.UserDefined<T,U> udp)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

calculateRowRanges

public static RowRanges calculateRowRanges(FilterCompat.Filter filter,
                                           ColumnIndexStore columnIndexStore,
                                           Set<org.apache.parquet.hadoop.metadata.ColumnPath> paths,
                                           long rowCount)

Calculates the row ranges containing the indexes of the rows might match the specified filter.

Parameters:

filter - to be used for filtering the rows

columnIndexStore - the store for providing column/offset indexes

paths - the paths of the columns used in the actual projection; a column not being part of the projection will be handled as containing null values only even if the column has values written in the file

rowCount - the total number of rows in the row-group

Returns:

the ranges of the possible matching row indexes; the returned ranges will contain all the rows if any of the required offset index is missing

visit

public <T extends Comparable<T>> RowRanges visit(Operators.Eq<T> eq)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>> RowRanges visit(Operators.NotEq<T> notEq)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>> RowRanges visit(Operators.Lt<T> lt)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>> RowRanges visit(Operators.LtEq<T> ltEq)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>> RowRanges visit(Operators.Gt<T> gt)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>> RowRanges visit(Operators.GtEq<T> gtEq)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>> RowRanges visit(Operators.In<T> in)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>> RowRanges visit(Operators.NotIn<T> notIn)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>,U extends UserDefinedPredicate<T>> RowRanges visit(Operators.UserDefined<T,U> udp)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public <T extends Comparable<T>,U extends UserDefinedPredicate<T>> RowRanges visit(Operators.LogicalNotUserDefined<T,U> udp)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public RowRanges visit(Operators.And and)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public RowRanges visit(Operators.Or or)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>

visit

public RowRanges visit(Operators.Not not)

Specified by:

visit in interface FilterPredicate.Visitor<RowRanges>