- canRead - Variable in class org.kitesdk.data.spi.AbstractRefinableView
-
- canRead(Schema, Schema) - Static method in class org.kitesdk.data.spi.SchemaValidationUtil
-
- canReplace(T) - Method in interface org.kitesdk.data.spi.Replaceable
-
Check whether part can be replaced.
- canWrite - Variable in class org.kitesdk.data.spi.AbstractRefinableView
-
- CharSequences - Class in org.kitesdk.data.spi
-
- CharSequences() - Constructor for class org.kitesdk.data.spi.CharSequences
-
- CharSequences.ImmutableCharSequenceSet - Class in org.kitesdk.data.spi
-
- CharSequences.ImmutableCharSequenceSet(Object...) - Constructor for class org.kitesdk.data.spi.CharSequences.ImmutableCharSequenceSet
-
- CharSequences.ImmutableCharSequenceSet(Iterable<? extends CharSequence>) - Constructor for class org.kitesdk.data.spi.CharSequences.ImmutableCharSequenceSet
-
- check(boolean, String, Object...) - Static method in exception org.kitesdk.data.DatasetRecordException
-
- check(boolean, String, Object...) - Static method in exception org.kitesdk.data.IncompatibleSchemaException
-
- check(String, String, DatasetDescriptor) - Static method in class org.kitesdk.data.spi.Compatibility
-
Checks the name and descriptor for known compatibility issues and throws an
exception if an incompatibility is found.
- check(boolean, String, Object...) - Static method in exception org.kitesdk.data.ValidationException
-
- checkAndWarn(String, String, Schema) - Static method in class org.kitesdk.data.spi.Compatibility
-
Checks the name and schema for known compatibility issues and warns.
- checkCompatible(DatasetDescriptor, DatasetDescriptor) - Static method in class org.kitesdk.data.spi.Compatibility
-
- checkDatasetName(String, String) - Static method in class org.kitesdk.data.spi.Compatibility
-
Precondition-style validation that a dataset name is compatible.
- checkDescriptor(DatasetDescriptor) - Static method in class org.kitesdk.data.spi.Compatibility
-
Precondition-style validation that the DatasetDescriptor is compatible.
- checkPartitionedBy(DatasetDescriptor, String) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
- checkSchema(Schema) - Static method in class org.kitesdk.data.spi.Compatibility
-
Precondition-style validation that a
Schema is compatible.
- checkSchemaForRead() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- checkSchemaForWrite() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- checkStrategyUpdate(PartitionStrategy, PartitionStrategy, Schema) - Static method in class org.kitesdk.data.spi.Compatibility
-
- checkTypeConsistency(Schema, String, Object...) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Checks that the type of each of values is consistent with the type of
field fieldName declared in the Avro schema (from descriptor).
- checkTypeConsistency(Schema, PartitionStrategy, String, Object...) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Checks that the type of each of values is consistent with the type of
field fieldName declared in the Avro schema (from descriptor).
- checkUpdate(DatasetDescriptor, DatasetDescriptor) - Static method in class org.kitesdk.data.spi.Compatibility
-
- close() - Method in interface org.kitesdk.data.DatasetReader
-
Close the reader and release any system resources.
- close() - Method in interface org.kitesdk.data.DatasetWriter
-
Close the writer and release any system resources.
- close() - Method in class org.kitesdk.data.spi.AbstractKeyRecordReaderWrapper
-
- close() - Method in class org.kitesdk.data.spi.FilteredRecordReader
-
- column(String, String, String) - Method in class org.kitesdk.data.ColumnMapping.Builder
-
Adds a mapping to store the record field name in a column using
the family and qualifier.
- column(String, String, String) - Static method in class org.kitesdk.data.FieldMapping
-
- ColumnMapping - Class in org.kitesdk.data
-
A descriptor for an entity's column mappings, which defines how an entity
maps to a columnar store.
- columnMapping(ColumnMapping) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's column mapping descriptor (optional)
- columnMapping(File) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's column mapping descriptor from a File.
- columnMapping(InputStream) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's column mapping descriptor from an InputStream.
- ColumnMapping.Builder - Class in org.kitesdk.data
-
- ColumnMapping.Builder() - Constructor for class org.kitesdk.data.ColumnMapping.Builder
-
- columnMappingLiteral(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's column mappings from a String literal.
- ColumnMappingParser - Class in org.kitesdk.data.spi
-
- ColumnMappingParser() - Constructor for class org.kitesdk.data.spi.ColumnMappingParser
-
- columnMappingUri(URI) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's column mappings from a URI.
- columnMappingUri(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's column mappings from a String URI.
- comparator - Variable in class org.kitesdk.data.spi.AbstractRefinableView
-
- compare(CharSequence, CharSequence) - Static method in class org.kitesdk.data.spi.CharSequences
-
- compare(Marker, Marker) - Method in class org.kitesdk.data.spi.MarkerComparator
-
- compare(MarkerRange.Boundary, MarkerRange.Boundary) - Method in class org.kitesdk.data.spi.MarkerRange.Boundary.LeftComparator
-
- compare(MarkerRange.Boundary, MarkerRange.Boundary) - Method in class org.kitesdk.data.spi.MarkerRange.Boundary.RightComparator
-
- compareTo(MarkerRange.Boundary) - Method in class org.kitesdk.data.spi.MarkerRange.Boundary
-
- compareTo(StorageKey) - Method in class org.kitesdk.data.spi.StorageKey
-
- Compatibility - Class in org.kitesdk.data.spi
-
Methods for checking compatibility.
- Compatibility() - Constructor for class org.kitesdk.data.spi.Compatibility
-
- complement() - Method in class org.kitesdk.data.spi.MarkerRange
-
- CompressionType - Enum in org.kitesdk.data
-
Contains constant definitions for the standard compression types we support.
- compressionType(CompressionType) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's compression format (optional).
- compressionType(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's compression format (optional).
- ConcurrentSchemaModificationException - Exception in org.kitesdk.data
-
Exception thrown when a schema modification collides with
another client trying to modify the schema of the same
dataset.
- ConcurrentSchemaModificationException(String) - Constructor for exception org.kitesdk.data.ConcurrentSchemaModificationException
-
- ConcurrentSchemaModificationException(Throwable) - Constructor for exception org.kitesdk.data.ConcurrentSchemaModificationException
-
- ConcurrentSchemaModificationException(String, Throwable) - Constructor for exception org.kitesdk.data.ConcurrentSchemaModificationException
-
- constraints - Variable in class org.kitesdk.data.spi.AbstractRefinableView
-
- Constraints - Class in org.kitesdk.data.spi
-
A set of simultaneous constraints.
- Constraints(Schema) - Constructor for class org.kitesdk.data.spi.Constraints
-
- Constraints(Schema, PartitionStrategy) - Constructor for class org.kitesdk.data.spi.Constraints
-
- Constraints.KeyPredicate - Class in org.kitesdk.data.spi
-
A
Predicate for testing a
StorageKey against a set of
predicates.
- construct(Map<String, String>) - Method in class org.kitesdk.data.spi.URIPattern
-
Constructs a
URI that matches this pattern from the given options.
- contains(Object) - Method in class org.kitesdk.data.spi.CharSequences.ImmutableCharSequenceSet
-
- contains(Marker, Marker) - Method in class org.kitesdk.data.spi.MarkerComparator
-
Returns true if container contains test, false otherwise.
- contains(Marker) - Method in class org.kitesdk.data.spi.MarkerRange
-
- Conversions - Class in org.kitesdk.data.spi
-
Static helper methods for converting between types.
- Conversions() - Constructor for class org.kitesdk.data.spi.Conversions
-
- convert(Object, Class<T>) - Static method in class org.kitesdk.data.spi.Conversions
-
- convert(Object, Schema) - Static method in class org.kitesdk.data.spi.Conversions
-
- convertToAvro(GenericData, JsonNode, Schema) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- copy(Schema.Field) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Creates a new field with the same name, schema, doc, and default value as
the incoming schema.
- copy(StorageKey) - Static method in class org.kitesdk.data.spi.StorageKey
-
A convenience method to make a copy of a
StorageKey.
- counter(String, String, String) - Method in class org.kitesdk.data.ColumnMapping.Builder
-
Adds a counter mapping to store record field name in a column
using the family and qualifier.
- counter(String, String, String) - Static method in class org.kitesdk.data.FieldMapping
-
- create(URI, DatasetDescriptor, Class<E>) - Static method in class org.kitesdk.data.Datasets
-
Create a
Dataset for the given dataset or view URI.
- create(URI, DatasetDescriptor) - Static method in class org.kitesdk.data.Datasets
-
Create a
Dataset for the given dataset or view URI.
- create(String, DatasetDescriptor, Class<E>) - Static method in class org.kitesdk.data.Datasets
-
Create a
Dataset for the given dataset or view URI string.
- create(String, DatasetDescriptor) - Static method in class org.kitesdk.data.Datasets
-
Create a
Dataset for the given dataset or view URI string.
- create(String, String, DatasetDescriptor) - Method in class org.kitesdk.data.spi.AbstractDatasetRepository
-
- create(String, String, DatasetDescriptor) - Method in interface org.kitesdk.data.spi.DatasetRepository
-
/**
Create a
Dataset with the supplied
descriptor.
- create(String, String, DatasetDescriptor, Class<E>) - Method in interface org.kitesdk.data.spi.DatasetRepository
-
Create a
Dataset with the supplied
descriptor.
- create(String, String, DatasetDescriptor) - Method in interface org.kitesdk.data.spi.MetadataProvider
-
Create a DatasetDescriptor for the dataset named name.
- createRecord(Class<E>, Schema) - Static method in class org.kitesdk.data.spi.DataModelUtil
-
If E implements GenericRecord, but does not implement SpecificRecord, then
create a new instance of E using reflection so that GenericDataumReader
will use the expected type.
- CSV - Static variable in class org.kitesdk.data.Formats
-
CSV: comma-separated values (read-only).
- DataModelUtil - Class in org.kitesdk.data.spi
-
Utilities for determining the appropriate data model at runtime.
- DataModelUtil() - Constructor for class org.kitesdk.data.spi.DataModelUtil
-
- Dataset<E> - Interface in org.kitesdk.data
-
A logical representation of a set of data entities.
- dataset - Variable in class org.kitesdk.data.spi.AbstractRefinableView
-
- dataset(String) - Method in class org.kitesdk.data.URIBuilder
-
Sets the dataset name that is used to construct the dataset URI.
- DATASET_NAME_OPTION - Static variable in class org.kitesdk.data.URIBuilder
-
- DATASET_SCHEME - Static variable in class org.kitesdk.data.URIBuilder
-
- DatasetDescriptor - Class in org.kitesdk.data
-
The structural definition of a
Dataset.
- DatasetDescriptor(Schema, URL, Format, URI, Map<String, String>, PartitionStrategy) - Constructor for class org.kitesdk.data.DatasetDescriptor
-
- DatasetDescriptor(Schema, URL, Format, URI, Map<String, String>, PartitionStrategy, ColumnMapping) - Constructor for class org.kitesdk.data.DatasetDescriptor
-
- DatasetDescriptor(Schema, URI, Format, URI, Map<String, String>, PartitionStrategy, ColumnMapping, CompressionType) - Constructor for class org.kitesdk.data.DatasetDescriptor
-
- DatasetDescriptor.Builder - Class in org.kitesdk.data
-
- DatasetDescriptor.Builder() - Constructor for class org.kitesdk.data.DatasetDescriptor.Builder
-
- DatasetDescriptor.Builder(DatasetDescriptor) - Constructor for class org.kitesdk.data.DatasetDescriptor.Builder
-
Creates a Builder configured to copy descriptor, if it is not
modified.
- DatasetException - Exception in org.kitesdk.data
-
Exception thrown for dataset-related failures.
- DatasetException() - Constructor for exception org.kitesdk.data.DatasetException
-
- DatasetException(String) - Constructor for exception org.kitesdk.data.DatasetException
-
- DatasetException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetException
-
- DatasetException(Throwable) - Constructor for exception org.kitesdk.data.DatasetException
-
- DatasetExistsException - Exception in org.kitesdk.data
-
Exception thrown when trying to create a dataset that already exists.
- DatasetExistsException(String) - Constructor for exception org.kitesdk.data.DatasetExistsException
-
- DatasetExistsException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetExistsException
-
- DatasetExistsException(Throwable) - Constructor for exception org.kitesdk.data.DatasetExistsException
-
- DatasetIOException - Exception in org.kitesdk.data
-
Exception thrown for dataset IO-related failures.
- DatasetIOException(String, IOException) - Constructor for exception org.kitesdk.data.DatasetIOException
-
- DatasetNotFoundException - Exception in org.kitesdk.data
-
Exception thrown to indicate that a dataset was not found.
- DatasetNotFoundException(String) - Constructor for exception org.kitesdk.data.DatasetNotFoundException
-
- DatasetNotFoundException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetNotFoundException
-
- DatasetNotFoundException(Throwable) - Constructor for exception org.kitesdk.data.DatasetNotFoundException
-
- DatasetOperationException - Exception in org.kitesdk.data
-
DatasetException thrown when an implementation-specific step fails
and prevents a dataset operation from completing successfully.
- DatasetOperationException(String, Object...) - Constructor for exception org.kitesdk.data.DatasetOperationException
-
- DatasetOperationException(Throwable, String, Object...) - Constructor for exception org.kitesdk.data.DatasetOperationException
-
- DatasetOperationException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetOperationException
-
- DatasetReader<E> - Interface in org.kitesdk.data
-
A stream-oriented dataset reader.
- DatasetRecordException - Exception in org.kitesdk.data
-
A DatasetException that signals that an individual record has failed.
- DatasetRecordException(String) - Constructor for exception org.kitesdk.data.DatasetRecordException
-
- DatasetRecordException(String, Throwable) - Constructor for exception org.kitesdk.data.DatasetRecordException
-
- DatasetRepositories - Class in org.kitesdk.data.spi
-
- DatasetRepositories() - Constructor for class org.kitesdk.data.spi.DatasetRepositories
-
- DatasetRepository - Interface in org.kitesdk.data.spi
-
A logical repository (storage system) of
Datasets.
- Datasets - Class in org.kitesdk.data
-
Methods for working with
Dataset instances.
- Datasets() - Constructor for class org.kitesdk.data.Datasets
-
- datasets(String) - Method in interface org.kitesdk.data.spi.DatasetRepository
-
List the names of the
Datasets in a namespace in this
DatasetRepository.
- datasets(String) - Method in interface org.kitesdk.data.spi.MetadataProvider
-
List the dataset names managed by this MetadataProvider in the
given namespace.
- DatasetWriter<E> - Interface in org.kitesdk.data
-
A stream-oriented dataset writer.
- dateFormat(String, String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner that applies a custom date format to a timestamp
field.
- day(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner for extracting the day from a timestamp field.
- day(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner for extracting the day from a timestamp field.
- DefaultConfiguration - Class in org.kitesdk.data.spi
-
- DefaultConfiguration() - Constructor for class org.kitesdk.data.spi.DefaultConfiguration
-
- delegate - Variable in class org.kitesdk.data.spi.AbstractKeyRecordReaderWrapper
-
- delete(URI) - Static method in class org.kitesdk.data.Datasets
-
Delete a
Dataset identified by the given dataset URI.
- delete(String) - Static method in class org.kitesdk.data.Datasets
-
Delete a
Dataset identified by the given dataset URI string.
- delete(Key) - Method in interface org.kitesdk.data.RandomAccessDataset
-
Deletes the entity in the dataset with
Key key.
- delete(E) - Method in interface org.kitesdk.data.RandomAccessDataset
-
Deletes the entity passed to this method in the dataset.
- delete(String, String) - Method in interface org.kitesdk.data.spi.DatasetRepository
-
- delete(String, String) - Method in interface org.kitesdk.data.spi.MetadataProvider
-
Delete all metadata associated with the dataset named name.
- delete() - Method in interface org.kitesdk.data.spi.TemporaryDatasetRepository
-
Deletes this temporary repository, removing all data and metadata.
- deleteAll() - Method in interface org.kitesdk.data.PartitionView
-
Deletes the entities included in this
View.
- deleteAll() - Method in class org.kitesdk.data.spi.AbstractDataset
-
- deleteAll() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- deleteAll() - Method in interface org.kitesdk.data.View
-
- DescriptorUtil - Class in org.kitesdk.data.spi
-
- DescriptorUtil() - Constructor for class org.kitesdk.data.spi.DescriptorUtil
-
- dropPartition(PartitionKey) - Method in interface org.kitesdk.data.spi.PartitionedDataset
-
- get(int) - Method in class org.kitesdk.data.Key
-
Returns the value for index.
- get(Key) - Method in interface org.kitesdk.data.RandomAccessDataset
-
Return the entity stored in the dataset at the row specified with
Key key.
- get() - Static method in class org.kitesdk.data.spi.DefaultConfiguration
-
- get(E, String) - Method in class org.kitesdk.data.spi.EntityAccessor
-
- get(E, Iterable<Schema.Field>) - Method in class org.kitesdk.data.spi.EntityAccessor
-
- get(String) - Method in class org.kitesdk.data.spi.Marker
-
Returns the value for name.
- get(int) - Method in class org.kitesdk.data.spi.Pair
-
- get(int) - Method in class org.kitesdk.data.spi.PartitionKey
-
Return the value at the specified index in the key.
- get(String) - Method in class org.kitesdk.data.spi.StorageKey
-
- get(int) - Method in class org.kitesdk.data.spi.StorageKey
-
Returns the value for index.
- get(PartitionStrategy, String) - Static method in class org.kitesdk.data.spi.TimeDomain
-
- getAccessor() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getAs(String, Class<T>) - Method in class org.kitesdk.data.spi.Marker
-
Returns the value for name coerced to the given type, T.
- getBound() - Method in class org.kitesdk.data.spi.MarkerRange.Boundary
-
- getCardinality() - Method in class org.kitesdk.data.PartitionStrategy
-
Return the cardinality produced by the contained field partitioners.
- getCardinality() - Method in class org.kitesdk.data.spi.FieldPartitioner
-
- getClassForType(Schema.Type) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
- getColumnMapping() - Method in class org.kitesdk.data.DatasetDescriptor
-
- getCompressionType() - Method in class org.kitesdk.data.DatasetDescriptor
-
- getConf() - Method in class org.kitesdk.data.spi.HadoopFileSystemURLStreamHandler
-
- getConstraints() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getCoveringPartitions() - Method in class org.kitesdk.data.spi.AbstractDataset
-
- getCoveringPartitions() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getCoveringPartitions() - Method in interface org.kitesdk.data.View
-
Returns an
Iterable of non-overlapping
View objects that
partition the underlying
Dataset and cover this
View.
- getCurrentKey() - Method in class org.kitesdk.data.spi.FilteredRecordReader
-
- getCurrentValue() - Method in class org.kitesdk.data.spi.AbstractKeyRecordReaderWrapper
-
- getCurrentValue() - Method in class org.kitesdk.data.spi.FilteredRecordReader
-
- getDataModelForType(Class<E>) - Static method in class org.kitesdk.data.spi.DataModelUtil
-
Get the data model for the given type.
- getDataset() - Method in class org.kitesdk.data.spi.AbstractDataset
-
- getDataset() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getDataset() - Method in interface org.kitesdk.data.View
-
Returns the underlying
Dataset for the
View.
- getDatumReaderForType(Class<E>, Schema) - Static method in class org.kitesdk.data.spi.DataModelUtil
-
Get the DatumReader for the given type.
- getDefault() - Static method in class org.kitesdk.data.impl.Accessor
-
- getDefaultCompressionType() - Method in class org.kitesdk.data.Format
-
- getDefaultConf() - Static method in class org.kitesdk.data.spi.HadoopFileSystemURLStreamHandler
-
- getDescriptor() - Method in interface org.kitesdk.data.Dataset
-
- getEnd() - Method in class org.kitesdk.data.spi.MarkerRange
-
- getExtension() - Method in class org.kitesdk.data.Format
-
Get the extension for use in filenames.
- getFamily() - Method in class org.kitesdk.data.FieldMapping
-
- getFamilyAsString() - Method in class org.kitesdk.data.FieldMapping
-
- getFieldMapping(String) - Method in class org.kitesdk.data.ColumnMapping
-
- getFieldMappings() - Method in class org.kitesdk.data.ColumnMapping
-
- getFieldName() - Method in class org.kitesdk.data.FieldMapping
-
- getFieldPartitioners(PartitionStrategy) - Method in class org.kitesdk.data.impl.Accessor
-
- getFormat() - Method in class org.kitesdk.data.DatasetDescriptor
-
Get the associated
Format the data is stored in.
- getFromOptions(Map<String, String>) - Method in interface org.kitesdk.data.spi.OptionBuilder
-
Build and return an instance of T configured from the given set of Options.
- getInputFormat(Configuration) - Method in interface org.kitesdk.data.spi.InputFormatAccessor
-
- getIOException() - Method in exception org.kitesdk.data.DatasetIOException
-
- getKeyPredicate() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getLastMatch() - Method in class org.kitesdk.data.spi.URIPattern
-
Returns the parsed results of the last matched URI.
- getLastModified() - Method in interface org.kitesdk.data.spi.LastModifiedAccessor
-
- getLength() - Method in class org.kitesdk.data.spi.PartitionKey
-
Return the number of values in the key.
- getLocation() - Method in class org.kitesdk.data.DatasetDescriptor
-
Get the URL location where the data for this
Dataset is stored
(optional).
- getLocation() - Method in interface org.kitesdk.data.PartitionView
-
Returns the location of this partition as a
URI.
- getMappingType() - Method in class org.kitesdk.data.FieldMapping
-
- getMatch(URI) - Method in class org.kitesdk.data.spi.URIPattern
-
Returns results from parsing a
URI with this pattern.
- getMatch(String) - Method in class org.kitesdk.data.spi.URIPattern
-
Returns results from parsing a
URI with this pattern.
- getName() - Method in enum org.kitesdk.data.CompressionType
-
Get the String name for this compression type.
- getName() - Method in interface org.kitesdk.data.Dataset
-
Get the name of a Dataset.
- getName() - Method in class org.kitesdk.data.Format
-
Get the format's name.
- getName() - Method in class org.kitesdk.data.spi.FieldPartitioner
-
- getNamespace() - Method in interface org.kitesdk.data.Dataset
-
Get the namespace that contains this Dataset.
- getPartition(PartitionKey, boolean) - Method in interface org.kitesdk.data.spi.PartitionedDataset
-
Get a partition for a
PartitionKey, optionally creating the
partition if it doesn't already exist.
- getPartitioner(PartitionStrategy, String) - Method in class org.kitesdk.data.impl.Accessor
-
- getPartitions() - Method in interface org.kitesdk.data.spi.PartitionedDataset
-
Return partitions.
- getPartitionStrategy() - Method in class org.kitesdk.data.DatasetDescriptor
-
- getPartitionStrategy() - Method in class org.kitesdk.data.spi.StorageKey
-
- getPartitionType(FieldPartitioner<S, T>, Schema) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
- getPath() - Method in class org.kitesdk.data.spi.StorageKey
-
- getPatternString() - Method in class org.kitesdk.data.spi.URIPattern
-
- getPrefix() - Method in class org.kitesdk.data.FieldMapping
-
- getProgress() - Method in class org.kitesdk.data.spi.AbstractKeyRecordReaderWrapper
-
- getProgress() - Method in class org.kitesdk.data.spi.FilteredRecordReader
-
- getProperty(String) - Method in class org.kitesdk.data.DatasetDescriptor
-
Get a named property.
- getProvidedValues() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getProvidedValues() - Method in class org.kitesdk.data.spi.Constraints
-
Returns a map of provided or fixed values for this constraint set.
- getQualifier() - Method in class org.kitesdk.data.FieldMapping
-
- getQualifierAsString() - Method in class org.kitesdk.data.FieldMapping
-
- getReaderSchema(Class<E>, Schema) - Static method in class org.kitesdk.data.spi.DataModelUtil
-
Get the reader schema based on the given type and writer schema.
- getReadSchema() - Method in class org.kitesdk.data.spi.EntityAccessor
-
- getRequiredColumnFamilies() - Method in class org.kitesdk.data.ColumnMapping
-
Get the column families required by this schema.
- getRequiredColumns() - Method in class org.kitesdk.data.ColumnMapping
-
Get the columns required by this schema.
- getSchema() - Method in class org.kitesdk.data.DatasetDescriptor
-
- getSchema() - Method in class org.kitesdk.data.spi.AbstractDataset
-
- getSchema() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getSchema() - Method in interface org.kitesdk.data.View
-
Get the schema of entities contained in this View.
- getSchemaUrl() - Method in class org.kitesdk.data.DatasetDescriptor
-
Get a URL from which the
Schema can be retrieved (optional).
- getScheme() - Method in class org.kitesdk.data.spi.URIPattern
-
- getSize() - Method in interface org.kitesdk.data.spi.SizeAccessor
-
- getSourceName() - Method in class org.kitesdk.data.spi.FieldPartitioner
-
- getSourceType() - Method in class org.kitesdk.data.spi.FieldPartitioner
-
The type of the source field, which is the type of the type expected by
the apply function.
- getSourceType(FieldPartitioner<S, ?>, Schema) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
- getStart() - Method in class org.kitesdk.data.spi.MarkerRange
-
- getSubpartitionStrategy(PartitionStrategy, int) - Method in class org.kitesdk.data.impl.Accessor
-
- getSupportedCompressionTypes() - Method in class org.kitesdk.data.Format
-
- getTemporaryRepository(String, String) - Method in interface org.kitesdk.data.spi.TemporaryDatasetRepositoryAccessor
-
- getType() - Method in class org.kitesdk.data.spi.AbstractDataset
-
- getType() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getType() - Method in class org.kitesdk.data.spi.EntityAccessor
-
- getType() - Method in class org.kitesdk.data.spi.FieldPartitioner
-
The type of the target field, which is the type of the return value of the
partition function.
- getType(Class<? extends S>) - Method in class org.kitesdk.data.spi.FieldPartitioner
-
The type of the target field, which is the type of the return value of the
partition function.
- getType() - Method in interface org.kitesdk.data.View
-
Get the runtime type of entities contained in this View.
- getUri() - Method in interface org.kitesdk.data.Dataset
-
Return a URI for this Dataset.
- getUri() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- getUri() - Method in interface org.kitesdk.data.spi.DatasetRepository
-
Return the
URI of this repository.
- getUri() - Method in interface org.kitesdk.data.View
-
Get a
URI that identifies this
View.
- getValues() - Method in class org.kitesdk.data.spi.PartitionKey
-
- getWriterSchema(Class<E>, Schema) - Static method in class org.kitesdk.data.spi.DataModelUtil
-
Get the writer schema based on the given type and dataset schema.
- getWriteSchema() - Method in class org.kitesdk.data.spi.EntityAccessor
-
- identity(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure an identity partitioner.
- identity(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure an identity partitioner.
- identity(String, int) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure an identity partitioner with a cardinality hint of
cardinalityHint.
- identity(String, String, int) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure an identity partitioner with a cardinality hint of
cardinalityHint.
- includes(E) - Method in class org.kitesdk.data.spi.AbstractDataset
-
- includes(E) - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- includes(E) - Method in interface org.kitesdk.data.View
-
Returns whether an entity
Object would be included in this
View if
it were present in the
Dataset.
- IncompatibleSchemaException - Exception in org.kitesdk.data
-
Exception thrown when a schema update is not compatible
with the previous schema (or schemas) or with existing
datasets (if shared storage is used, for example).
- IncompatibleSchemaException(String) - Constructor for exception org.kitesdk.data.IncompatibleSchemaException
-
- IncompatibleSchemaException(String, Throwable) - Constructor for exception org.kitesdk.data.IncompatibleSchemaException
-
- IncompatibleSchemaException(Throwable) - Constructor for exception org.kitesdk.data.IncompatibleSchemaException
-
- increment(Key, String, long) - Method in interface org.kitesdk.data.RandomAccessDataset
-
Increment a field named fieldName on the entity by the
specified amount.
- inferSchema(InputStream, String, int) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- inferSchema(JsonNode, String) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- inferSchemaWithMaps(JsonNode, String) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- init(Configuration) - Static method in class org.kitesdk.data.spi.DefaultConfiguration
-
Initialize the default Hadoop
Configuration if it has not been set.
- initialize(InputSplit, TaskAttemptContext) - Method in class org.kitesdk.data.spi.AbstractKeyRecordReaderWrapper
-
- initialize(InputSplit, TaskAttemptContext) - Method in class org.kitesdk.data.spi.FilteredRecordReader
-
- initialize() - Method in interface org.kitesdk.data.spi.InitializeAccessor
-
Prepare the reader or writer, allocating any necessary resources required
to produce entities.
- InitializeAccessor - Interface in org.kitesdk.data.spi
-
- INPUTFORMAT - Static variable in class org.kitesdk.data.Formats
-
INPUTFORMAT: a mapreduce InputFormat (read-only).
- InputFormatAccessor<E> - Interface in org.kitesdk.data.spi
-
This interface is for datasets or views that can provide a MapReduce InputFormat.
- intersection(MarkerRange) - Method in class org.kitesdk.data.spi.MarkerRange
-
- isAvroCompatibleName(String) - Static method in class org.kitesdk.data.spi.Compatibility
-
Returns true if the name does not contain characters that are known to be
incompatible with the specs defined in Avro schema.
- isColumnMapped() - Method in class org.kitesdk.data.DatasetDescriptor
-
Returns true if an associated dataset is column mapped (that is, has an
associated
ColumnMapping), false otherwise.
- isCompatibleName(String) - Static method in class org.kitesdk.data.spi.Compatibility
-
Returns true if the name does not contain characters that are known to be
incompatible with some projects, such as Hive or HBase.
- isConsistentWithExpectedType(Schema.Type, Class<?>) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Checks that a schema type should produce an object of the expected class.
- isConsistentWithMappingType(Schema.Type, FieldMapping.MappingType) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
- isDisabled(String, DatasetDescriptor) - Static method in class org.kitesdk.data.spi.DescriptorUtil
-
Returns whether the value of the descriptor property is false.
- isEmpty() - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- isEmpty() - Method in interface org.kitesdk.data.View
-
Check whether this
View contains any records.
- isEnabled(String, DatasetDescriptor) - Static method in class org.kitesdk.data.spi.DescriptorUtil
-
Returns whether the value of the descriptor property is true.
- isField(Schema, PartitionStrategy, String) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Return whether there is a field named name in the schema or
partition strategy.
- isGeneric(Class<?>) - Static method in class org.kitesdk.data.spi.DataModelUtil
-
- isGreaterThan(Marker) - Method in class org.kitesdk.data.spi.MarkerRange.Boundary
-
- isInclusive() - Method in class org.kitesdk.data.spi.MarkerRange.Boundary
-
- isLessThan(Marker) - Method in class org.kitesdk.data.spi.MarkerRange.Boundary
-
- isOpen() - Method in interface org.kitesdk.data.DatasetReader
-
- isOpen() - Method in interface org.kitesdk.data.DatasetWriter
-
- isPartitioned() - Method in class org.kitesdk.data.DatasetDescriptor
-
Returns true if an associated dataset is partitioned (that is, has an
associated
PartitionStrategy), false otherwise.
- isReady() - Method in interface org.kitesdk.data.Signalable
-
Returns true if the view's data is ready for consumption.
- isUnbounded() - Method in class org.kitesdk.data.spi.Constraints
-
Returns true if there are no constraints.
- iterator() - Method in class org.kitesdk.data.spi.AbstractDatasetReader
-
- iterator() - Method in class org.kitesdk.data.spi.CharSequences.ImmutableCharSequenceSet
-
- makeDouble(Object) - Static method in class org.kitesdk.data.spi.Conversions
-
- makeFloat(Object) - Static method in class org.kitesdk.data.spi.Conversions
-
- makeInteger(Object) - Static method in class org.kitesdk.data.spi.Conversions
-
- makeLong(Object) - Static method in class org.kitesdk.data.spi.Conversions
-
- makeString(Object) - Static method in class org.kitesdk.data.spi.Conversions
-
- makeString(Object, Integer) - Static method in class org.kitesdk.data.spi.Conversions
-
- map(Schema, T) - Method in class org.kitesdk.data.spi.SchemaUtil.SchemaVisitor
-
- Marker - Class in org.kitesdk.data.spi
-
A
Marker is a bookmark in the partition space, which is the space of
each possible partition in a
PartitionStrategy.
- Marker() - Constructor for class org.kitesdk.data.spi.Marker
-
- Marker.Builder - Class in org.kitesdk.data.spi
-
A fluent builder for creating Marker instances.
- Marker.Builder(Marker.ImmutableMarker) - Constructor for class org.kitesdk.data.spi.Marker.Builder
-
Constructs a Builder from the contents of a Marker.
- Marker.Builder(Marker.Builder) - Constructor for class org.kitesdk.data.spi.Marker.Builder
-
Constructs a Builder from the contents of another Builder.
- Marker.Builder(Map<String, Object>) - Constructor for class org.kitesdk.data.spi.Marker.Builder
-
Constructs a Builder from the contents of a Map.
- Marker.Builder(String, Object) - Constructor for class org.kitesdk.data.spi.Marker.Builder
-
A convenience constructor for a Builder with only one value.
- Marker.Builder() - Constructor for class org.kitesdk.data.spi.Marker.Builder
-
Constructs an empty Builder.
- MarkerComparator - Class in org.kitesdk.data.spi
-
- MarkerComparator(PartitionStrategy) - Constructor for class org.kitesdk.data.spi.MarkerComparator
-
- MarkerRange - Class in org.kitesdk.data.spi
-
Represents a range of concrete partitions.
- MarkerRange(MarkerComparator) - Constructor for class org.kitesdk.data.spi.MarkerRange
-
- MarkerRange.Boundary - Class in org.kitesdk.data.spi
-
Represents the boundary of a range, either inclusive or exclusive.
- MarkerRange.Boundary(MarkerComparator, Marker, boolean) - Constructor for class org.kitesdk.data.spi.MarkerRange.Boundary
-
- MarkerRange.Boundary.LeftComparator - Class in org.kitesdk.data.spi
-
- MarkerRange.Boundary.LeftComparator() - Constructor for class org.kitesdk.data.spi.MarkerRange.Boundary.LeftComparator
-
- MarkerRange.Boundary.RightComparator - Class in org.kitesdk.data.spi
-
- MarkerRange.Boundary.RightComparator() - Constructor for class org.kitesdk.data.spi.MarkerRange.Boundary.RightComparator
-
- MarkerRange.Builder - Class in org.kitesdk.data.spi
-
- MarkerRange.Builder(MarkerComparator) - Constructor for class org.kitesdk.data.spi.MarkerRange.Builder
-
- matches(URI) - Method in class org.kitesdk.data.spi.URIPattern
-
Returns true if the
URI matches this pattern.
- matches(String) - Method in class org.kitesdk.data.spi.URIPattern
-
Returns true if the
URI String matches this pattern.
- merge(T) - Method in interface org.kitesdk.data.spi.Mergeable
-
Merge the update object into this.
- merge(Iterable<Schema>) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Merges
Schema instances if they are compatible.
- merge(Schema, Schema) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Merges two
Schema instances if they are compatible.
- Mergeable<T> - Interface in org.kitesdk.data.spi
-
This interface is for classes that can merge updates into themselves in some
(undefined) way.
- mergeOrUnion(Iterable<Schema>) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Merges
Schema instances and creates a union of schemas if any are
incompatible.
- MetadataProvider - Interface in org.kitesdk.data.spi
-
A service provider interface for metadata system plugins.
- minute(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner for extracting the minute from a timestamp field.
- minute(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner for extracting the minute from a timestamp field.
- missing(MissingNode) - Method in class org.kitesdk.data.spi.JsonUtil.JsonTreeVisitor
-
- month(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner for extracting the month from a timestamp field.
- month(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner for extracting the month from a timestamp field.
- Pair<K,V> - Class in org.kitesdk.data.spi
-
- Pair(K, V) - Constructor for class org.kitesdk.data.spi.Pair
-
- PARQUET - Static variable in class org.kitesdk.data.Formats
-
- parse(String) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
Parses the Mapping Descriptor as a JSON string.
- parse(File) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
Parses the Mapping Descriptor from a File
- parse(InputStream) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
Parses the Mapping Descriptor from an input stream
- parse(String) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- parse(String, Class<T>) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- parse(File) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- parse(File, Class<T>) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- parse(InputStream) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- parse(InputStream, Class<T>) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- parse(String) - Static method in class org.kitesdk.data.spi.PartitionStrategyParser
-
Parses a PartitionStrategy from a JSON string.
- parse(File) - Static method in class org.kitesdk.data.spi.PartitionStrategyParser
-
Parses a PartitionStrategy from a File
- parse(InputStream) - Static method in class org.kitesdk.data.spi.PartitionStrategyParser
-
Parses a PartitionStrategy from an input stream
- parseFieldMapping(JsonNode) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
Parses the FieldMapping from an annotated schema field.
- parseFieldMapping(String, JsonNode) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
Parses the FieldMapping from an annotated schema field.
- parseFromSchema(Schema) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
- parseFromSchema(Schema) - Static method in class org.kitesdk.data.spi.PartitionStrategyParser
-
- parseFromSchemaFields(Schema) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
- parseKeyMappingsFromSchemaFields(Schema) - Static method in class org.kitesdk.data.spi.ColumnMappingParser
-
- parser(InputStream) - Static method in class org.kitesdk.data.spi.JsonUtil
-
- partitionAdded(String, String, String) - Method in interface org.kitesdk.data.spi.PartitionListener
-
- partitionDeleted(String, String, String) - Method in interface org.kitesdk.data.spi.PartitionListener
-
- PartitionedDataset<E> - Interface in org.kitesdk.data.spi
-
- partitionFieldSchema(FieldPartitioner<?, ?>, Schema) - Static method in class org.kitesdk.data.spi.SchemaUtil
-
Builds a Schema for the FieldPartitioner using the given Schema to
determine types not fixed by the FieldPartitioner.
- PartitionKey - Class in org.kitesdk.data.spi
-
A key for retrieving partitions from a
Dataset.
- PartitionKey(Object...) - Constructor for class org.kitesdk.data.spi.PartitionKey
-
- partitionKeyForEntity(PartitionStrategy, E, EntityAccessor<E>) - Static method in class org.kitesdk.data.spi.PartitionKey
-
Construct a partition key for the given entity.
- partitionKeyForEntity(PartitionStrategy, E, EntityAccessor<E>, PartitionKey) - Static method in class org.kitesdk.data.spi.PartitionKey
-
Construct a partition key for the given entity, reusing the supplied key if
not null.
- PartitionListener - Interface in org.kitesdk.data.spi
-
Callback interface for metadata providers to listen for a new partition being added
so they can act on it (e.g.
- partitionStrategy(PartitionStrategy) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's partitioning strategy (optional).
- partitionStrategy(File) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's partition strategy from a File.
- partitionStrategy(InputStream) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's partition strategy from an InputStream.
- PartitionStrategy - Class in org.kitesdk.data
-
The strategy used to determine how a dataset is partitioned.
- PartitionStrategy.Builder - Class in org.kitesdk.data
-
- PartitionStrategy.Builder() - Constructor for class org.kitesdk.data.PartitionStrategy.Builder
-
- partitionStrategyLiteral(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's partition strategy from a String literal.
- PartitionStrategyParser - Class in org.kitesdk.data.spi
-
Parses a PartitionStrategy from JSON representation.
- PartitionStrategyParser() - Constructor for class org.kitesdk.data.spi.PartitionStrategyParser
-
- partitionStrategyUri(URI) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's partition strategy from a URI.
- partitionStrategyUri(String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Configure the dataset's partition strategy from a String URI.
- PartitionView<E> - Interface in org.kitesdk.data
-
A
PartitionView is a subset of a
Dataset that corresponds to
a single partition, with a location.
- PASSWORD - Static variable in class org.kitesdk.data.spi.URIPattern
-
- PORT - Static variable in class org.kitesdk.data.spi.URIPattern
-
- POSITIVE_INFINITY - Static variable in class org.kitesdk.data.spi.MarkerRange.Boundary
-
- primitive(Schema) - Method in class org.kitesdk.data.spi.SchemaUtil.SchemaVisitor
-
- project(Schema, Class<T>) - Method in class org.kitesdk.data.spi.AbstractRefinableView
-
- project(Predicate<S>) - Method in class org.kitesdk.data.spi.FieldPartitioner
-
Projects a source-data constraint Predicate into the image of the
backing partition function.
- project(Predicate<Long>) - Method in class org.kitesdk.data.spi.TimeDomain
-
- projectStrict(Predicate<S>) - Method in class org.kitesdk.data.spi.FieldPartitioner
-
Projects a source-data constraint Predicate into the image of the
backing partition function.
- projectStrict(Predicate<Long>) - Method in class org.kitesdk.data.spi.TimeDomain
-
- property(String, String) - Method in class org.kitesdk.data.DatasetDescriptor.Builder
-
Add a key-value property to the descriptor.
- provided(String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner that uses values always provided at runtime.
- provided(String, String) - Method in class org.kitesdk.data.PartitionStrategy.Builder
-
Configure a partitioner that uses values always provided at runtime.
- put(E) - Method in interface org.kitesdk.data.RandomAccessDataset
-
Put the entity into the dataset.