| Package | Description |
|---|---|
| org.kitesdk.data |
Provides interfaces and classes for reading and writing datasets.
|
| org.kitesdk.data.impl |
Provides internal implementation classes that are not part of the public API,
and which are not published in the Javadoc.
|
| org.kitesdk.data.spi |
Provides a service provider interface for implementors of Kite Data APIs.
|
| Modifier and Type | Method and Description |
|---|---|
PartitionStrategy |
PartitionStrategy.Builder.build()
Build a configured
PartitionStrategy instance. |
PartitionStrategy |
DatasetDescriptor.getPartitionStrategy()
Get the
PartitionStrategy, if this dataset is partitioned. |
| Modifier and Type | Method and Description |
|---|---|
DatasetDescriptor.Builder |
DatasetDescriptor.Builder.partitionStrategy(PartitionStrategy partitionStrategy)
Configure the dataset's partitioning strategy (optional).
|
| Constructor and Description |
|---|
DatasetDescriptor(Schema schema,
URI schemaUri,
Format format,
URI location,
Map<String,String> properties,
PartitionStrategy partitionStrategy,
ColumnMapping columnMapping,
CompressionType compressionType)
Create an instance of this class with the supplied
Schema, optional
URL, Format, optional location URL, optional
PartitionStrategy, optional ColumnMapping, and optional
CompressionType. |
DatasetDescriptor(Schema schema,
URL schemaUrl,
Format format,
URI location,
Map<String,String> properties,
PartitionStrategy partitionStrategy)
Create an instance of this class with the supplied
Schema,
optional URL, Format, optional location URL, and optional
PartitionStrategy. |
DatasetDescriptor(Schema schema,
URL schemaUrl,
Format format,
URI location,
Map<String,String> properties,
PartitionStrategy partitionStrategy,
ColumnMapping columnMapping)
Create an instance of this class with the supplied
Schema, optional
URL, Format, optional location URL, optional
PartitionStrategy, and optional ColumnMapping. |
| Modifier and Type | Method and Description |
|---|---|
abstract PartitionStrategy |
Accessor.fromExpression(String partitionExpression) |
abstract PartitionStrategy |
Accessor.getSubpartitionStrategy(PartitionStrategy partitionStrategy,
int startIndex) |
| Modifier and Type | Method and Description |
|---|---|
abstract List<FieldPartitioner> |
Accessor.getFieldPartitioners(PartitionStrategy partitionStrategy) |
abstract FieldPartitioner |
Accessor.getPartitioner(PartitionStrategy partitionStrategy,
String name) |
abstract PartitionStrategy |
Accessor.getSubpartitionStrategy(PartitionStrategy partitionStrategy,
int startIndex) |
abstract boolean |
Accessor.hasPartitioner(PartitionStrategy partitionStrategy,
String name) |
abstract String |
Accessor.toExpression(PartitionStrategy partitionStrategy) |
| Modifier and Type | Method and Description |
|---|---|
PartitionStrategy |
StorageKey.getPartitionStrategy() |
static PartitionStrategy |
PartitionStrategyParser.parse(File file)
Parses a PartitionStrategy from a File
|
static PartitionStrategy |
PartitionStrategyParser.parse(InputStream in)
Parses a PartitionStrategy from an input stream
|
static PartitionStrategy |
PartitionStrategyParser.parse(String json)
Parses a PartitionStrategy from a JSON string.
|
static PartitionStrategy |
PartitionStrategyParser.parseFromSchema(Schema schema) |
| Modifier and Type | Method and Description |
|---|---|
static void |
Compatibility.checkStrategyUpdate(PartitionStrategy existing,
PartitionStrategy other,
Schema schema) |
static void |
SchemaUtil.checkTypeConsistency(Schema schema,
PartitionStrategy strategy,
String fieldName,
Object... values)
Checks that the type of each of
values is consistent with the type of
field fieldName declared in the Avro schema (from descriptor). |
static Schema |
PartitionStrategyParser.embedPartitionStrategy(Schema schema,
PartitionStrategy strategy) |
static Schema |
SchemaUtil.fieldSchema(Schema schema,
PartitionStrategy strategy,
String name)
Returns a
Schema for the given field name, which could be either a
schema field or a partition field. |
static Constraints |
Constraints.fromQueryMap(Schema schema,
PartitionStrategy strategy,
Map<String,String> query) |
static TimeDomain |
TimeDomain.get(PartitionStrategy strategy,
String source) |
static boolean |
SchemaUtil.isField(Schema schema,
PartitionStrategy strategy,
String name)
Return whether there is a field named
name in the schema or
partition strategy. |
static Schema |
SchemaUtil.keySchema(Schema schema,
PartitionStrategy strategy)
|
static <E> PartitionKey |
PartitionKey.partitionKeyForEntity(PartitionStrategy strategy,
E entity,
EntityAccessor<E> accessor)
Construct a partition key for the given entity.
|
static <E> PartitionKey |
PartitionKey.partitionKeyForEntity(PartitionStrategy strategy,
E entity,
EntityAccessor<E> accessor,
PartitionKey reuseKey)
Construct a partition key for the given entity, reusing the supplied key if
not null.
|
static String |
PartitionStrategyParser.toString(PartitionStrategy strategy,
boolean pretty) |
| Constructor and Description |
|---|
Constraints(Schema schema,
PartitionStrategy strategy) |
MarkerComparator(PartitionStrategy strategy) |
StorageKey.Builder(PartitionStrategy strategy) |
StorageKey(PartitionStrategy strategy) |
TimeDomain(PartitionStrategy strategy,
String sourceName) |
Copyright © 2013–2015. All rights reserved.