Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##: Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  val BASE_METADATA_EXTRACTORS: Map[String, (PartitionedFile) => Any]

   All BASE_METADATA_FIELDS require custom extractors because they are derived directly from fields of the PartitionedFile, and do have entries in the file's metadata map.

5.  val BASE_METADATA_FIELDS: Seq[StructField]

   Schema of metadata struct that can be produced by every file format, metadata fields for every file format must be *not* nullable.

6.  val FILE_BLOCK_LENGTH: String
7.  val FILE_BLOCK_START: String
8.  val FILE_MODIFICATION_TIME: String
9.  val FILE_NAME: String
10.  val FILE_PATH: String
11.  val FILE_SIZE: String
12.  val METADATA_NAME: String
13.  val OPTION_RETURNING_BATCH: String

    Option to pass to buildReaderWithPartitionValues to return columnar batch output or not.

    Option to pass to buildReaderWithPartitionValues to return columnar batch output or not. For ParquetFileFormat and OrcFileFormat, passing this option is required. This should only be passed as true if it can actually be supported, which can be checked by calling supportBatch.

14.  final def asInstanceOf[T0]: T0

    Definition Classes

    Any

15.  def clone(): AnyRef

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.CloneNotSupportedException]) @native()

16.  def createMetadataInternalRow(partitionValues: InternalRow, fieldNames: Seq[String], filePath: SparkPath, fileSize: Long, fileModificationTime: Long): InternalRow
17.  final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

18.  def equals(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef → Any

19.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.Throwable])

20.  final def getClass(): Class[_ <: AnyRef]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

21.  def getFileConstantMetadataColumnValue(name: String, file: PartitionedFile, metadataExtractors: Map[String, (PartitionedFile) => Any]): Literal

    Extracts the Literal value of a file-constant metadata column from a PartitionedFile.

    Extracts the Literal value of a file-constant metadata column from a PartitionedFile.

    If an extractor is available, apply it. Otherwise, look up the column's name in the file's column value map and return the result (or null, if not found).

    Raw values (including null) are automatically converted to literals as a courtesy.

22.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

23.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

24.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

25.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

26.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

27.  final def synchronized[T0](arg0: => T0): T0

    Definition Classes

    AnyRef

28.  def toString(): String

    Definition Classes

    AnyRef → Any

29.  def updateMetadataInternalRow(row: InternalRow, fieldNames: Seq[String], file: PartitionedFile, metadataExtractors: Map[String, (PartitionedFile) => Any]): InternalRow
30.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

31.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException])

32.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws(classOf[java.lang.InterruptedException]) @native()