Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def capabilities(): Set[TableCapability]

   Definition Classes

   FileTable → Table

6.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

7.  lazy val dataSchema: StructType

   Definition Classes

   FileTable

8.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

9.  val fallbackFileFormat: Class[_ <: FileFormat]

   Returns a V1 FileFormat class of the same file data source.

   Returns a V1 FileFormat class of the same file data source. This is a solution for the following cases: 1. File datasource V2 implementations cause regression. Users can disable the problematic data source via SQL configuration and fall back to FileFormat. 2. Catalog support is required, which is still under development for data source V2.

   Definition Classes

   CSVTable → FileTable

10.  lazy val fileIndex: PartitioningAwareFileIndex

    Definition Classes

    FileTable

11.  def finalize(): Unit

    Attributes

    protected[lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

12.  def formatName: String

    The string that represents the format that this data source provider uses.

    The string that represents the format that this data source provider uses. This is overridden by children to provide a nice alias for the data source. For example:

    override def formatName(): String = "ORC"

    Definition Classes

    CSVTable → FileTable

13.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

14.  def inferSchema(files: Seq[FileStatus]): Option[StructType]

    When possible, this method should return the schema of the given files.

    When possible, this method should return the schema of the given files. When the format does not support inference, or no valid files are given should return None. In these cases Spark will require that user specify the schema manually.

    Definition Classes

    CSVTable → FileTable

15.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

16.  val name: String

    Definition Classes

    CSVTable → Table

17.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

18.  def newScanBuilder(options: CaseInsensitiveStringMap): CSVScanBuilder

    Definition Classes

    CSVTable → SupportsRead

19.  def newWriteBuilder(info: LogicalWriteInfo): WriteBuilder

    Definition Classes

    CSVTable → SupportsWrite

20.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

21.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

22.  val options: CaseInsensitiveStringMap
23.  def partitioning(): Array[Transform]

    Definition Classes

    FileTable → Table

24.  val paths: Seq[String]
25.  def properties(): Map[String, String]

    Definition Classes

    FileTable → Table

26.  lazy val schema: StructType

    Definition Classes

    FileTable → Table

27.  val sparkSession: SparkSession
28.  def supportsDataType(dataType: DataType): Boolean

    Returns whether this format supports the given DataType in read/write path.

    Returns whether this format supports the given DataType in read/write path. By default all data types are supported.

    Definition Classes

    CSVTable → FileTable

29.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

30.  val userSpecifiedSchema: Option[StructType]
31.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

32.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

33.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()