Packages

c

org.apache.spark.sql.internal

ReadOnlySQLConf

class ReadOnlySQLConf extends SQLConf

A readonly SQLConf that will be created by tasks running at the executor side. It reads the configs from the local properties which are propagated from driver to executors.

Linear Supertypes
SQLConf, Logging, Serializable, Serializable, AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. ReadOnlySQLConf
  2. SQLConf
  3. Logging
  4. Serializable
  5. Serializable
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new ReadOnlySQLConf(context: TaskContext)

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def adaptiveExecutionEnabled: Boolean
    Definition Classes
    SQLConf
  5. def adaptiveExecutionLogLevel: String
    Definition Classes
    SQLConf
  6. def addSingleFileInAddFile: Boolean
    Definition Classes
    SQLConf
  7. def advancedPartitionPredicatePushdownEnabled: Boolean
    Definition Classes
    SQLConf
  8. def allowAutoGeneratedAliasForView: Boolean
    Definition Classes
    SQLConf
  9. def allowNegativeScaleOfDecimalEnabled: Boolean
    Definition Classes
    SQLConf
  10. def allowNonEmptyLocationInCTAS: Boolean
    Definition Classes
    SQLConf
  11. def allowStarWithSingleTableIdentifierInCount: Boolean
    Definition Classes
    SQLConf
  12. def analyzerMaxIterations: Int

    ************************ Spark SQL Params/Hints *******************

    ************************ Spark SQL Params/Hints *******************

    Definition Classes
    SQLConf
  13. def ansiEnabled: Boolean
    Definition Classes
    SQLConf
  14. def arrowMaxRecordsPerBatch: Int
    Definition Classes
    SQLConf
  15. def arrowPySparkEnabled: Boolean
    Definition Classes
    SQLConf
  16. def arrowPySparkFallbackEnabled: Boolean
    Definition Classes
    SQLConf
  17. def arrowPySparkSelfDestructEnabled: Boolean
    Definition Classes
    SQLConf
  18. def arrowSafeTypeConversion: Boolean
    Definition Classes
    SQLConf
  19. def arrowSparkREnabled: Boolean
    Definition Classes
    SQLConf
  20. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  21. def autoBroadcastJoinThreshold: Long
    Definition Classes
    SQLConf
  22. def autoBucketedScanEnabled: Boolean
    Definition Classes
    SQLConf
  23. def autoSizeUpdateEnabled: Boolean
    Definition Classes
    SQLConf
  24. def avroCompressionCodec: String
    Definition Classes
    SQLConf
  25. def avroDeflateLevel: Int
    Definition Classes
    SQLConf
  26. def avroFilterPushDown: Boolean
    Definition Classes
    SQLConf
  27. def broadcastHashJoinOutputPartitioningExpandLimit: Int
    Definition Classes
    SQLConf
  28. def broadcastTimeout: Long
    Definition Classes
    SQLConf
  29. def bucketingEnabled: Boolean
    Definition Classes
    SQLConf
  30. def bucketingMaxBuckets: Int
    Definition Classes
    SQLConf
  31. def cacheVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  32. def cartesianProductExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  33. def cartesianProductExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  34. def caseSensitiveAnalysis: Boolean
    Definition Classes
    SQLConf
  35. def caseSensitiveInferenceMode: SQLConf.HiveCaseSensitiveInferenceMode.Value
    Definition Classes
    SQLConf
  36. def castDatetimeToString: Boolean
    Definition Classes
    SQLConf
  37. def cboEnabled: Boolean
    Definition Classes
    SQLConf
  38. def charVarcharAsString: Boolean
    Definition Classes
    SQLConf
  39. def checkpointLocation: Option[String]
    Definition Classes
    SQLConf
  40. def clear(): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  41. def cliPrintHeader: Boolean
    Definition Classes
    SQLConf
  42. def clone(): SQLConf
    Definition Classes
    ReadOnlySQLConf → SQLConf → AnyRef
  43. def coalesceBucketsInJoinEnabled: Boolean
    Definition Classes
    SQLConf
  44. def coalesceBucketsInJoinMaxBucketRatio: Int
    Definition Classes
    SQLConf
  45. def coalesceShufflePartitionsEnabled: Boolean
    Definition Classes
    SQLConf
  46. def codegenCacheMaxEntries: Int
    Definition Classes
    SQLConf
  47. def codegenComments: Boolean
    Definition Classes
    SQLConf
  48. def codegenFallback: Boolean
    Definition Classes
    SQLConf
  49. def codegenSplitAggregateFunc: Boolean
    Definition Classes
    SQLConf
  50. def columnBatchSize: Int
    Definition Classes
    SQLConf
  51. def columnNameOfCorruptRecord: String
    Definition Classes
    SQLConf
  52. def concatBinaryAsString: Boolean
    Definition Classes
    SQLConf
  53. def constraintPropagationEnabled: Boolean
    Definition Classes
    SQLConf
  54. def contains(key: String): Boolean

    Return whether a given key is set in this SQLConf.

    Return whether a given key is set in this SQLConf.

    Definition Classes
    SQLConf
  55. def continuousStreamingEpochBacklogQueueSize: Int
    Definition Classes
    SQLConf
  56. def continuousStreamingExecutorPollIntervalMs: Long
    Definition Classes
    SQLConf
  57. def continuousStreamingExecutorQueueSize: Int
    Definition Classes
    SQLConf
  58. def convertCTAS: Boolean
    Definition Classes
    SQLConf
  59. def copy(entries: (ConfigEntry[_], Any)*): SQLConf
    Definition Classes
    ReadOnlySQLConf → SQLConf
  60. def crossJoinEnabled: Boolean
    Definition Classes
    SQLConf
  61. def csvColumnPruning: Boolean
    Definition Classes
    SQLConf
  62. def csvExpressionOptimization: Boolean
    Definition Classes
    SQLConf
  63. def csvFilterPushDown: Boolean
    Definition Classes
    SQLConf
  64. def dataFramePivotMaxValues: Int
    Definition Classes
    SQLConf
  65. def dataFrameRetainGroupColumns: Boolean
    Definition Classes
    SQLConf
  66. def dataFrameSelfJoinAutoResolveAmbiguity: Boolean
    Definition Classes
    SQLConf
  67. def datetimeJava8ApiEnabled: Boolean
    Definition Classes
    SQLConf
  68. def decimalOperationsAllowPrecisionLoss: Boolean
    Definition Classes
    SQLConf
  69. def decorrelateInnerQueryEnabled: Boolean
    Definition Classes
    SQLConf
  70. def defaultDataSourceName: String
    Definition Classes
    SQLConf
  71. def defaultNumShufflePartitions: Int
    Definition Classes
    SQLConf
  72. def defaultSizeInBytes: Long
    Definition Classes
    SQLConf
  73. def disabledJdbcConnectionProviders: String
    Definition Classes
    SQLConf
  74. def disabledV2StreamingMicroBatchReaders: String
    Definition Classes
    SQLConf
  75. def disabledV2StreamingWriters: String
    Definition Classes
    SQLConf
  76. def dynamicPartitionPruningEnabled: Boolean
    Definition Classes
    SQLConf
  77. def dynamicPartitionPruningFallbackFilterRatio: Double
    Definition Classes
    SQLConf
  78. def dynamicPartitionPruningReuseBroadcastOnly: Boolean
    Definition Classes
    SQLConf
  79. def dynamicPartitionPruningUseStats: Boolean
    Definition Classes
    SQLConf
  80. def eltOutputAsString: Boolean
    Definition Classes
    SQLConf
  81. def enableRadixSort: Boolean
    Definition Classes
    SQLConf
  82. def enableTwoLevelAggMap: Boolean
    Definition Classes
    SQLConf
  83. def enableVectorizedHashMap: Boolean
    Definition Classes
    SQLConf
  84. def enforceReservedKeywords: Boolean
    Definition Classes
    SQLConf
  85. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  86. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  87. def escapedStringLiterals: Boolean
    Definition Classes
    SQLConf
  88. def exchangeReuseEnabled: Boolean
    Definition Classes
    SQLConf
  89. def exponentLiteralAsDecimalEnabled: Boolean
    Definition Classes
    SQLConf
  90. def fallBackToHdfsForStatsEnabled: Boolean
    Definition Classes
    SQLConf
  91. def fastFailFileFormatOutput: Boolean
    Definition Classes
    SQLConf
  92. def fastHashAggregateRowMaxCapacityBit: Int
    Definition Classes
    SQLConf
  93. def fetchShuffleBlocksInBatch: Boolean
    Definition Classes
    SQLConf
  94. def fileCommitProtocolClass: String
    Definition Classes
    SQLConf
  95. def fileCompressionFactor: Double
    Definition Classes
    SQLConf
  96. def fileSinkLogCleanupDelay: Long
    Definition Classes
    SQLConf
  97. def fileSinkLogCompactInterval: Int
    Definition Classes
    SQLConf
  98. def fileSinkLogDeletion: Boolean
    Definition Classes
    SQLConf
  99. def fileSourceLogCleanupDelay: Long
    Definition Classes
    SQLConf
  100. def fileSourceLogCompactInterval: Int
    Definition Classes
    SQLConf
  101. def fileSourceLogDeletion: Boolean
    Definition Classes
    SQLConf
  102. def fileStreamSinkMetadataIgnored: Boolean
    Definition Classes
    SQLConf
  103. def filesMaxPartitionBytes: Long
    Definition Classes
    SQLConf
  104. def filesMinPartitionNum: Option[Int]
    Definition Classes
    SQLConf
  105. def filesOpenCostInBytes: Long
    Definition Classes
    SQLConf
  106. def filesourcePartitionFileCacheSize: Long
    Definition Classes
    SQLConf
  107. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  108. def gatherFastStats: Boolean
    Definition Classes
    SQLConf
  109. def getAllConfs: Map[String, String]

    Return all the configuration properties that have been set (i.e.

    Return all the configuration properties that have been set (i.e. not the default). This creates a new copy of the config properties in the form of a Map.

    Definition Classes
    SQLConf
  110. def getAllDefinedConfs: Seq[(String, String, String, String)]

    Return all the configuration definitions that have been defined in SQLConf.

    Return all the configuration definitions that have been defined in SQLConf. Each definition contains key, defaultValue and doc.

    Definition Classes
    SQLConf
  111. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  112. def getConf[T](entry: OptionalConfigEntry[T]): Option[T]

    Return the value of an optional Spark SQL configuration property for the given key.

    Return the value of an optional Spark SQL configuration property for the given key. If the key is not set yet, returns None.

    Definition Classes
    SQLConf
  113. def getConf[T](entry: ConfigEntry[T]): T

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue in ConfigEntry.

    Definition Classes
    SQLConf
  114. def getConf[T](entry: ConfigEntry[T], defaultValue: T): T

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue. This is useful when defaultValue in ConfigEntry is not the desired one.

    Definition Classes
    SQLConf
  115. def getConfString(key: String, defaultValue: String): String

    Return the string value of Spark SQL configuration property for the given key.

    Return the string value of Spark SQL configuration property for the given key. If the key is not set yet, return defaultValue.

    Definition Classes
    SQLConf
  116. def getConfString(key: String): String

    Return the value of Spark SQL configuration property for the given key.

    Return the value of Spark SQL configuration property for the given key.

    Definition Classes
    SQLConf
    Annotations
    @throws( "if key is not set" )
  117. def groupByAliases: Boolean
    Definition Classes
    SQLConf
  118. def groupByOrdinal: Boolean
    Definition Classes
    SQLConf
  119. def groupingIdWithAppendedUserGroupByEnabled: Boolean
    Definition Classes
    SQLConf
  120. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  121. def hintErrorHandler: HintErrorHandler

    Returns the error handler for handling hint errors.

    Returns the error handler for handling hint errors.

    Definition Classes
    SQLConf
  122. def histogramEnabled: Boolean
    Definition Classes
    SQLConf
  123. def histogramNumBins: Int
    Definition Classes
    SQLConf
  124. def histogramNumericPropagateInputType: Boolean
    Definition Classes
    SQLConf
  125. def hiveThriftServerSingleSession: Boolean
    Definition Classes
    SQLConf
  126. def hugeMethodLimit: Int
    Definition Classes
    SQLConf
  127. def ignoreCorruptFiles: Boolean
    Definition Classes
    SQLConf
  128. def ignoreDataLocality: Boolean
    Definition Classes
    SQLConf
  129. def ignoreMissingFiles: Boolean
    Definition Classes
    SQLConf
  130. def ignoreMissingParquetFieldId: Boolean
    Definition Classes
    SQLConf
  131. def inMemoryPartitionPruning: Boolean
    Definition Classes
    SQLConf
  132. def inMemoryTableScanStatisticsEnabled: Boolean
    Definition Classes
    SQLConf
  133. def inferDictAsStruct: Boolean
    Definition Classes
    SQLConf
  134. def initializeLogIfNecessary(isInterpreter: Boolean, silent: Boolean): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  135. def initializeLogIfNecessary(isInterpreter: Boolean): Unit
    Attributes
    protected
    Definition Classes
    Logging
  136. def integerGroupingIdEnabled: Boolean
    Definition Classes
    SQLConf
  137. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  138. def isModifiable(key: String): Boolean
    Definition Classes
    SQLConf
  139. def isOrcSchemaMergingEnabled: Boolean
    Definition Classes
    SQLConf
  140. def isParquetBinaryAsString: Boolean
    Definition Classes
    SQLConf
  141. def isParquetINT96AsTimestamp: Boolean
    Definition Classes
    SQLConf
  142. def isParquetINT96TimestampConversion: Boolean
    Definition Classes
    SQLConf
  143. def isParquetSchemaMergingEnabled: Boolean
    Definition Classes
    SQLConf
  144. def isParquetSchemaRespectSummaries: Boolean
    Definition Classes
    SQLConf
  145. def isReplEagerEvalEnabled: Boolean
    Definition Classes
    SQLConf
  146. def isStateSchemaCheckEnabled: Boolean
    Definition Classes
    SQLConf
  147. def isTraceEnabled(): Boolean
    Attributes
    protected
    Definition Classes
    Logging
  148. def isUnsupportedOperationCheckEnabled: Boolean
    Definition Classes
    SQLConf
  149. def joinReorderCardWeight: Double
    Definition Classes
    SQLConf
  150. def joinReorderDPStarFilter: Boolean
    Definition Classes
    SQLConf
  151. def joinReorderDPThreshold: Int
    Definition Classes
    SQLConf
  152. def joinReorderEnabled: Boolean
    Definition Classes
    SQLConf
  153. def jsonExpressionOptimization: Boolean
    Definition Classes
    SQLConf
  154. def jsonFilterPushDown: Boolean
    Definition Classes
    SQLConf
  155. def jsonGeneratorIgnoreNullFields: Boolean
    Definition Classes
    SQLConf
  156. def legacyIntervalEnabled: Boolean
    Definition Classes
    SQLConf
  157. def legacyMsSqlServerNumericMappingEnabled: Boolean
    Definition Classes
    SQLConf
  158. def legacyParquetNanosAsLong: Boolean
    Definition Classes
    SQLConf
  159. def legacyPathOptionBehavior: Boolean
    Definition Classes
    SQLConf
  160. def legacySizeOfNull: Boolean
    Definition Classes
    SQLConf
  161. def legacyStatisticalAggregate: Boolean
    Definition Classes
    SQLConf
  162. def legacyTimeParserPolicy: SQLConf.LegacyBehaviorPolicy.Value
    Definition Classes
    SQLConf
  163. def limitScaleUpFactor: Int
    Definition Classes
    SQLConf
  164. def literalPickMinimumPrecision: Boolean
    Definition Classes
    SQLConf
  165. def log: Logger
    Attributes
    protected
    Definition Classes
    Logging
  166. def logDebug(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  167. def logDebug(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  168. def logError(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  169. def logError(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  170. def logInfo(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  171. def logInfo(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  172. def logName: String
    Attributes
    protected
    Definition Classes
    Logging
  173. def logTrace(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  174. def logTrace(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  175. def logWarning(msg: ⇒ String, throwable: Throwable): Unit
    Attributes
    protected
    Definition Classes
    Logging
  176. def logWarning(msg: ⇒ String): Unit
    Attributes
    protected
    Definition Classes
    Logging
  177. def loggingMaxLinesForCodegen: Int
    Definition Classes
    SQLConf
  178. def manageFilesourcePartitions: Boolean
    Definition Classes
    SQLConf
  179. def maxBatchesToRetainInMemory: Int
    Definition Classes
    SQLConf
  180. def maxConcurrentOutputFileWriters: Int
    Definition Classes
    SQLConf
  181. def maxMetadataStringLength: Int
    Definition Classes
    SQLConf
  182. def maxNestedViewDepth: Int
    Definition Classes
    SQLConf
  183. def maxPlanStringLength: Int
    Definition Classes
    SQLConf
  184. def maxRecordsPerFile: Long
    Definition Classes
    SQLConf
  185. def maxToStringFields: Int
    Definition Classes
    SQLConf
  186. def metadataCacheTTL: Long
    Definition Classes
    SQLConf
  187. def metastorePartitionPruning: Boolean
    Definition Classes
    SQLConf
  188. def metastorePartitionPruningFallbackOnException: Boolean
    Definition Classes
    SQLConf
  189. def metastorePartitionPruningFastFallback: Boolean
    Definition Classes
    SQLConf
  190. def metastorePartitionPruningInSetThreshold: Int
    Definition Classes
    SQLConf
  191. def methodSplitThreshold: Int
    Definition Classes
    SQLConf
  192. def minBatchesToRetain: Int
    Definition Classes
    SQLConf
  193. def nameNonStructGroupingKeyAsValue: Boolean
    Definition Classes
    SQLConf
  194. def ndvMaxError: Double
    Definition Classes
    SQLConf
  195. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  196. def nestedPruningOnExpressions: Boolean
    Definition Classes
    SQLConf
  197. def nestedSchemaPruningEnabled: Boolean
    Definition Classes
    SQLConf
  198. def nonEmptyPartitionRatioForBroadcastJoin: Double
    Definition Classes
    SQLConf
  199. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  200. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  201. def numShufflePartitions: Int
    Definition Classes
    SQLConf
  202. def objectAggSortBasedFallbackThreshold: Int
    Definition Classes
    SQLConf
  203. def offHeapColumnVectorEnabled: Boolean
    Definition Classes
    SQLConf
  204. def optimizeNullAwareAntiJoin: Boolean
    Definition Classes
    SQLConf
  205. def optimizerExcludedRules: Option[String]
    Definition Classes
    SQLConf
  206. def optimizerInSetConversionThreshold: Int
    Definition Classes
    SQLConf
  207. def optimizerInSetSwitchThreshold: Int
    Definition Classes
    SQLConf
  208. def optimizerMaxIterations: Int
    Definition Classes
    SQLConf
  209. def optimizerMetadataOnly: Boolean
    Definition Classes
    SQLConf
  210. def orcAggregatePushDown: Boolean
    Definition Classes
    SQLConf
  211. def orcCompressionCodec: String
    Definition Classes
    SQLConf
  212. def orcFilterPushDown: Boolean
    Definition Classes
    SQLConf
  213. def orcVectorizedReaderBatchSize: Int
    Definition Classes
    SQLConf
  214. def orcVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  215. def orcVectorizedReaderNestedColumnEnabled: Boolean
    Definition Classes
    SQLConf
  216. def orderByOrdinal: Boolean
    Definition Classes
    SQLConf
  217. def pandasGroupedMapAssignColumnsByName: Boolean
    Definition Classes
    SQLConf
  218. def pandasUDFBufferSize: Int
    Definition Classes
    SQLConf
  219. def parallelFileListingInStatsComputation: Boolean
    Definition Classes
    SQLConf
  220. def parallelPartitionDiscoveryParallelism: Int
    Definition Classes
    SQLConf
  221. def parallelPartitionDiscoveryThreshold: Int
    Definition Classes
    SQLConf
  222. def parquetAggregatePushDown: Boolean
    Definition Classes
    SQLConf
  223. def parquetCompressionCodec: String
    Definition Classes
    SQLConf
  224. def parquetFieldIdReadEnabled: Boolean
    Definition Classes
    SQLConf
  225. def parquetFieldIdWriteEnabled: Boolean
    Definition Classes
    SQLConf
  226. def parquetFilterPushDown: Boolean
    Definition Classes
    SQLConf
  227. def parquetFilterPushDownDate: Boolean
    Definition Classes
    SQLConf
  228. def parquetFilterPushDownDecimal: Boolean
    Definition Classes
    SQLConf
  229. def parquetFilterPushDownInFilterThreshold: Int
    Definition Classes
    SQLConf
  230. def parquetFilterPushDownStringStartWith: Boolean
    Definition Classes
    SQLConf
  231. def parquetFilterPushDownTimestamp: Boolean
    Definition Classes
    SQLConf
  232. def parquetOutputCommitterClass: String
    Definition Classes
    SQLConf
  233. def parquetOutputTimestampType: SQLConf.ParquetOutputTimestampType.Value
    Definition Classes
    SQLConf
  234. def parquetRecordFilterEnabled: Boolean
    Definition Classes
    SQLConf
  235. def parquetVectorizedReaderBatchSize: Int
    Definition Classes
    SQLConf
  236. def parquetVectorizedReaderEnabled: Boolean
    Definition Classes
    SQLConf
  237. def parquetVectorizedReaderNestedColumnEnabled: Boolean
    Definition Classes
    SQLConf
  238. def partitionColumnTypeInferenceEnabled: Boolean
    Definition Classes
    SQLConf
  239. def partitionOverwriteMode: SQLConf.PartitionOverwriteMode.Value
    Definition Classes
    SQLConf
  240. def percentileAccuracy: Int
    Definition Classes
    SQLConf
  241. def planChangeBatches: Option[String]
    Definition Classes
    SQLConf
  242. def planChangeLogLevel: String
    Definition Classes
    SQLConf
  243. def planChangeRules: Option[String]
    Definition Classes
    SQLConf
  244. def planStatsEnabled: Boolean
    Definition Classes
    SQLConf
  245. def preferSortMergeJoin: Boolean
    Definition Classes
    SQLConf
  246. def pysparkJVMStacktraceEnabled: Boolean
    Definition Classes
    SQLConf
  247. def pysparkSimplifiedTraceback: Boolean
    Definition Classes
    SQLConf
  248. def rangeExchangeSampleSizePerPartition: Int
    Definition Classes
    SQLConf
  249. val reader: ConfigReader
    Attributes
    protected
    Definition Classes
    ReadOnlySQLConf → SQLConf
  250. def redactOptions[K, V](options: Seq[(K, V)]): Seq[(K, V)]

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Definition Classes
    SQLConf
  251. def redactOptions[K, V](options: Map[K, V]): Map[K, V]

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Redacts the given option map according to the description of SQL_OPTIONS_REDACTION_PATTERN.

    Definition Classes
    SQLConf
  252. def replEagerEvalMaxNumRows: Int
    Definition Classes
    SQLConf
  253. def replEagerEvalTruncate: Int
    Definition Classes
    SQLConf
  254. def replaceDatabricksSparkAvroEnabled: Boolean
    Definition Classes
    SQLConf
  255. def replaceExceptWithFilter: Boolean
    Definition Classes
    SQLConf
  256. def resolver: Resolver

    Returns the Resolver for the current configuration, which can be used to determine if two identifiers are equal.

    Returns the Resolver for the current configuration, which can be used to determine if two identifiers are equal.

    Definition Classes
    SQLConf
  257. def runSQLonFile: Boolean
    Definition Classes
    SQLConf
  258. def runtimeFilterBloomFilterEnabled: Boolean
    Definition Classes
    SQLConf
  259. def runtimeFilterCreationSideThreshold: Long
    Definition Classes
    SQLConf
  260. def runtimeFilterSemiJoinReductionEnabled: Boolean
    Definition Classes
    SQLConf
  261. def serializerNestedSchemaPruningEnabled: Boolean
    Definition Classes
    SQLConf
  262. def sessionLocalTimeZone: String
    Definition Classes
    SQLConf
  263. def sessionWindowBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  264. def sessionWindowBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  265. def setCommandRejectsSparkCoreConfs: Boolean
    Definition Classes
    SQLConf
  266. def setConf[T](entry: ConfigEntry[T], value: T): Unit

    Set the given Spark SQL configuration property.

    Set the given Spark SQL configuration property.

    Definition Classes
    SQLConf
  267. def setConf(props: Properties): Unit

    Set Spark SQL configuration properties.

    Set Spark SQL configuration properties.

    Definition Classes
    SQLConf
  268. def setConfString(key: String, value: String): Unit

    Set the given Spark SQL configuration property using a string value.

    Set the given Spark SQL configuration property using a string value.

    Definition Classes
    SQLConf
  269. def setConfWithCheck(key: String, value: String): Unit
    Attributes
    protected
    Definition Classes
    ReadOnlySQLConf → SQLConf
  270. def setOpsPrecedenceEnforced: Boolean
    Definition Classes
    SQLConf
  271. val settings: Map[String, String]
    Definition Classes
    ReadOnlySQLConf → SQLConf
  272. def sortBeforeRepartition: Boolean
    Definition Classes
    SQLConf
  273. def sortMergeJoinExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  274. def sortMergeJoinExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  275. def starSchemaDetection: Boolean
    Definition Classes
    SQLConf
  276. def starSchemaFTRatio: Double
    Definition Classes
    SQLConf
  277. def stateStoreCompressionCodec: String
    Definition Classes
    SQLConf
  278. def stateStoreFormatValidationEnabled: Boolean
    Definition Classes
    SQLConf
  279. def stateStoreMinDeltasForSnapshot: Int
    Definition Classes
    SQLConf
  280. def stateStoreProviderClass: String
    Definition Classes
    SQLConf
  281. def stateStoreSkipNullsForStreamStreamJoins: Boolean
    Definition Classes
    SQLConf
  282. def statefulOperatorCorrectnessCheckEnabled: Boolean
    Definition Classes
    SQLConf
  283. def storeAnalyzedPlanForView: Boolean
    Definition Classes
    SQLConf
  284. def storeAssignmentPolicy: SQLConf.StoreAssignmentPolicy.Value
    Definition Classes
    SQLConf
  285. def streamingFileCommitProtocolClass: String
    Definition Classes
    SQLConf
  286. def streamingMaintenanceInterval: Long
    Definition Classes
    SQLConf
  287. def streamingMetricsEnabled: Boolean
    Definition Classes
    SQLConf
  288. def streamingNoDataMicroBatchesEnabled: Boolean
    Definition Classes
    SQLConf
  289. def streamingNoDataProgressEventInterval: Long
    Definition Classes
    SQLConf
  290. def streamingPollingDelay: Long
    Definition Classes
    SQLConf
  291. def streamingProgressRetention: Int
    Definition Classes
    SQLConf
  292. def streamingSchemaInference: Boolean
    Definition Classes
    SQLConf
  293. def streamingSessionWindowMergeSessionInLocalPartition: Boolean
    Definition Classes
    SQLConf
  294. def strictIndexOperator: Boolean
    Definition Classes
    SQLConf
  295. def stringRedactionPattern: Option[Regex]
    Definition Classes
    SQLConf
  296. def subexpressionEliminationCacheMaxEntries: Int
    Definition Classes
    SQLConf
  297. def subexpressionEliminationEnabled: Boolean
    Definition Classes
    SQLConf
  298. def subqueryReuseEnabled: Boolean
    Definition Classes
    SQLConf
  299. def supportQuotedRegexColumnName: Boolean
    Definition Classes
    SQLConf
  300. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  301. def tableRelationCacheSize: Int
    Definition Classes
    SQLConf
  302. def timestampType: AtomicType
    Definition Classes
    SQLConf
  303. def toString(): String
    Definition Classes
    AnyRef → Any
  304. def topKSortFallbackThreshold: Int
    Definition Classes
    SQLConf
  305. def truncateTableIgnorePermissionAcl: Boolean
    Definition Classes
    SQLConf
  306. def uiExplainMode: String
    Definition Classes
    SQLConf
  307. def unsetConf(entry: ConfigEntry[_]): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  308. def unsetConf(key: String): Unit
    Definition Classes
    ReadOnlySQLConf → SQLConf
  309. def useCompression: Boolean
    Definition Classes
    SQLConf
  310. def useCurrentSQLConfigsForView: Boolean
    Definition Classes
    SQLConf
  311. def useDeprecatedKafkaOffsetFetching: Boolean
    Definition Classes
    SQLConf
  312. def useObjectHashAggregation: Boolean
    Definition Classes
    SQLConf
  313. def useV1Command: Boolean
    Definition Classes
    SQLConf
  314. def v2BucketingEnabled: Boolean
    Definition Classes
    SQLConf
  315. def validatePartitionColumns: Boolean
    Definition Classes
    SQLConf
  316. def variableSubstituteEnabled: Boolean
    Definition Classes
    SQLConf
  317. def verifyPartitionPath: Boolean
    Definition Classes
    SQLConf
  318. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  319. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  320. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  321. def warehousePath: String
    Definition Classes
    SQLConf
  322. def wholeStageEnabled: Boolean
    Definition Classes
    SQLConf
  323. def wholeStageMaxNumFields: Int
    Definition Classes
    SQLConf
  324. def wholeStageSplitConsumeFuncByOperator: Boolean
    Definition Classes
    SQLConf
  325. def wholeStageUseIdInClassName: Boolean
    Definition Classes
    SQLConf
  326. def windowExecBufferInMemoryThreshold: Int
    Definition Classes
    SQLConf
  327. def windowExecBufferSpillThreshold: Int
    Definition Classes
    SQLConf
  328. def writeLegacyParquetFormat: Boolean
    Definition Classes
    SQLConf

Inherited from SQLConf

Inherited from Logging

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped