Packages

o

org.apache.spark.sql.catalyst.optimizer

NestedColumnAliasing

object NestedColumnAliasing

This aims to handle a nested column aliasing pattern inside the ColumnPruning optimizer rule. If a project or its child references to nested fields, and not all the fields in a nested attribute are used, we can substitute them by alias attributes; then a project of the nested fields as aliases on the children of the child will be created.

Linear Supertypes
AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. NestedColumnAliasing
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  5. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()
  6. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  7. def equals(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  8. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  9. def getAliasSubMap(exprList: Seq[Expression], exclusiveAttrs: Seq[Attribute] = Seq.empty): Option[(Map[ExtractValue, Alias], Map[ExprId, Seq[Alias]])]

    Return two maps in order to replace nested fields to aliases.

    Return two maps in order to replace nested fields to aliases.

    If exclusiveAttrs is given, any nested field accessors of these attributes won't be considered in nested fields aliasing.

    1. ExtractValue -> Alias: A new alias is created for each nested field. 2. ExprId -> Seq[Alias]: A reference attribute has multiple aliases pointing it.

  10. final def getClass(): Class[_]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def getNewProjectList(projectList: Seq[NamedExpression], nestedFieldToAlias: Map[ExtractValue, Alias]): Seq[NamedExpression]

    Return a replaced project list.

  12. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  13. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  14. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  15. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  17. def replaceWithAliases(plan: LogicalPlan, nestedFieldToAlias: Map[ExtractValue, Alias], attrToAliases: Map[ExprId, Seq[Alias]]): LogicalPlan

    Return a plan with new children replaced with aliases, and expressions replaced with aliased attributes.

  18. final def synchronized[T0](arg0: ⇒ T0): T0
    Definition Classes
    AnyRef
  19. def toString(): String
    Definition Classes
    AnyRef → Any
  20. def unapply(plan: LogicalPlan): Option[LogicalPlan]
  21. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  22. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  23. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws( ... ) @native()

Inherited from AnyRef

Inherited from Any

Ungrouped