org.apache.spark.sql.util

Class SchemaUtils

Object

org.apache.spark.sql.util.SchemaUtils

public class SchemaUtils
extends Object

Utils for handling schemas.

TODO: Merge this file with SchemaUtils.

Constructor Summary

Constructors

Constructor and Description
SchemaUtils()

Method Summary

Modifier and Type	Method and Description
static void	checkColumnNameDuplication(scala.collection.Seq<String> columnNames, String colType, boolean caseSensitiveAnalysis) Checks if input column names have duplicate identifiers.
static void	checkColumnNameDuplication(scala.collection.Seq<String> columnNames, String colType, scala.Function2<String,String,Object> resolver) Checks if input column names have duplicate identifiers.
static void	checkSchemaColumnNameDuplication(StructType schema, String colType, boolean caseSensitiveAnalysis) Checks if an input schema has duplicate column names.

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SchemaUtils

public SchemaUtils()

Method Detail

checkSchemaColumnNameDuplication

public static void checkSchemaColumnNameDuplication(StructType schema,
                                                    String colType,
                                                    boolean caseSensitiveAnalysis)

Checks if an input schema has duplicate column names. This throws an exception if the duplication exists.

Parameters:

schema - schema to check

colType - column type name, used in an exception message

caseSensitiveAnalysis - whether duplication checks should be case sensitive or not

checkColumnNameDuplication

public static void checkColumnNameDuplication(scala.collection.Seq<String> columnNames,
                                              String colType,
                                              scala.Function2<String,String,Object> resolver)

Checks if input column names have duplicate identifiers. This throws an exception if the duplication exists.

Parameters:

columnNames - column names to check

colType - column type name, used in an exception message

resolver - resolver used to determine if two identifiers are equal

checkColumnNameDuplication

public static void checkColumnNameDuplication(scala.collection.Seq<String> columnNames,
                                              String colType,
                                              boolean caseSensitiveAnalysis)

Checks if input column names have duplicate identifiers. This throws an exception if the duplication exists.

Parameters:

columnNames - column names to check

colType - column type name, used in an exception message

caseSensitiveAnalysis - whether duplication checks should be case sensitive or not