The spsql Module

Utility to execute SQL statement or statements taken from command line arguments over Parquet file(s) using Spark

read_parquet(spark: SparkSession, location: str) → DataFrame[source]

start_session(app_name=None, xmx: Optional[str] = None, hive=False, config: Optional[Dict] = None)[source]

execute(spark: SparkSession, location: str, sql: str, table: Optional[str] = None) → DataFrame[source]

execute_and_show(args)[source]

parse_args()[source]