ibis.impala.api.ImpalaClient.delimited_file

ImpalaClient.delimited_file(hdfs_dir, schema, name=None, database=None, delimiter=', ', na_rep=None, escapechar=None, lineterminator=None, external=True, persist=False)

Interpret delimited text files (CSV / TSV / etc.) as an Ibis table. See parquet_file for more exposition on what happens under the hood.

Parameters
hdfs_dirstring

HDFS directory name containing delimited text files

schemaibis Schema
namestring, default None

Name for temporary or persistent table; otherwise random one generated

databasestring

Database to create the (possibly temporary) table in

delimiterlength-1 string, default ‘,’

Pass None if there is no delimiter

escapecharlength-1 string

Character used to escape special characters

lineterminatorlength-1 string

Character used to delimit lines

externalboolean, default True

Create table as EXTERNAL (data will not be deleted on drop). Not that if persist=False and external=False, whatever data you reference will be deleted

persistboolean, default False

If True, do not delete the table upon garbage collection of ibis table object

Returns
delimited_tableImpalaTable