ibis.impala.api.ImpalaClient.delimited_file

ImpalaClient.delimited_file(hdfs_dir, schema, name=None, database=None, delimiter=', ', na_rep=None, escapechar=None, lineterminator=None, external=True, persist=False)

Interpret delimited text files (CSV / TSV / etc.) as an Ibis table. See parquet_file for more exposition on what happens under the hood.

Parameters:

hdfs_dir : string

HDFS directory name containing delimited text files

schema : ibis Schema

name : string, default None

Name for temporary or persistent table; otherwise random one generated

database : string

Database to create the (possibly temporary) table in

delimiter : length-1 string, default ‘,’

Pass None if there is no delimiter

escapechar : length-1 string

Character used to escape special characters

lineterminator : length-1 string

Character used to delimit lines

external : boolean, default True

Create table as EXTERNAL (data will not be deleted on drop). Not that if persist=False and external=False, whatever data you reference will be deleted

persist : boolean, default False

If True, do not delete the table upon garbage collection of ibis table object

Returns:

delimited_table : ImpalaTable