ibis.backends.impala.ImpalaClient.delimited_file¶
-
ImpalaClient.
delimited_file
(hdfs_dir, schema, name=None, database=None, delimiter=',', na_rep=None, escapechar=None, lineterminator=None, external=True, persist=False)¶ Interpret delimited text files (CSV / TSV / etc.) as an Ibis table. See parquet_file for more exposition on what happens under the hood.
- Parameters
hdfs_dir (string) – HDFS directory name containing delimited text files
schema (ibis Schema) –
name (string, default None) – Name for temporary or persistent table; otherwise random one generated
database (string) – Database to create the (possibly temporary) table in
delimiter (length-1 string, default ',') – Pass None if there is no delimiter
escapechar (length-1 string) – Character used to escape special characters
lineterminator (length-1 string) – Character used to delimit lines
external (boolean, default True) – Create table as EXTERNAL (data will not be deleted on drop). Not that if persist=False and external=False, whatever data you reference will be deleted
persist (boolean, default False) – If True, do not delete the table upon garbage collection of ibis table object
- Returns
delimited_table
- Return type
ImpalaTable