ibis.HDFS.put_tarfile

HDFS.put_tarfile(hdfs_path: str, local_path: str, compression: str = 'gzip', verbose: bool = None, overwrite: bool = False)

Write contents of tar archive to HDFS.

Write contents of tar archive to HDFS directly without having to decompress it locally first.

Parameters
  • hdfs_path (string) –

  • local_path (string) –

  • compression ({'gzip', 'bz2', None}) –

  • overwrite (boolean, default False) –

  • verbose (boolean, default None (global default)) –

Raises

ValueError – if given compression is none of the following: None, gzip or bz2.