towhee.functional.storages.ChunkedTable

class towhee.functional.storages.ChunkedTable(chunks=None, chunksize=128, stream=False)[source]

Bases: object

A chunked pyarrow table.

Parameters:

  • chunks – The list or queue of chunks.

  • chunksize (int) – The size of the chunk.

  • stream (bool) – If the data is streamed.

Methods

chunks

feed

Attributes

chunksize

is_stream

__init__(chunks=None, chunksize=128, stream=False) → None[source]