5.3.1.7.2.5.1. cli.cmd_etl.etl.table.Table

class cli.cmd_etl.etl.table.Table(start_date: TimestampScalar, output_format: OutputFormats | None = None, join_on: str | None = None, **kwargs: Unpack[TableKwargs])

Bases: object

Implements the functionalities to create tables out of the decoded CAN messages.

Parameters:

  • _start_date – The start date of the CAN measurement.

  • _output_format – Only support output formats are CSV and PARQUET

  • _join_on – All CAN message are join based on the Date column of this specified column

can_to_table(data: Path) → Table

Convert CAN messages stored as json object to a pyarrow table.

Parameters:

data – Path to the .json file with the CAN messages.

Returns:

Pyarrow table created from the CAN messages.

join(tables: list[Table]) → Table

Join a list of tables based on the Date column of the table containing the specified join_on column.

Parameters:

tables – A list of tables containing each a Date column.

Returns:

A table containing only one Date column and all other columns of the passed tables.

save_data(tables: dict[Path, table]) → None

Save all passed tables with respect to the configuration.

Parameters:

tables – A dictionary with the key as save path for the table with name but without suffix and the value as the table object.