tecton.VirtualDataSource

class tecton.VirtualDataSource(*, name, description='', family='', tags=None, owner='', batch_ds_config, stream_ds_config=None)

Declare a VirtualDataSource (VDS), used to read data into Tecton.

VirtualDataSource (commonly referred to as a VDS) is Tecton’s main data abstraction. TemporalFeaturePackages and TemporalAggregateFeaturePackages ingest data from VDS’s. A VDS can represent a batch data source, or a streaming data source which has been backed up by a historical log represented by a batch data source.

Methods

__init__

Creates a new Virtual Data Source.

__init__(*, name, description='', family='', tags=None, owner='', batch_ds_config, stream_ds_config=None)

Creates a new Virtual Data Source.

Parameters
  • name (str) – An unique name of the Virtual DS.

  • description (str) – (Optional) Description.

  • batch_ds_config (BaseBatchDataSource) – BatchDataSourceConfig object containing the configuration of the batch data source that is to be included into this VirtualDataSource.

  • stream_ds_config (Optional[BaseStreamDataSource]) – (Optional) StreamDataSourceConfig object containing the configuration about the batch data source that is to be included included into this virtual DS. If present, this VDS class represents a stream data source backed up by the batch data source.

  • owner (str) – Owner name.

Returns

A VirtualDataSource class instance.

Attributes

name

timestamp_key