tecton.declarative.BatchSource

class tecton.declarative.BatchSource(*, name, description=None, tags=None, owner=None, batch_config)

Declare a BatchSource, used to read batch data into Tecton.

BatchFeatureViews ingest data from a BatchSource.

Methods

__init__

Creates a new BatchSource

__init__(*, name, description=None, tags=None, owner=None, batch_config)

Creates a new BatchSource

Parameters
  • name (str) – An unique name of the DataSource.

  • description (Optional[str]) – A human readable description.

  • tags (Optional[Dict[str, str]]) – Tags associated with this Tecton Object (key-value pairs of arbitrary metadata).

  • owner (Optional[str]) – Owner name (typically the email of the primary maintainer).

  • batch_config (Union[FileConfig, HiveConfig, RedshiftConfig, SnowflakeConfig]) – BatchConfig object containing the configuration of the batch data source to be included in this DataSource.

Returns

A BatchSource class instance.

Example of a BatchSource declaration:

# Declare a BatchSource with HiveConfig instance as its batch_config parameter
# Refer to Configs API documentation other batch_config types.
from tecton import HiveConfig, BatchSource

credit_scores_batch = BatchSource(
    name='credit_scores_batch',
    batch_config=HiveConfig(
        database='demo_fraud',
        table='credit_scores',
        timestamp_field='timestamp'
    ),
    owner='matt@tecton.ai',
    tags={'release': 'production'}
)

Attributes

name

The name of this DataSource.

timestamp_field

The name of the timestamp column or key of this DataSource.