tecton.interactive.BatchDataSource

class tecton.interactive.BatchDataSource

BatchDataSource abstracts batch data sources.

BatchFeatureViews and BatchWindowAggregateFeatureViews ingest data from BatchDataSources.

Methods

get_dataframe	Returns this data source’s data as a Tecton DataFrame.
summary	Displays a human readable summary of this data source.

get_dataframe(start_time=None, end_time=None, *, apply_translator=True)

Returns this data source’s data as a Tecton DataFrame.

Parameters

• start_time (Union[DateTime, datetime, None]) – The interval start time from when we want to retrieve source data. If no timezone is specified, will default to using UTC. Can only be defined if apply_translator is True.

• end_time (Union[DateTime, datetime, None]) – The interval end time until when we want to retrieve source data. If no timezone is specified, will default to using UTC. Can only be defined if apply_translator is True.

• apply_translator (bool) – If True, the transformation specified by raw_batch_translator will be applied to the dataframe for the data source. apply_translator is not applicable to batch sources configured with spark_batch_config because it does not have a post_processor.

Returns

A Tecton DataFrame containing the data source’s raw or translated source data.

Raises

TectonValidationError – If apply_translator is False, but start_time or end_time filters are passed in.

summary()

Displays a human readable summary of this data source.

Attributes

columns	Returns streaming DS columns if it’s present.
created_at	Returns the creation date of this Tecton Object.
defined_in	Returns filename where this Tecton Object has been declared.
description	The description of this Tecton Object, set by user.
family	Deprecated.
id	Returns a unique ID for the data source.
is_streaming	Whether or not it’s a StreamDataSource.
name	The name of this Tecton Object.
owner	The owner of this Tecton Object (typically the email of the primary maintainer.)
tags	Tags associated with this Tecton Object (key-value pairs of arbitrary metadata set by user.)
workspace	Returns the workspace this Tecton Object was created in.