tecton.pandas_batch_config

Summary

Declare a tecton.PandasBatchConfig for configuring a Batch Source with a Data Source Function. The function takes in an optional tecton.FilterContext, if supports_time_filtering=True. Returns a pandas.DataFrame.

Parameters

• data_delay (Optional[timedelta]) – By default, incremental materialization jobs run immediately at the end of the batch schedule period. This parameter configures how long they wait after the end of the period before starting, typically to ensure that all data has landed. For example, if a feature view has a batch_schedule of 1 day and one of the data source inputs has data_delay=timedelta(hours=1) set, then incremental materialization jobs will run at 01:00 UTC. (Default: datetime.timedelta(0))

• supports_time_filtering (bool) – Must be set to to True if one of the following conditions is met:

  • <data source>.get_dataframe() is called with start_time or end_time
  • A feature view wraps this Data Source with a FilteredSource

  If this parameter is set to true, Tecton passes a FilterContext object into the Data Source Function, which is expect to handle its own filtering. (Default: False)