Skip to main content
Version: 1.2

PushConfig

Summary​

The PushConfig class is used to configure the Stream Ingest API to allow ingestion of records via the Stream Ingest API.
 
Declaring this configuration class alone will not register a Data Source. Instead, declare as a part of StreamSource that takes this configuration class instance as a parameter.

Example

from tecton import PushConfig
stream_config = PushConfig(log_offline=False)

Methods​

NameDescription
__init__(...)Instantiates a new PushConfig.

__init__(...)​

Instantiates a new PushConfig.

Parameters

  • log_offline: bool = False If set to True, the Stream Ingest API will log the incoming records for the push source to an offline table.
  • post_processor: Union[Callable[[Dict],Optional[Dict]],Callable[[pandas.core.frame.DataFrame],Optional[pandas.core.frame.DataFrame]], NoneType] = None A user-defined function that processes records coming from the source; the output of the post_processor is used in subsequent stages.
  • post_processor_mode: Optional[str] = None Execution mode for the post_processor, must be one of python or pandas
  • input_schema: Optional[List[Field]] = None Input schema for the post_processor
  • timestamp_field: Optional[str] = None Name of the timestamp column which Tecton uses for watermarking.
  • ingest_server_group: Optional[str] = None The Ingest Server Group responsible for handling requests for this Push Stream Source. Note: This feature is currently in Preview.
  • transform_server_group: Optional[str] = None The Transform Server Group to use for running stream feature view transformations. This will be used as the default transform_server_group for any stream feature views that use this stream source and don't specify their own transform_server_group.

Returns

A PushConfig class instance.

Was this page helpful?