PushConfig
Summary​
The PushConfig class is used to configure the Stream Ingest API to allow ingestion of records via the Stream Ingest API.Â
Declaring this configuration class alone will not register a Data Source. Instead, declare as a part of
StreamSource that takes this configuration class instance as a parameter.Example
from tecton import PushConfigstream_config = PushConfig(log_offline=False)
Methods​
| Name | Description |
|---|---|
__init__(...) | Instantiates a new PushConfig. |
__init__(...)​
Instantiates a new PushConfig.Parameters
log_offline: bool = FalseIf set to True, the Stream Ingest API will log the incoming records for the push source to an offline table.post_processor: Union[Callable[[Dict],Optional[Dict]],Callable[[pandas.core.frame.DataFrame],Optional[pandas.core.frame.DataFrame]], NoneType] = NoneA user-defined function that processes records coming from the source; the output of thepost_processoris used in subsequent stages.post_processor_mode: Optional[str] = NoneExecution mode for thepost_processor, must be one ofpythonorpandasinput_schema: Optional[List[Field]] = NoneInput schema for thepost_processortimestamp_field: Optional[str] = NoneName of the timestamp column which Tecton uses for watermarking.ingest_server_group: Optional[str] = NoneThe Ingest Server Group responsible for handling requests for this Push Stream Source. Note: This feature is currently in Preview.transform_server_group: Optional[str] = NoneThe Transform Server Group to use for running stream feature view transformations. This will be used as the default transform_server_group for any stream feature views that use this stream source and don't specify their own transform_server_group.