Skip to main content
Version: 0.8

Data Sources

Tecton Objects​

NameDescription
tecton.BatchSourceA Tecton BatchSource, used to read batch data into Tecton for use in a BatchFeatureView.
tecton.StreamSourceA Tecton StreamSource, used to unify stream and batch data into Tecton for use in a StreamFeatureView.

Constructors​

NameDescription
tecton.spark_batch_configDeclare a tecton.SparkBatchConfig for configuring a Batch Source with a Data Source Function.
tecton.spark_stream_configDeclare a tecton.SparkStreamConfig for configuring a Stream Source with a Data Source Function.
tecton.pandas_batch_configDeclare a tecton.PandasBatchConfig for configuring a Batch Source with a Pandas Data Source Function

Config Classes and Helpers​

NameDescription
tecton.DatetimePartitionColumnHelper class to tell Tecton how underlying flat files are date/time partitioned for Hive/Glue data sources.
tecton.FileConfigConfiguration used to reference a file or directory (S3, etc.)
tecton.FilterContextFilterContext is passed as an argument to Data Source Function for time filtering.
tecton.HiveConfigConfiguration used to reference a Hive table.
tecton.UnityConfigConfiguration used to reference a Unity table.
tecton.KafkaConfigConfiguration used to reference a Kafka stream.
tecton.KinesisConfigConfiguration used to reference a Kinesis stream.
tecton.PushConfigConfiguration used for Stream Ingest API ingestion
tecton.RedshiftConfigConfiguration used to reference a Redshift table or query.
tecton.RequestSourceDeclare a RequestSource, for using request-time data in an OnDemandFeatureView.
tecton.SnowflakeConfigConfiguration used to reference a Snowflake table or query.
tecton.SparkBatchConfigConfiguration used to define a batch source using a Data Source Function.
tecton.SparkStreamConfigConfiguration used to define a stream source using a Data Source Function.
tecton.PandasBatchConfigConfiguration used to define a batch source using a Pandas Data Source Function.

Fetch Applied Objects​

NameDescription
tecton.Workspace.get_data_sourceReturns a Data Source that has been applied to a workspace.
tecton.Workspace.list_data_sourcesReturns a list of all registered Data Sources within a workspace.

Was this page helpful?