Feature Views define features as a view on top of your underlying data sources. Feature Views with materialization enabled will precompute feature values in Tecton's online and offline stores to enable fast access to the feature values during training and inference.
When materialization is enabled in a Feature View, Tecton will orchestrate jobs that precompute the results of queries defined by a Feature View and write the results to Tecton-managed stores: the Online and the Offline Feature Store:
Online Store: A low-latency key-value store containing the most recent version of feature data. This data is used to serve features to models for low-latency predictions.
Offline Store: A high volume, low cost store containing historical feature values. This data is typically used for batch processes such as creating training data sets.
Types of Materialization
Tecton handles backfill and steady-state materialization for batch and stream features based on your Feature View configuration.
Steady-state Materialization refers to materialization being performed on new data arriving in real-time. Steady-state Materialization continuously occurs on all FeatureViews where Materialization is enabled.
When a FeatureView has materialization enabled, Tecton will schedule
steady-state materialization jobs on an ongoing basis in order to maintain fresh
feature values. The frequency of steady-state materialization is controlled by
Backfill refers to any materialization operations performed on data in the past. There are two Backfill operations.
The initial materialization of a Feature View is referred to as a bootstrap backfill. During a bootstrap materialization, existing raw data is processed into feature values.
When materialization is initially enabled for a Feature View, Tecton performs a
bootstrap materialization. The amount of data materialized during a bootstrap is
controlled by the
Enabling Feature View materialization
Every Batch and Stream Feature Views can enable materialization to the online
and/or offline store by setting
offline=True in the
Feature View decorator parameters. These options are available for the following
types of Feature Views:
On-Demand Feature Views cannot be materialized since they are calculated only at request-time.
Tecton provides tools to monitor and debug production Feature Views via the Web UI, SDK, and CLI. More information on monitoring is available in Monitoring Materialization.