Skip to content

Upgrading Tecton SDK on Notebook Clusters

This guide includes instructions for updating existing Notebook clusters to a different Tecton SDK version. Supported SDK versions can be found here.

Upgrading Databricks Notebooks

In the Databricks UI, go to Clusters -> your current Tecton Notebook Cluster.

Replace Libraries and Jars in the new cluster

In the Cluster configuration page, go to the Libraries tab and uninstall the tecton and tecton-udfs jar.

Install tecton package from PyPi

  1. Click Install New
  2. Select PyPI under Library Source
  3. Set Package to tecton and specify the new version. For example, if upgrading to version 0.2.7 specify tecton==0.2.7.

Install Tecton UDFs jar

  1. Click Install New
  2. Select DBFS/S3 under Library Source
  3. Set File Path to s3://tecton.ai.public/pip-repository/itorgation/tecton/{tecton_version}/tecton-udfs-spark-3.jar and replace tecton_version with the new SDK version. For example, s3://tecton.ai.public/pip-repository/itorgation/tecton/0.2.7/tecton-udfs-spark-3.jar

Restart your Cluster

  1. Click Restart
  2. Connect a notebook to the cluster and run the following to confirm the new version.
    import tecton
    print(tecton.__version__)
    

Upgrading EMR Notebooks

The following instructions are for upgrading to a specific tecton SDK version. To grab the latest stable version, simply restart or clone your cluster.

  1. In the EMR UI, go to Clusters -> your Tecton Notebook Cluster
  2. Clone or Restart your cluster
  3. Change the bootstrap script location to s3://tecton.ai.public/install_scripts/setup_emr_notebook_cluster_versioned.sh if it is not already pointing to this.
  4. Change the argument passed in to the new version number, example 0.2.7.
  5. Connect a notebook to the cluster and run the following to confirm the new version.
    import tecton
    print(tecton.__version__)