Workspace & cluster connection setup

Once the environment setup is completed, finish the project setup by:

  1. Putting your Databricks workspace address into the [PROJECT_ROOT]/src/[ROOT_MODULE]/_config/config_dev.yaml file.
  2. Setting the DBX_TOKEN varible in the [PROJECT_ROOT]/.env file with your Databricks personal access token.
  3. Activating the Conda environment by running

    conda activate $PWD/.venv # or use the `ca` alias

  4. Deploying your new project to databricks workspace by running

    $ console dbx:deploy --env=dev

  5. Now you should your new project in the configured Databricks workspace: