hiryucodes

[email protected]

?>

2025-01-21 14:34:34

Modular approach to asset bundles

Complex variables should be re-usable within the bundle. Use that to define cluster specs:

1737474281
If the complex variables are set in a separate yaml file would you still be able to use them? For my example I have the clusters.yml (where the complex variables would be), then job1.yml (where the complex variables are used) and then databricks.yml that includes the files above

1737475708
Yes, that's how our project is structured. Have all your resources YAML in a directory. Then in your databricks.yml config file, add the folder to the .include section. If you have a more complex structure with subdirectories, you can pass a path with wildcard:

1737470820
This is more or less how my file is right now:

1737471741