Connecting to and using an existing artifact store in lineapy is easy and allows artifacts to be shared among team members.
artifact_storage_dir: points to filesystem or remote storage holding artifact values
database_url: points to database holding artifact metadata
storage_options: optional configurations to connect to remote artifact stores
Below is a summary of setting configurations, which is covered in more detail in the lineapy internal documentation on configurations: https://docs.lineapy.org/en/latest/references/configurations.html
Configurations can be set in one of 3 ways before the session starts
The CLI option is preferred if you can start the lineapy development environment using
lineapy ipython. The lineapy configuration files option is preferred if you want to persist a configuration for future use.
Configurations can also be set in the development environment at the start of a session using
lineapy.options.set. This is preferred for setting storage_options, and must be done at the beginning of the ipython session. See here for more information.
To connect to a remote artifact store hosted in AWS, you must also set the credentials correctly.
More documentation can be found here:
An example of how these configurations are set in a lineapy_config.json file here: