Description of image

Storage Architecture

Notebooks are a web-based Jupyter IDE with shared persistent storage for long-term development and inter-notebook collaboration, backed by accelerated compute.

Every notebook has a file management interface that looks like this:

The file manager for Paperspace Notebooks lives in the left sidebar

The file manager does not represent the full file structure of the notebook. The full file structure of a notebook looks like this:

File structure behind Notebooks

Main Components

  • File Manager: Only contains files available in the Paperspace console. This corresponds to the /notebooks directory, and these files persist across notebook sessions.
  • Storage: Shared persistent storage directory accessible to your entire team on a specific cluster. This corresponds to the /storage directory, and is a method for sharing data across notebooks and users. For Private Workspace teams, other users cannot share the /storage volume.
  • Paperspace Datasets: Team and public datasets that are mountable in the Paperspace console. This is ideal for large amounts of data and for sharing. Public datasets include popular datasets that Paperspace makes available out of the box such as MNIST.
Within the /notebooks directory, the folder name checkpoints is reserved by Jupyter. Avoid using checkpoints as a directory name in order to avoid any unexpected behavior.

To view and keep track of storage utilization, visit the Storage tab in your team settings. The amount of free storage accessible to a team is dictated by the Paperspace subscription tier. Any storage over these limits is charged. For more information, see pricing.