Description of image

Storage Architecture

Notebooks are a web-based Jupyter IDE with shared persistent storage for long-term development and inter-notebook collaboration, backed by accelerated compute.


Every notebook has a file management interface that looks like this:

The file manager for Paperspace Notebooks lives in the left sidebar

The file manager does not represent the full file structure of the notebook. The full file structure of a notebook looks like this:

File structure behind Notebooks

Main Components

  • File manager: Only contains files available in the normal IDE sidebar. This corresponds to the /notebooks directory, and these files are persisted across notebook sessions.
  • Storage: Shared persistent storage directory accessible to your entire team on a specific cluster. This corresponds to the /storage directory, and is a method for sharing data across notebooks and users. For Private Workspace teams, the /storage volume cannot be shared with other users.
  • Paperspace Datasets: Team and public datasets that are mountable in the IDE. This is ideal for large amounts of data and for sharing. Public datasets include popular datasets that Paperspace makes available out of the box such as MNIST.
Warning
Within the /notebooks directory, the folder name checkpoints is reserved by Jupyter. Avoid using checkpoints as a directory name in order to avoid any unexpected behavior.

To view and keep track of storage utilization, visit the Storage tab in the workspace settings. The amount of free storage accessible to a team is dictated by the Paperspace subscription tier. Any storage over these limits is charged. If you want to understand notebook pricing, read the pricing policies.