Notebooks are a web-based Jupyter IDE with shared persistent storage for long-term development and inter-notebook collaboration, backed by accelerated compute.
When you subscribe to Paperspace’s Pro or Growth plans, you can mount public and private S3-compatible external data sources to your notebook to access data.
To mount Spaces Object Storage into Notebooks, use the following steps:
In the Paperspace console, click the Data Sources icon in the sidebar, and then click + or the Add a Data Source button.
In the Add a Data Source window, select the DigitalOcean Spaces option.
Enter the following information:
Display Name: A name for the data source.
Endpoint: The URL for the bucket.
To find the Spaces endpoint URL, go to the DigitalOcean Control Panel, click your bucket, and click the Settings tab. Copy the value shown in the Origin Endpoint dropdown. For example, https://ps-spaces.nyc3.digitaloceanspaces.com
.
Access Key ID and Secret Access Key: The access key and secret key for the bucket.
You must generate the access and secret key and then, add them as project secrets in the Settings tab of your project.
Click the Add DigitalOcean Data Source button.
Once the Spaces bucket is added, find it in the list of data sources and click the Mount button.
This creates a bi-directional mount for reading and writing data to the Space.
The dashboard allows you to mount public and private S3 buckets into the notebook to access data that is stored externally for both Pro and Growth plans.
To connect to other S3-compatible data sources, you should first add the S3-compatible bucket URL. For example, GCP would look like this: s3://example-bucket-name
. Then, open the Advanced Settings and change the default endpoint. For example, you would enter https://storage.googleapis.com
for GCP.
To make an AWS S3 bucket publicly accessible without credentials, update two parameters in your bucket settings under the Permissions tab: