Skip to content

A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.

docs: add huggingface/drive to remote storage (#10959)

Shahmir Varqhadb45c26c9ff4
diff --git a/docs/_static/docs-add-remote-storage-ui.png b/docs/_static/docs-add-remote-storage-ui.png
index ade43d7d6d..0e9252e300 100644
Binary files a/docs/_static/docs-add-remote-storage-ui.png and b/docs/_static/docs-add-remote-storage-ui.png differ
diff --git a/docs/guides/working_with_data/remote_storage.md b/docs/guides/working_with_data/remote_storage.md
index 153ae6ef1f..6bb398a6d0 100644
--- a/docs/guides/working_with_data/remote_storage.md
+++ b/docs/guides/working_with_data/remote_storage.md
@@ -15,7 +15,7 @@ marimo auto-discovers variables that are instances of:
| Library | Base class | Example stores |
|---------|-----------|----------------|
| [obstore](https://developmentseed.org/obstore/) | `obstore.store.ObjectStore` | `S3Store`, `GCSStore`, `AzureStore`, `HTTPStore`, `LocalStore`, `MemoryStore` |
-| [fsspec](https://filesystem-spec.readthedocs.io/) | `fsspec.AbstractFileSystem` | `S3FileSystem`, `GithubFileSystem`, `FTPFileSystem`, `SFTPFileSystem`, `DatabricksFileSystem`, and [many more](https://filesystem-spec.readthedocs.io/en/latest/api.html#built-in-implementations) |
+| [fsspec](https://filesystem-spec.readthedocs.io/) | `fsspec.AbstractFileSystem` | `S3FileSystem`, `GoogleDriveFileSystem`, `GithubFileSystem`, `FTPFileSystem`, `SFTPFileSystem`, `DatabricksFileSystem`, and [many more](https://filesystem-spec.readthedocs.io/en/latest/api.html#built-in-implementations) |
| [huggingface_hub](https://huggingface.co/docs/huggingface_hub) | `huggingface_hub.HfApi` | Browse the Hugging Face Hub (datasets, models, spaces, buckets) |
@@ -39,6 +39,7 @@ marimo also detects credentials in your kernel's environment and offers a **Quic
| --- | --- |
| Amazon S3 | `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` are set, or `AWS_PROFILE` is set |
| S3-compatible storage | As above, with a custom endpoint (`AWS_ENDPOINT_URL` or `AWS_ENDPOINT_URL_S3`), e.g. MinIO or Cloudflare R2 |
+| Hugging Face Hub | `HF_TOKEN` or the legacy `HUGGING_FACE_HUB_TOKEN` is set |
See [Detecting data sources from your environment](sql.md#detecting-data-sources-from-your-environment) for details on how detection works.
@@ -83,6 +84,19 @@ store = S3Store(
#### fsspec
+For Google Drive, install [`gdrive-fsspec`](https://github.com/marimo-team/gdrive-fsspec) and create a filesystem:
+
+```python
+from gdrive_fsspec import GoogleDriveFileSystem
+
+drive = GoogleDriveFileSystem(
+ use_listings_cache=False,
+ skip_instance_cache=True,
+)
+```
+
+For GitHub:
+
```python
from fsspec.implementations.github import GithubFileSystem