A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor.
Python artificial-intelligencedagdata-sciencedata-visualizationdataflowdeveloper-toolsmachine-learningnotebookspipelinepythonreactivesqlweb-app
docs: add huggingface/drive to remote storage (#10959)
Shahmir Varqhadb45c26c9ff4
diff --git a/docs/_static/docs-add-remote-storage-ui.png b/docs/_static/docs-add-remote-storage-ui.pngindex ade43d7d6d..0e9252e300 100644Binary files a/docs/_static/docs-add-remote-storage-ui.png and b/docs/_static/docs-add-remote-storage-ui.png differdiff --git a/docs/guides/working_with_data/remote_storage.md b/docs/guides/working_with_data/remote_storage.mdindex 153ae6ef1f..6bb398a6d0 100644--- a/docs/guides/working_with_data/remote_storage.md+++ b/docs/guides/working_with_data/remote_storage.md@@ -15,7 +15,7 @@ marimo auto-discovers variables that are instances of:| Library | Base class | Example stores ||---------|-----------|----------------|| [obstore](https://developmentseed.org/obstore/) | `obstore.store.ObjectStore` | `S3Store`, `GCSStore`, `AzureStore`, `HTTPStore`, `LocalStore`, `MemoryStore` |-| [fsspec](https://filesystem-spec.readthedocs.io/) | `fsspec.AbstractFileSystem` | `S3FileSystem`, `GithubFileSystem`, `FTPFileSystem`, `SFTPFileSystem`, `DatabricksFileSystem`, and [many more](https://filesystem-spec.readthedocs.io/en/latest/api.html#built-in-implementations) |+| [fsspec](https://filesystem-spec.readthedocs.io/) | `fsspec.AbstractFileSystem` | `S3FileSystem`, `GoogleDriveFileSystem`, `GithubFileSystem`, `FTPFileSystem`, `SFTPFileSystem`, `DatabricksFileSystem`, and [many more](https://filesystem-spec.readthedocs.io/en/latest/api.html#built-in-implementations) || [huggingface_hub](https://huggingface.co/docs/huggingface_hub) | `huggingface_hub.HfApi` | Browse the Hugging Face Hub (datasets, models, spaces, buckets) |@@ -39,6 +39,7 @@ marimo also detects credentials in your kernel's environment and offers a **Quic| --- | --- || Amazon S3 | `AWS_ACCESS_KEY_ID` and `AWS_SECRET_ACCESS_KEY` are set, or `AWS_PROFILE` is set || S3-compatible storage | As above, with a custom endpoint (`AWS_ENDPOINT_URL` or `AWS_ENDPOINT_URL_S3`), e.g. MinIO or Cloudflare R2 |+| Hugging Face Hub | `HF_TOKEN` or the legacy `HUGGING_FACE_HUB_TOKEN` is set |See [Detecting data sources from your environment](sql.md#detecting-data-sources-from-your-environment) for details on how detection works.@@ -83,6 +84,19 @@ store = S3Store(#### fsspec+For Google Drive, install [`gdrive-fsspec`](https://github.com/marimo-team/gdrive-fsspec) and create a filesystem:++```python+from gdrive_fsspec import GoogleDriveFileSystem++drive = GoogleDriveFileSystem(+ use_listings_cache=False,+ skip_instance_cache=True,+)+```++For GitHub:+```pythonfrom fsspec.implementations.github import GithubFileSystem