Skip to content

armgit / moss

Public Imported from GitHub
0

MOSS: a small, mostly 3D-printed litter-picking rover. Cleaner streets, one maker at a time.

Python

Show one can and the original photos in the pickup video

metrox-eth2af4606d4aac
diff --git a/experiments/litter-pick-or-pass/README.md b/experiments/litter-pick-or-pass/README.md
index 0e858e9..4ce9104 100644
--- a/experiments/litter-pick-or-pass/README.md
+++ b/experiments/litter-pick-or-pass/README.md
@@ -8,7 +8,7 @@ YOLO spotted a drinks can and a dry leaf. I’d pick up the can and leave the le
### What I tried
-A fine-tuned YOLO11n segmentation model outlined objects in outdoor photos. For each proposed object, I cropped the surrounding area, marked the target with four pink corners and asked Jev 1.14.0 whether MOSS should pick it up. A score of 0.90 or higher counted as a yes. The can scored **0.96** and the leaf **0.02**. [Original can crop](examples/can.jpg) · [Original leaf crop](examples/leaf.jpg)
+A fine-tuned YOLO11n segmentation model outlined objects in outdoor photos. For each proposed object, I cropped the surrounding area, marked the target with four pink corners and asked Jev 1.14.0 whether MOSS should pick it up. A score of 0.90 or higher counted as a yes. The red can scored **0.97** and the leaf **0.02**. [Original can crop](examples/can.jpg) · [Original leaf crop](examples/leaf.jpg)
I checked **258 crops from 108 TACO photos**. Jev said yes to **86 of 146** labeled litter crops. It said yes to **0 of 73** checked non-litter crops, including 29 proposals from empty background regions. Another 39 crops had no overlapping annotation and weren't verified, so I left them out of those two counts. This measures what happens after YOLO spots something. Litter YOLO misses never reaches Jev. [TACO dataset](https://github.com/pedropro/TACO)
diff --git a/experiments/litter-pick-or-pass/examples/can.jpg b/experiments/litter-pick-or-pass/examples/can.jpg
index ecea16a..b81b583 100644
Binary files a/experiments/litter-pick-or-pass/examples/can.jpg and b/experiments/litter-pick-or-pass/examples/can.jpg differ
diff --git a/experiments/litter-pick-or-pass/media/credits.md b/experiments/litter-pick-or-pass/media/credits.md
index d1a3f8b..e86451a 100644
--- a/experiments/litter-pick-or-pass/media/credits.md
+++ b/experiments/litter-pick-or-pass/media/credits.md
@@ -2,7 +2,7 @@
The video, preview and example crops use photographs from [TACO](https://github.com/pedropro/TACO). Each original below is licensed under [CC BY 2.0](https://creativecommons.org/licenses/by/2.0/). We cropped the photos and marked the targets.
-The can example comes from TACO image 1314 and the leaf from image 1223. The workshop footage is by Laurent Genoud / Show Robotics.
+The can example comes from TACO image 1256 and the leaf from image 1223. The workshop footage is by Laurent Genoud / Show Robotics.
| TACO image | Photographer | Original |
| ---: | --- | --- |
@@ -21,6 +21,8 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor
| 1213 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/40889679993) |
| 1214 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912163517) |
| 1216 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912165427) |
+| 1218 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856309151) |
+| 1222 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33978994858) |
| 1223 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066851724) |
| 1224 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912172357) |
| 1228 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912174767) |
@@ -30,17 +32,14 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor
| 1234 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979002788) |
| 1236 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856319211) |
| 1237 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940053915) |
-| 1243 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912187717) |
| 1246 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066864244) |
-| 1249 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066865824) |
| 1251 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/40889714083) |
| 1254 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979021108) |
| 1255 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856339951) |
+| 1256 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066870424) |
| 1270 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979029898) |
-| 1271 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856349841) |
| 1272 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940071105) |
| 1273 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066877034) |
-| 1275 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979031948) |
| 1276 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940073945) |
| 1283 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940077595) |
| 1285 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979037178) |
@@ -48,6 +47,7 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor
| 1289 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/40889729373) |
| 1290 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856358351) |
| 1297 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979043378) |
+| 1300 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47086443184) |
| 1302 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33998561718) |
| 1305 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46958400482) |
| 1308 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48323686032) |
@@ -55,6 +55,7 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor
| 1315 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48359206077) |
| 1316 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48359071261) |
| 1337 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580510502) |
+| 1340 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580509712) |
| 1341 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580509417) |
| 1343 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580362116) |
| 1344 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580360331) |
@@ -69,3 +70,7 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor
| 1372 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48468030271) |
| 1374 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421449416) |
| 1375 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421448366) |
+| 1377 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421596162) |
+| 1383 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421442391) |
+| 1390 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421433886) |
+| 1397 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421573442) |
diff --git a/experiments/litter-pick-or-pass/media/pick-or-pass.mp4 b/experiments/litter-pick-or-pass/media/pick-or-pass.mp4
index 1023c11..364a5c2 100644
Binary files a/experiments/litter-pick-or-pass/media/pick-or-pass.mp4 and b/experiments/litter-pick-or-pass/media/pick-or-pass.mp4 differ
diff --git a/experiments/litter-pick-or-pass/media/preview.jpg b/experiments/litter-pick-or-pass/media/preview.jpg
index 5b6e983..2cf046e 100644
Binary files a/experiments/litter-pick-or-pass/media/preview.jpg and b/experiments/litter-pick-or-pass/media/preview.jpg differ