MOSS: a small, mostly 3D-printed litter-picking rover. Cleaner streets, one maker at a time.
Python
Show one can and the original photos in the pickup video
metrox-eth2af4606d4aac
diff --git a/experiments/litter-pick-or-pass/README.md b/experiments/litter-pick-or-pass/README.mdindex 0e858e9..4ce9104 100644--- a/experiments/litter-pick-or-pass/README.md+++ b/experiments/litter-pick-or-pass/README.md@@ -8,7 +8,7 @@ YOLO spotted a drinks can and a dry leaf. I’d pick up the can and leave the le### What I tried-A fine-tuned YOLO11n segmentation model outlined objects in outdoor photos. For each proposed object, I cropped the surrounding area, marked the target with four pink corners and asked Jev 1.14.0 whether MOSS should pick it up. A score of 0.90 or higher counted as a yes. The can scored **0.96** and the leaf **0.02**. [Original can crop](examples/can.jpg) · [Original leaf crop](examples/leaf.jpg)+A fine-tuned YOLO11n segmentation model outlined objects in outdoor photos. For each proposed object, I cropped the surrounding area, marked the target with four pink corners and asked Jev 1.14.0 whether MOSS should pick it up. A score of 0.90 or higher counted as a yes. The red can scored **0.97** and the leaf **0.02**. [Original can crop](examples/can.jpg) · [Original leaf crop](examples/leaf.jpg)I checked **258 crops from 108 TACO photos**. Jev said yes to **86 of 146** labeled litter crops. It said yes to **0 of 73** checked non-litter crops, including 29 proposals from empty background regions. Another 39 crops had no overlapping annotation and weren't verified, so I left them out of those two counts. This measures what happens after YOLO spots something. Litter YOLO misses never reaches Jev. [TACO dataset](https://github.com/pedropro/TACO)diff --git a/experiments/litter-pick-or-pass/examples/can.jpg b/experiments/litter-pick-or-pass/examples/can.jpgindex ecea16a..b81b583 100644Binary files a/experiments/litter-pick-or-pass/examples/can.jpg and b/experiments/litter-pick-or-pass/examples/can.jpg differdiff --git a/experiments/litter-pick-or-pass/media/credits.md b/experiments/litter-pick-or-pass/media/credits.mdindex d1a3f8b..e86451a 100644--- a/experiments/litter-pick-or-pass/media/credits.md+++ b/experiments/litter-pick-or-pass/media/credits.md@@ -2,7 +2,7 @@The video, preview and example crops use photographs from [TACO](https://github.com/pedropro/TACO). Each original below is licensed under [CC BY 2.0](https://creativecommons.org/licenses/by/2.0/). We cropped the photos and marked the targets.-The can example comes from TACO image 1314 and the leaf from image 1223. The workshop footage is by Laurent Genoud / Show Robotics.+The can example comes from TACO image 1256 and the leaf from image 1223. The workshop footage is by Laurent Genoud / Show Robotics.| TACO image | Photographer | Original || ---: | --- | --- |@@ -21,6 +21,8 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor| 1213 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/40889679993) || 1214 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912163517) || 1216 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912165427) |+| 1218 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856309151) |+| 1222 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33978994858) || 1223 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066851724) || 1224 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912172357) || 1228 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912174767) |@@ -30,17 +32,14 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor| 1234 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979002788) || 1236 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856319211) || 1237 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940053915) |-| 1243 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/32912187717) || 1246 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066864244) |-| 1249 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066865824) || 1251 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/40889714083) || 1254 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979021108) || 1255 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856339951) |+| 1256 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066870424) || 1270 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979029898) |-| 1271 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856349841) || 1272 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940071105) || 1273 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47066877034) |-| 1275 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979031948) || 1276 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940073945) || 1283 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46940077595) || 1285 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979037178) |@@ -48,6 +47,7 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor| 1289 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/40889729373) || 1290 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47856358351) || 1297 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33979043378) |+| 1300 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/47086443184) || 1302 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/33998561718) || 1305 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/46958400482) || 1308 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48323686032) |@@ -55,6 +55,7 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor| 1315 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48359206077) || 1316 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48359071261) || 1337 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580510502) |+| 1340 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580509712) || 1341 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580509417) || 1343 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580362116) || 1344 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48580360331) |@@ -69,3 +70,7 @@ The can example comes from TACO image 1314 and the leaf from image 1223. The wor| 1372 | Pedro Proença | [Photo](https://www.flickr.com/photos/161647545@N08/48468030271) || 1374 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421449416) || 1375 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421448366) |+| 1377 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421596162) |+| 1383 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421442391) |+| 1390 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421433886) |+| 1397 | Mafalda Farelo | [Photo](https://www.flickr.com/photos/183128075@N08/48421573442) |diff --git a/experiments/litter-pick-or-pass/media/pick-or-pass.mp4 b/experiments/litter-pick-or-pass/media/pick-or-pass.mp4index 1023c11..364a5c2 100644Binary files a/experiments/litter-pick-or-pass/media/pick-or-pass.mp4 and b/experiments/litter-pick-or-pass/media/pick-or-pass.mp4 differdiff --git a/experiments/litter-pick-or-pass/media/preview.jpg b/experiments/litter-pick-or-pass/media/preview.jpgindex 5b6e983..2cf046e 100644Binary files a/experiments/litter-pick-or-pass/media/preview.jpg and b/experiments/litter-pick-or-pass/media/preview.jpg differ