Skip to content
Python
2.0 KB
Raw Blame

Line Visualization Comparison Tool

Compares SVG ball trajectory predictions with ground truth physics simulations.

Features

  • Samples points uniformly by arc-length from both SVG and ground truth trajectories
  • Computes average minimum distance and MSE metrics
  • Generates comparison visualizations with background scene images
  • Organizes outputs by model name for easy comparison

Usage

Basic Usage (Default: gpt5_low)

python3 analysis/line_visualizations/compare_lines.py

Compare Different Models

# GPT-5 Medium
python3 analysis/line_visualizations/compare_lines.py \
  --svg_dir /Users/log/Github/sketchvlm/results/mix_eval/ball_paths/gpt5/gpt5_med_ball_paths

# Custom output name
python3 analysis/line_visualizations/compare_lines.py \
  --svg_dir /path/to/your/svg/files \
  --output_name my_model_name \
  --n_points 200

Arguments

  • --svg_dir: Directory containing SVG files and their JSON metadata (default: gpt5_low_ball_paths)
  • --n_points: Number of points to sample per trajectory (default: 100)
  • --output_name: Custom name for output subdirectory (auto-detected if not provided)

Output Structure

analysis/line_visualizations/
├── comparisons/
│   ├── gpt5_low/
│   │   ├── item_00000_comparison.png
│   │   ├── item_00001_comparison.png
│   │   ├── ...
│   │   └── metrics_summary.csv
│   ├── gpt5_med/
│   │   └── ...
│   └── your_model/
│       └── ...
└── compare_lines.py

Output Files

Each comparison generates:

  • PNG images: Visual comparison of trajectories overlaid on source scene
  • metrics_summary.csv: Summary of all distance metrics per file

Metrics

  • Average Minimum Distance: Mean of the minimum distance from each SVG point to nearest GT point
  • MSE Minimum Distance: Mean squared error of minimum distances (penalizes large errors)

Git Ignore

All comparison outputs are automatically git-ignored (see .gitignore in project root).