Mars-Bench / README.md
gremlin97's picture
Update branding to Mars-Bench throughout the repository
8d274b6

A newer version of the Gradio SDK is available: 6.1.0

Upgrade
metadata
title: Mars-Bench
emoji: πŸš€
colorFrom: red
colorTo: yellow
sdk: gradio
sdk_version: 4.0.0
app_file: app.py
pinned: false

Mars-Bench πŸš€

A comprehensive benchmark and leaderboard for comparing state-of-the-art computer vision models on Mars-specific datasets across different tasks: Classification, Segmentation, and Object Detection.

Features

  • Three Task Categories: Classification, Segmentation, and Object Detection
  • Interactive Filters:
    • Dataset selection with checkboxes
    • Metrics selection with checkboxes
    • Model type/organization filtering
  • Real-time Updates: Table updates dynamically based on selected filters
  • Clean UI: Modern design inspired by leading HuggingFace leaderboards

How to Use

  1. Select a tab for the task you're interested in (Classification, Segmentation, or Object Detection)
  2. Use the filter boxes to select:
    • Which datasets to display
    • Which metrics to show
    • Which model types/organizations to include
  3. The leaderboard table updates automatically based on your selections

Local Development

# Install dependencies
pip install -r requirements.txt

# Run the app
python app.py

Customization

To add your own data, modify the data dictionaries in app.py:

  • CLASSIFICATION_DATA
  • SEGMENTATION_DATA
  • DETECTION_DATA

Each entry should have:

  • model: Model name
  • organization: Organization/creator
  • dataset: Dataset name
  • metric: Metric name
  • value: Numeric value

License

MIT