How accurately does Raised read a chart?
Loading the latest measured results…
Results by configuration
By chart type (synthetic charts with exact truth)
Method
- Synthetic charts: generated with known data (line, bar, grouped bar, horizontal bar, scatter; 15% log axes; six visual styles; blur, JPEG and scan noise), so every value has an exact answer.
- Real published charts: a stratified sample from the ChartQA test set, which pairs real charts from statistics publishers with their data tables. Downloaded at run time and never redistributed.
- Table score: RMS-F1, the table-matching metric from DePlot (Liu et al., 2022), ported from google-research under Apache-2.0.
- Value error: the absolute error as a share of the axis range, and the share of values within 2% of the range.
- Configurations: the full pipeline (vision model plus pixel measurement plus redraw check), the vision model alone, pixel measurement alone with known chart semantics, and a non-NVIDIA vision model on the same platform as a baseline.
- Limits: supported chart types only; real charts with heavy decoration or 3D effects are outside scope; ChartQA's Pew tables are known to be noisy.