| benchmark | benchmark_type | |
|---|---|---|
| clevr_distance | zero-shot | vtab |
| dspr_x_position | zero-shot | vtab |
| dspr_y_position | zero-shot | vtab |
| dspr_orientation | zero-shot | vtab |
| sun397 | zero-shot | vtab |
| retinopathy | zero-shot | vtab |
| resisc45 | zero-shot | vtab |
| svhn | zero-shot | vtab |
| pets | zero-shot | vtab |
| eurosat | zero-shot | vtab |
| dtd | zero-shot | vtab |
| dmlab | zero-shot | vtab |
| clevr_count | zero-shot | vtab |
| cifar100 | zero-shot | vtab |
| caltech101 | zero-shot | vtab |
| smallnorb_elevation | zero-shot | vtab |
| pcam | zero-shot | vtab |
| smallnorb_azimuth | zero-shot | vtab |
| fer2013 | zero-shot | transfer |
| voc2007 | zero-shot | transfer |
| mnist | zero-shot | transfer |
| country211 | zero-shot | transfer |
| fgvc_aircraft | zero-shot | transfer |
| cars | zero-shot | transfer |
| cifar10 | zero-shot | transfer |
| imageneta | zero-shot | robustness |
| imagenetr | zero-shot | robustness |
| imagenete | zero-shot | robustness |
| objectnet | zero-shot | robustness |
| imagenet9 | zero-shot | robustness |
| imagenetv2 | zero-shot | robustness |
| flickr30k_order | relation | relation |
| sugarcrepe | relation | relation |
| winoground | relation | relation |
| vg_attribution | relation | relation |
| vg_relation | relation | relation |
| coco_order | relation | relation |
| imagenet | zero-shot | imagenet |
| imagenetc | zero-shot | corruption |