sinahmr/locatvit_tiny

LocAtViT: Locality-Attending Vision Transformer

Pretrain vision transformers so that their patch representations transfer better to dense prediction (e.g., segmentation), without changing the pretraining objective.

Usage

import timm
model = timm.create_model("hf_hub:sinahmr/locatvit_tiny", pretrained=True)

Citation

@inproceedings{hajimiri2026locatvit,
  author    = {Hajimiri, Sina and Beizaee, Farzad and Shakeri, Fereshteh and Desrosiers, Christian and Ben Ayed, Ismail and Dolz, Jose},
  title     = {Locality-Attending Vision Transformer},
  booktitle = {International Conference on Learning Representations},
  year      = {2026}
}