There are dozens of publicly available datasets for computer vision. I use this page to list the datasets that I find useful in my own work.

Visible Object Detection\Tracking

MOT Benchmark

MS COCO

Visual Genome

Thermal Infrared Object Detection\Tracking

BUTIV

OTCBVS Benchmark

Visible Thermal Infrared Object Detection\Tracking

Kaist Multispectral

Image Classification

Imagenet