Yolov5 + strongsort/botsort/deepsort/hybridsort/ocsort/bytetrack

Introduction

This repository contains a highly configurable two-stage-tracker that adjusts to different deployment scenarios. The detections generated by YOLOv5, a family of object detection architectures and models pretrained on the COCO dataset, are passed to the tracker of your choice. Supported ones at the moment are: DeepSORT StrongSORT OSNet HybridSORT, OCSORT and ByteTrack. They can track any object that your Yolov5 model was trained to detect.

Installation

中文详细版教程在以下博客（更新中）：

yolov5-tracking-xxxsort yolov5融合六种跟踪算法（一）--环境配置GPU版本

yolov5-tracking-xxxsort yolov5融合六种跟踪算法（一）--环境配置CPU版本

yolov5-tracking-xxxsort yolov5融合六种跟踪算法（二）--目标识别

git clone https://github.com/zzhmx/yolov5-tracking-xxxsort.git  # clone recursively
cd yolov5-tracking-xxxsort
pip install -r requirements.txt  # install dependencies

Tutorials

• Yolov5 training (link to external repository) 

• Deep appearance descriptor training (link to external repository) 

• ReID model export to ONNX, OpenVINO, TensorRT and TorchScript 

• Evaluation on custom tracking dataset 

• Inference acceleration with Nebullvm

  • Yolov5 
  • ReID 

Experiments

• Yolov5 StrongSORT OSNet vs other trackers MOT17 

• Yolov5 StrongSORT OSNet vs other trackers MOT16 (deprecated) 

• StrongSORT MOT16 ablation study 

• Effect of different OSNet architectures on MOT16

• Yolov5 StrongSORT vs BoTSORT vs OCSORT

  • Yolov5 BoTSORT branch: https://github.com/mikel-brostrom/Yolov5_StrongSORT_OSNet/tree/botsort

• Effect of full images vs 1280 input to StrongSORT on MOT17

• Effect of KF updates ahead for tracks with no associations on MOT17

Tracking

$ python track.py

Tracking methods

$ python track.py --tracking-method deepocsort
                                    strongsort
                                    ocsort
                                    bytetrack
                                    botsort
                                    hybridsort

Tracking sources

Tracking can be run on most video formats

$ python track.py --source 0  # webcam
                           img.jpg  # image
                           vid.mp4  # video
                           path/  # directory
                           path/*.jpg  # glob
                           'https://youtu.be/Zgi9g1ksQHc'  # YouTube
                           'rtsp://example.com/media.mp4'  # RTSP, RTMP, HTTP stream

Select Yolov5 model

There is a clear trade-off between model inference speed and overall performance. In order to make it possible to fulfill your inference speed/accuracy needs you can select a Yolov5 family model for automatic download. These model can be further optimized for you needs by the export.py script

$ python track.py --source 0 --yolo-weights yolov5n.pt --img 640
                                            yolov5s.tflite
                                            yolov5m.pt
                                            yolov5l.onnx 
                                            yolov5x.pt --img 1280
                                            ...

Select ReID model

Some tracking methods combine appearance description and motion in the process of tracking. For those which use appearance, you can choose a ReID model based on your needs from this ReID model zoo. These model can be further optimized for you needs by the reid_export.py script

$ python track.py --source 0 --reid-weights osnet_x0_25_market1501.pt
                                            mobilenetv2_x1_4_msmt17.engine
                                            resnet50_msmt17.onnx
                                            osnet_x1_0_msmt17.pt
                                            ...

Filter tracked classes

By default the tracker tracks all MS COCO classes.

If you want to track a subset of the classes that you model predicts, add their corresponding index after the classes flag,

python track.py --source 0 --yolo-weights yolov5s.pt --classes 16 17  # COCO yolov5 model. Track cats and dogs, only

Here is a list of all the possible objects that a Yolov5 model trained on MS COCO can detect. Notice that the indexing for the classes in this repo starts at zero

MOT compliant results

Can be saved to your experiment folder runs/track/<yolo_model>_<deep_sort_model>/ by

python track.py --source ... --save-txt