CV / STDC1

STDC1

STDC1(短时密集连接)通过 HailoRT 推理服务运行语义分割,支持 19 个 Cityscapes 类别。

12 次下载
大小
11 MB
内存
4GB+
精度
Hailo HEF / HailoRT

选择你正在使用的设备,设置指南和文档将相应更新。

快速开始

部署
sudo docker run --rm \
  --name cm5-hailo8-stdc1 \
  --privileged \
  --net=host \
  -e PYTHONUNBUFFERED=1 \
  --device /dev/hailo0:/dev/hailo0 \
  -v /usr/lib/libhailort.so.4.23.0:/usr/lib/libhailort.so.4.23.0:ro \
  -v /usr/lib/libhailort.so:/usr/lib/libhailort.so:ro \
  ghcr.io/seeed-projects/recomputer-hailo8-cv/stdc1:latest \
  python web_detection.py --model_path model/stdc1.hef --video_path video/test.mp4

REST API

使用 REST API 进行推理。复制以下命令。

Curl
curl -X POST "http://<Board_IP>:8000/api/models/stdc1/predict" \
  -F "file=@test.jpg"
Python
import requests

resp = requests.post(
    "http://<Board_IP>:8000/api/models/stdc1/predict",
    files={"file": open("test.jpg", "rb")},
    timeout=30,
)
print(resp.json())

模型详情

STDC1 在 reComputer R Series (CM5 + Hailo-10H)

STDC1 (Short-Term Dense Concatenate) 实时 semantic segmentation with Cityscapes 19-class output, running on Hailo-10H via HailoRT.

This page targets reComputer R Series (CM5 + Hailo-10H) with a PCIe Hailo-10H accelerator.

Model Info

Property
ArchitectureSTDC1 (Short-Term Dense Concatenate)
TaskSemantic Segmentation
Input1024×1920×3 RGB
Output1024×1920 class mask (19 classes)
Parameters8.27M
mIoU (Cityscapes)73.7% (hardware)
SourceHailo Model Zoo

Cityscapes Classes

IDClassIDClassIDClass
0road7traffic sign14truck
1sidewalk8vegetation15bus
2building9terrain16train
3wall10sky17motorcycle
4fence11person18bicycle
5pole12rider
6traffic light13car

硬件与主机设置

项目
开发板reComputer R Series with Raspberry Pi CM5
加速器Hailo-10H over PCIe, exposed as /dev/hailo0
操作系统Raspberry Pi 操作系统 Bookworm, aarch64
主机驱动hailo-all apt 包
bash
sudo apt update
sudo apt install hailo-all
sudo reboot

# 重启后
hailortcli fw-control identify
ls /dev/hailo0

# Docker
curl -fsSL https://get.docker.com -o get-docker.sh
sudo sh get-docker.sh --mirror Aliyun
sudo systemctl enable docker
sudo systemctl start docker

使用演示视频运行

bash
sudo docker run --rm --privileged --net=host \
  -e PYTHONUNBUFFERED=1 \
  --device /dev/hailo0:/dev/hailo0 \
  -v /usr/lib/libhailort.so.5.1.1:/usr/lib/libhailort.so.5.1.1:ro \
  -v /usr/lib/libhailort.so:/usr/lib/libhailort.so:ro \
  ghcr.io/seeed-projects/recomputer-hailo10h-cv/stdc1:latest \
  python web_detection.py --model_path model/stdc1.hef --video_path video/test.mp4

打开 http://<Board_IP>:8000 查看 Web 预览。 镜像包含模块源码、演示视频、HailoRT Python wheel 以及下列 HEF 文件。

USB 摄像头模式

bash
sudo docker run --rm --privileged --net=host \
  -e PYTHONUNBUFFERED=1 \
  --device /dev/hailo0:/dev/hailo0 \
  --device /dev/video0:/dev/video0 \
  -v /usr/lib/libhailort.so.5.1.1:/usr/lib/libhailort.so.5.1.1:ro \
  -v /usr/lib/libhailort.so:/usr/lib/libhailort.so:ro \
  ghcr.io/seeed-projects/recomputer-hailo10h-cv/stdc1:latest \
  python web_detection.py --model_path model/stdc1.hef --camera_id 0

HEF 文件

HEF大小备注
stdc1.hef11 MB语义分割 model

REST API

预测端点:

text
P操作系统T http://<Board_IP>:8000/api/models/stdc1/predict

示例图片请求:

bash
curl -X P操作系统T "http://<Board_IP>:8000/api/models/stdc1/predict" \
  -F "file=@test.jpg"

通用服务端点:

Endpoint方法用途
/GETWeb 预览界面
/api/models/stdc1/predictP操作系统TSegmentation mask (JSON)
/api/models/stdc1/visualizeP操作系统TOverlay image (JPEG)
/api/models/stdc1/classesGETCityscapes class list
/api/video_feedGETMJPEG 预览流

开发说明

  • 源模块: src/hailo10h_stdc1/
  • Dockerfile: docker/hailo10h/stdc1.dockerfile
  • 主服务: web_detection.py --model_path model/stdc1.hef wraps HailoRT inference, post-processing, MJPEG preview, and REST prediction.

输入与输出

输入:图像(1024×1920 RGB)。输出:19 类语义分割掩码(Cityscapes)。