dashscope-video

hermes-plugin-dashscope-video

Video generation plugin for Hermes Agent using Alibaba Cloud DashScope (Qwen Cloud).

Brings Alibaba's HappyHorse 1.1 video models to Hermes's video_generate tool. Works with token plan keys (sk-sp-*) and pay-as-you-go keys (sk-ws-*).

Models

| Model Family | Modes | Strengths |
|-------------|-------|-----------|
| happyhorse-1.1 | t2v, i2v, r2v | Cinematic video generation |

The plugin auto-routes to the correct mode-specific model ID:

| Mode | Trigger | Model ID |
|------|---------|----------|
| Text-to-video | prompt only | happyhorse-1.1-t2v |
| Image-to-video | prompt + image_url | happyhorse-1.1-i2v |
| Reference-to-video | prompt + reference_image_urls | happyhorse-1.1-r2v |

All models are included in the Alibaba Cloud AI Token Plan subscription and are available on the PAYG free tier. Generation takes ~2-3 minutes for a 5-second clip.

Install

hermes plugins install rriggs/hermes-plugin-dashscope-video
hermes plugins enable dashscope

Configure

All configuration lives under video_gen.dashscope in config.yaml:

video_gen:
  provider: dashscope
  dashscope:
    api: https://token-plan.ap-southeast-1.maas.aliyuncs.com
    key_env: QWEN_API_KEY
    model_family: happyhorse-1.1        # auto-appends -t2v/-i2v/-r2v
    # model_t2v: happyhorse-1.1-t2v     # optional per-mode override
    # model_i2v: happyhorse-1.1-i2v
    # model_r2v: happyhorse-1.1-r2v

| Key | Default | Description |
|-----|---------|-------------|
| api | https://token-plan.ap-southeast-1.maas.aliyuncs.com | DashScope API base URL |
| key_env | QWEN_API_KEY | Name of the env var holding your API key |
| model_family | happyhorse-1.1 | Base model family; mode suffix appended automatically |
| model_t2v | (derived) | Override the text-to-video model ID |
| model_i2v | (derived) | Override the image-to-video model ID |
| model_r2v | (derived) | Override the reference-to-video model ID |

Model resolution (first hit wins):

Explicit model kwarg from the tool call (full model ID)
Per-mode config override (model_t2v / model_i2v / model_r2v)
model_family + mode suffix (-t2v / -i2v / -r2v)
Default family (happyhorse-1.1) + mode suffix

Set the API key in your .env file:

QWEN_API_KEY=***

PAYG users

video_gen:
  provider: dashscope
  dashscope:
    api: https://dashscope-intl.aliyuncs.com
    key_env: DASHSCOPE_API_KEY

No env var names are hard-coded -- key_env tells the plugin which env var to read.

Usage

Once configured, Hermes's video_generate tool routes through DashScope automatically:

Text-to-video: provide a prompt (routes to -t2v)
Image-to-video: provide prompt + image_url (routes to -i2v)
- Accepts URLs (https://...), data URIs (data:image/png;base64,...), or local file paths (/path/to/image.png) -- local files are automatically base64-encoded inline
Reference-to-video: provide prompt + reference_image_urls (routes to -r2v)
- Same local file path support as i2v

Supported parameters: duration (3-10s), aspect_ratio (16:9, 9:16, 1:1, 4:3, 3:4).

Generated videos are cached locally under $HERMES_HOME/cache/videos/ since DashScope OSS URLs expire.

API Details

This plugin uses the native DashScope async task API:

1. POST {api}/api/v1/services/aigc/video-generation/video-synthesis
   (with X-DashScope-Async: enable header)
   --> returns task_id

2. GET {api}/api/v1/tasks/{task_id}
   --> poll until SUCCEEDED/FAILED

3. Download video from output.video_url

Both the token plan and PAYG endpoints require async mode for video models. The plugin handles the full submit-poll-download cycle with a 10-minute timeout.

Requirements

Hermes Agent v0.18+
API key set in the env var named by key_env
requests Python package (bundled with Hermes)

License

MIT

README from the reviewed commit 229b5c9; it updates when the author re-pins.