Repository navigation

Mixed modality - #4531

Merged

lvhan028 merged 34 commits into

InternLM:mainfrom

CUHKSZzxy:mixed-modality

Apr 27, 2026

Merged

Mixed modality#4531
lvhan028 merged 34 commits into
InternLM:mainfrom
CUHKSZzxy:mixed-modality

Commits on Apr 14, 2026
- WIP: support mixed modality
  CUHKSZzxy
  committed
  a12e492
Commits on Apr 15, 2026
- fix mm processor kwargs, cleanup
  CUHKSZzxy
  committed
  79b9953
- qwen3.5 mixed modality
  CUHKSZzxy
  committed
  c12b02c
- interns1 pro mixed modality, fix kwargs
  CUHKSZzxy
  committed
  cd85dcf
Commits on Apr 16, 2026
- fix generate, cleanup
  CUHKSZzxy
  committed
  dc8e388
- minor
  CUHKSZzxy
  committed
  8d525fc
- Merge branch 'main' into mixed-modality
  CUHKSZzxy
  committed
  1e6a17d
- simplify
  CUHKSZzxy
  committed
  20cd4ec
- fix glm4.1v
  CUHKSZzxy
  committed
  71112f4
- compatible with legacy preprocess, give up re-writing all ...
  CUHKSZzxy
  committed
  1994bfa
- fix bugs
  CUHKSZzxy
  committed
  f47d011
- minor
  CUHKSZzxy
  committed
  1d40a76
- minor
  CUHKSZzxy
  committed
  b69fd8b
- minor
  CUHKSZzxy
  committed
  70d4178
Commits on Apr 17, 2026
- fix ut
  CUHKSZzxy
  committed
  006a8ca
- fix qwen3vl moe
  CUHKSZzxy
  committed
  7922cc3
- allow modality-specific kwargs, add ut
  CUHKSZzxy
  committed
  2f992c9
- docs: add multi-modal input format reference (EN + ZH)
  
  CUHKSZzxy
  and
  claude
  committed
  0787a8a
- docs: update video/audio URLs to official Qwen assets
  
  CUHKSZzxy
  and
  claude
  committed
  8611115
- docs: fix model name Qwen3.5-VL -> Qwen3.5
  
  CUHKSZzxy
  and
  claude
  committed
  de923d7
- fix: address PR #4531 review comments
  
  CUHKSZzxy
  and
  claude
  committed
  52a46b7
- Merge branch 'main' into mixed-modality
  CUHKSZzxy
  committed
  8844e26
- refactor: rename interns1_pro_ts.py to interns1_pro_time_series.py
  CUHKSZzxy
  committed
  3df1592
Commits on Apr 22, 2026
- docs: remove audio sections (not yet supported)
  
  CUHKSZzxy
  and
  claude
  committed
  72de87b
Commits on Apr 23, 2026
- refactor: extract preprocess helpers from VisionModel into preprocess_utils.py
  
  CUHKSZzxy
  and
  claude
  committed
  a4ea4d7
Commits on Apr 24, 2026
- refactor: move MultimodalSpecialTokens to constants.py, promote API detector to staticmethod
  
  CUHKSZzxy
  and
  claude
  committed
  8ca4a89
- minor
  CUHKSZzxy
  committed
  cad03c5
- minor
  CUHKSZzxy
  committed
  765d352
Commits on Apr 27, 2026
- bunch of fix
  CUHKSZzxy
  committed
  69dc303
- update glm4.1v
  CUHKSZzxy
  committed
  ecdb320
- simplify map dict
  CUHKSZzxy
  committed
  32aca27
- Fix Qwen3VL tests for input prompt API
  CUHKSZzxy
  committed
  9cfb41f
- update
  CUHKSZzxy
  committed
  39ebc19
- minor
  CUHKSZzxy
  committed
  1627f33

Commits

Commits on Apr 14, 2026

Commits on Apr 15, 2026

Commits on Apr 16, 2026

Commits on Apr 17, 2026

Commits on Apr 22, 2026

Commits on Apr 23, 2026

Commits on Apr 24, 2026

Commits on Apr 27, 2026