Skip to content

Latest commit

 

History

64 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 

Repository files navigation

Draw Things Chat

Documentation-only repository

This repository contains only the user documentation for draw-things-chat (Markdown + images). It intentionally contains no LM Studio plugin code and is not installable.

Looking for the actual plugin? See: https://lmstudio.ai/ceveyne/draw-things-chat

Table of Contents

Key Benefits

As it's questionable if simply plugging Draw Things into LM Studio might be of any benefit, enlightening your vision-capable Agent-Model with your generated images can sometimes be... surprising.

LM Studio Plugin: Draw Things supported by vision-capable Agents

  • Image-based "Reasoning" approach for vision-capable LLMs
  • "Agentic" workflows for text2image, image2image, edit, text2video & image2video
  • Re-use of any previously generates content (requires "Metadata Query" plugin draw-things-index)
  • All local
  • Optional: distributed computing across your local network
  • Maintain your favourite settings, models, LoRAs, etc., as custom presets to ensure the desired qualities of your Draw Things artwork.

Setup

For an overview of supported deployment scenarios (single machine, distributed, Linux server, runpod), see docs/DEPLOYMENT.md.

Draw Things user on Mac

  1. Prepare for text2image, image2image, edit, text2video and image2video modes by simply providing your favourite Draw-Things-settings for use with draw-things-chat:
  • Draw-Things > Basic Settings > Load your preferences > Save as... text2image.auto, image2image.auto, edit.auto, text2video.auto, image2video.auto

custom_configs_auto_draw_things(1)

custom_configs_auto_draw_things(2)

  • ⚠️ Note: These settings are stored to <Your_configured_Model-Folder>/custom_configs.json. It might be a good idea to keep this file in sync with the one located inside your Default-Model-Folder (~/Library/Containers/com.liuliu.draw-things/Data/Documents/Models/custom_configs.json)
  1. Setup Draw Things gRPC server:
  • Draw-Things > Advanced Settings: API Server: enable, ⚡️ gRPC Port: 7859, Transport Layer Security: enable, Response Compression: enable, Enable Model Browsing: enable

advanced_settings_draw_things

  1. Prepare your LM Studio Client for the vision-capability-primer:
  • Download the required helper-model qwen/qwen3-vl-4b to your local computer

lms_developer_vision-capability-priming

  1. Prepare your LM Studio Server:
  • Download your preferred vision-capable agent-model (default: qwen/qwen3.6-35b-a3b) to your server computer
  • Set appropriate context length for your vision-capable agent-model
  • Enable your LM Studio Server

lms_developer_local_llm_service

lms_developer_server_settings

  1. Install the draw-things-chat plugin:

run_in_LM_Studio

  • Activate the draw-things-chat plugin with the model-loader

lms_model-loader

  • Adjust the draw-things-chat plugin-settings to your local machine and network

your_generator_draw-things_chat

LM Studio user on Windows or Linux - MCP-based image generation

  1. Prepare your LM Studio Client for the vision-capability-primer:
  • Download the required helper-model qwen/qwen3-vl-4b to your local computer
  • ⚠️ Note: This model is not intended to be used for inference. Hence it doesn't need any GPU support.

windows_mymodels

  1. Prepare your LM Studio Server:
  • Download your preferred vision-capable agent-model (default: qwen/qwen3.5-35b-a3b) to your server computer
  • Set appropriate context length for your vision-capable agent-model
  • Enable your LM Studio Server
  1. Install the draw-things-chat plugin:

run_in_LM_Studio

  • Activate the draw-things-chat plugin by choosing it from the model-loader

windows_generate_image()

  • Adjust the draw-things-chat plugin-settings to your local machine and network: Disable the built-in tool 'generate_image()' to use any MCP-tool for image-generation that delivers base64 as tool-result.

windows_no_generate_image()

LM Studio user on Linux - Draw-Things-backend image generation

  1. Follow the instructions here to setup the Draw Things gRPC Server
  • For model-management and custom_configs it's easiest to use the Draw Things Client on macOS.
  1. Prepare for text2image, image2image, edit, text2video and image2video modes by simply providing your favourite Draw-Things-settings for use with draw-things-chat:
  • Draw-Things > Basic Settings > Load your preferences > Save as... text2image.auto, image2image.auto, edit.auto, text2video.auto, image2video.auto

custom_configs_auto_draw_things(1)

custom_configs_auto_draw_things(2)

  • ⚠️ Note: These settings are stored to <Your_gRPC-configured_Model-Folder>/custom_configs.json. It might be a good idea to keep this file in sync with the one located inside your Default-Model-Folder (~/Library/Containers/com.liuliu.draw-things/Data/Documents/Models/custom_configs.json)
  1. Prepare your LM Studio Client for the vision-capability-primer:
  • Download the required helper-model qwen/qwen3-vl-4b to your local computer

lms_developer_vision-capability-priming

  1. Prepare your LM Studio Server:
  • Download your preferred vision-capable agent-model (default: qwen/qwen3.5-35b-a3b) to your server computer
  • Set appropriate context length for your vision-capable agent-model
  • Enable your LM Studio Server

lms_developer_local_llm_service

lms_developer_server_settings

  1. Install the draw-things-chat plugin:

run_in_LM_Studio

  • Activate the draw-things-chat plugin with the model-loader

lms_model-loader

  • Adjust the draw-things-chat plugin-settings to your local machine and network

your_generator_draw-things_chat

Invoke formerly generated images: Metadata Query plugin draw-things-index

See the draw-things-index documentation for setup instructions.

Workflow example (Draw Things backend)

draw-things-chat-workflow(1)

draw-things-chat-workflow(2)

draw-things-chat-workflow(4)

Usecase example (ComfyUI backend)

index_image_draw-things-chat_comfyui


More detailed user docs

See USER_GUIDE.md for in-depth documentation, use cases, technical requirements, known issues, and more.

Changelog

See CHANGELOG.md for version history and release notes.

License

MIT

About

LM Studio Plugin: Draw Things supported by vision-capable Agents

Topics

Resources

Stars

6 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors