Error: Failed to fetch completions: Error processing prompt (see logs with DEBUG>=2): No module named '_posixshmem' #237

Issue Description

I am currently running the Exo framework on my Windows device. Initially, I encountered compatibility errors because the main.py file was only supported on macOS. However, after modifying main.py, I was able to successfully execute it on Windows.

While using tinychat to send a question to the model, I encountered the following error message:
Error: Failed to fetch completions: Error processing prompt (see logs with DEBUG>=2): No module named '_posixshmem'

Analysis

The error arises because multiprocessing.shared_memory (which internally uses _posixshmem) is not supported on Windows. Instead, Windows uses alternatives like multiprocessing.sharedctypes or multiprocessing.Manager for shared memory operations.

Proposed Solution

To resolve this issue, I need to locate the files in the Exo codebase that are using multiprocessing.shared_memory and replace them with Windows-compatible modules like multiprocessing.Manager.

Steps to Locate the File, which I have already tried, but didnt get any success.

Use Command-Line Search:

• Use the command-line tools to search for shared_memory or _posixshmem references in the Exo directory:

On Windows:

findstr /s /i "shared_memory _posixshmem" *.py