The text generation serving should have an option to only return the newly generated part, without the prompt.
Activity