Awesome MCP › Media & Creativity

heshengtao/comfyui_LLM_party

⭐ 2358 Python repository created 2024-04-13

ComfyUI LLM Party is a comprehensive and versatile framework designed to integrate large language models (LLMs) with ComfyUI, enabling users to build customizable LLM workflows and AI assistants. It supports multiple LLMs, including API-based models, local models in various formats such as GGUF and distributed formats, and vision-language models (VLMs). The framework also integrates with the Model Context Protocol (MCP) server and various social applications like QQ, Feishu, and Discord, facilitating complex agent interactions and social app connectivity. The project provides a rich set of nodes for constructing LLM workflows within ComfyUI, allowing users to quickly create AI assistants tailored to specific needs, including industry-specific knowledge management using word vector retrieval augmented generation (RAG) and GraphRAG techniques. It supports both simple single-agent pipelines and complex multi-agent interaction modes such as radial and ring interactions. ComfyUI LLM Party is suitable for a wide range of users, from students starting with their first LLM application to scientific researchers requiring advanced parameter tuning and model adaptation. It also caters to streaming media professionals by offering integrated workflows combining LLM, text-to-speech (TTS), and ComfyUI image generation. The project includes detailed quick start guides and example workflows for various use cases, such as calling LLMs via API, managing local LLMs with Ollama, and generating Stable Diffusion prompts using VLMs. It features real-time streaming output for API calls and enhanced reasoning content separation for improved response handling. Additionally, the framework supports image hosting services and continuously updates to incorporate new features and model support. Its integration with MCP ensures it aligns with modern standards for model context management, making it a powerful tool for building advanced AI workflows and assistants within the ComfyUI ecosystem.

https://github.com/heshengtao/comfyui_LLM_party

agentai-assistantaisuite-interfaceapichatttscomfyuideepseekdifydiscorddistributed-modeldoubaofeishufluxflux-prompt-nodesgeminiggufglmgot-ocr2.0gpt-sovitsgraphraggrokimage-hostingimgbb.comjanus-prokimilarge-language-modellinkage-graphraglinuxllamallama-3.3llmllm-agent-frameworkllm-workflowslocal-llmslocal-modelmacosmcpmcp-servermodel-adaptationmodel-context-protocolmulti-agent-interactiono1ocrollamaomostopenaiopenai-interfaceqqqwenragreasoning-contentsm.mssocial-app-integrationstable-diffusionstreaming-outputtext-to-speechttsvlmword-vector-ragworkflow