Can the system be adapted to support ​​DeepSeek​​ and ​​Qwen​​ series open-source LLMs?

[brikitlu]

While attempting to use ​​ANP (Agent Network Protocol)​​ to connect ​​Ollama-hosted Qwen and DeepSeek models​​, we encountered the following error:

AttributeError: 'NoneType' object has no attribute 'requester_instance'

We hope to see ​​early support for domestic open-source LLMs (e.g., Qwen, DeepSeek, ChatGLM, etc.)​​ and compatibility with more model deployment frameworks, such as ​​Tsinghua University’s KVCache-AI team’s open-source ktransformers framework​​.

[Moshiii]

@chgaowei this is a good feature. please review
please share your code for Ollama integration, we will debug and fix it for you