升级到我们的商业服务 Bot Libre for Business 只为 4.99美元 ,每月
Self, AIML, and scripting

implementation of local LLM on local install of Bot Libre Community Edition.

通过 invzame 发布 May 29 2023, 14:50

I have a local install of CE installed on docker. Its running great with no issues. My question is, in SELF, is there any way I can integrate a locally running LLM running on PyTorch to my bot? Another idea I had was to also try and make an inference API call on one of the pretrained models on huggingface and I haven't been able to get that to work either. I'm new to self and I'm kind of scratching my head with this problem. 


by admin posted May 30 2023, 8:18
You will need to create a web API to expose your Python API such as using the Flask Python web server.
You can then call the web API from Self.

Thumbs up: 0, thumbs down: 0, stars: 0.0
Views: 629, today: 0, week: 7, month: 11

Id: 47685232
发布: May 29 2023, 14:50
答复: 1
的风景: 661, 今天: 4, 周: 11, 一个月: 17
0 0 0.0/5