Add support for open-source LLMs

[dmitryshurov]

Adding LLaMA support would be really great :)

[bonk1t]

Hi @dmitryshurov,

Thank you for your suggestion! We would love to support open-source models like LLaMA. However, we currently rely on the Agency Swarm library, which only supports the OpenAI Assistants API at the moment.

According to their plans, Agency Swarm intends to integrate with Open Assistant API in the future (related issues: #112, #92). As soon as this integration is available, we will be able to add support for open-source models in our project.

We appreciate your interest and will keep you updated on any progress!

Best regards,
Nick