You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Bug Description
v1.3.8 update doesn't work for using it with vLLM openai compatible server (custom model llama3).
v1.3.6 was working good.
Actual Results API Error: Status Code 400, {"object":"error","message":"[{'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'user'\", 'input': 'system', 'ctx': {'expected': \"'user'\"}}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'assistant'\", 'input': 'system', 'ctx': {'expected': \"'assistant'\"}}, {'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'tool'\", 'input': 'system', 'ctx': {'expected': \"'tool'\"}}, {'type': 'missing', 'loc': ('body', 'messages', 0, 'typed-dict', 'tool_call_id'), 'msg': 'Field required', 'input': {'role': 'system', 'content': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}}, {'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'missing', 'loc': ('body', 'messages', 0, 'typed-dict', 'name'), 'msg': 'Field required', 'input': {'role': 'system', 'content': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'function'\", 'input': 'system', 'ctx': {'expected': \"'function'\"}}]","type":"BadRequestError","param":null,"code":400}
Desktop (please complete the following information):
Operating System: linux ubuntu 22.04
Application Version: 1.3.8
vLLM v0.4.2, openai v1.25.1
The text was updated successfully, but these errors were encountered:
Bug Description
v1.3.8 update doesn't work for using it with vLLM openai compatible server (custom model llama3).
v1.3.6 was working good.
Actual Results
API Error: Status Code 400, {"object":"error","message":"[{'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'user'\", 'input': 'system', 'ctx': {'expected': \"'user'\"}}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'assistant'\", 'input': 'system', 'ctx': {'expected': \"'assistant'\"}}, {'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'tool'\", 'input': 'system', 'ctx': {'expected': \"'tool'\"}}, {'type': 'missing', 'loc': ('body', 'messages', 0, 'typed-dict', 'tool_call_id'), 'msg': 'Field required', 'input': {'role': 'system', 'content': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}}, {'type': 'string_type', 'loc': ('body', 'messages', 0, 'typed-dict', 'content'), 'msg': 'Input should be a valid string', 'input': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}, {'type': 'missing', 'loc': ('body', 'messages', 0, 'typed-dict', 'name'), 'msg': 'Field required', 'input': {'role': 'system', 'content': [{'type': 'text', 'text': 'Current model: casperhansen/llama-3-70b-instruct-awq\\n\\nYou are a helpful assistant. You can help me by answering my questions. You can also ask me questions.'}]}}, {'type': 'literal_error', 'loc': ('body', 'messages', 0, 'typed-dict', 'role'), 'msg': \"Input should be 'function'\", 'input': 'system', 'ctx': {'expected': \"'function'\"}}]","type":"BadRequestError","param":null,"code":400}
Desktop (please complete the following information):
The text was updated successfully, but these errors were encountered: