Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve MD_JSON mode to be more aggressive #489

Open
jxnl opened this issue Mar 6, 2024 · 0 comments
Open

Improve MD_JSON mode to be more aggressive #489

jxnl opened this issue Mar 6, 2024 · 0 comments
Assignees
@jxnl

Comments

@jxnl
Copy link
Owner

jxnl commented Mar 6, 2024

MD_JSON mode still performs poorly for local models

  1. we should make the system prompts more aggressive in asking for json
  2. we should be more aggresstive with parsing out the text perhaps by reading out everything and asking it to return ```json
    this can still be done to handle streaming etc.
@jxnl jxnl self-assigned this Mar 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jxnl jxnl

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jxnl