Skip to content

Pull requests: openai/tiktoken

New pull request New
17 Open 63 Closed
17 Open 63 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Remove dependency on requests
#271 opened Mar 26, 2024 by tristan-jl Loading…
In-code documentation update
#260 opened Feb 19, 2024 by louisbrulenaudet Loading…
Add possessive quantifiers to avoid catastrophic backtracking
#258 opened Feb 11, 2024 by paplorinc Loading…
9
Optimize byte pair merge for really big tokens (40x faster for a 2500 token word)
#239 opened Jan 15, 2024 by paplorinc Loading…
24
Support enterprise network support for self-hosted encodings (UPDATED v0.6.0)
#238 opened Jan 12, 2024 by blaney83 Loading…
1
0) Add the jtokkit test suite examples to validate the cl100k_base, p50k_base & r50k_base encodings
#237 opened Jan 6, 2024 by paplorinc Loading…
1
feat: Add option TIKTOKEN_FORCE_CACHE
#170 opened Jul 28, 2023 by Kontrolix Loading…
4
✨ feat: Split code rust, for run as python lib and rust lib
#167 opened Jul 18, 2023 by Miuler Loading…
1
5
fix pycache folder being added instead of encoding info files
#152 opened Jun 23, 2023 by dheerajiiitv Loading…
1
9
Add support for fine-tuned models in encoding_for_model
#135 opened May 23, 2023 by thespino Loading…
2
Option to use env variable for BPE_FILE location
#128 opened May 15, 2023 by csnelsonchu Loading…
update license metadata to use SPDX identifier as per recommendation
#125 opened May 12, 2023 by imrehg Loading…
Allow older versions of dependencies fancy-regex and bstr.
#108 opened Apr 16, 2023 by petterreinholdtsen Loading…
1
Add ruby bindings
#83 opened Mar 28, 2023 by arjun810 Loading…
Enable ppc64le wheels
#65 opened Mar 16, 2023 by mgiessing Loading…
1
Add WASM/JS bindings
#50 opened Mar 6, 2023 by dqbd Loading…
2
WIP: refactor for Java bindings
#40 opened Feb 28, 2023 by eisber Loading…
3
ProTip! Add no:assignee to see everything that’s not assigned.