Skip to content

Pull requests: IBM/text-generation-inference

New pull request New
11 Open 76 Closed
11 Open 76 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

use fastsafetensors
#99 opened May 24, 2024 by takeshi-yoshimura Loading…
3
Fix logic for determining the number of cache blocks
#98 opened May 16, 2024 by tdoublep Loading…
11
TGIS gRPC adapter for lm-eval
#90 opened May 9, 2024 by maxdebayser Loading…
✨ allow single-shard paged attention
#86 opened May 6, 2024 by joerunde Loading…
@tdoublep
3
Performance Optimizations for TP-Aware GPTQ
#67 opened Mar 22, 2024 by cyang49 • Draft
feat: Make tokenizer add_special_tokens option configurable
#54 opened Mar 11, 2024 by njhill • Draft
Test AMD ROCm build
#45 opened Mar 1, 2024 by maxdebayser • Draft
re-enable http generate endpoint
#22 opened Jan 12, 2024 by dtrifiro • Draft
2
Add example for running inference locally
#18 opened Dec 12, 2023 by helena-intel Loading…
OpenVINO integration for CausalLM models
#17 opened Dec 12, 2023 by helena-intel Loading…
4
enabling Intel(R) Extension for PyTorch*
#16 opened Nov 22, 2023 by kta-intel Loading…
1
ProTip! Filter pull requests by the default branch with base:main.