Add simple tool calling script that works around vLLM tool_choice limitation
1f77df0
Peter Larnholt
commited on
Spaces:
Paused
Paused
Commit History
Remove --enable-auto-tool-choice flag (Qwen has native tool calling)
80b0386
Peter Larnholt
commited on
Enable auto tool choice for better tool calling support
55381a2
Peter Larnholt
commited on
Upgrade torch to 2.5.1 for vLLM 0.6.4.post1 compatibility
1b713bd
Peter Larnholt
commited on
Upgrade vLLM to 0.6.4.post1 and remove explicit outlines dependencies
65659d1
Peter Larnholt
commited on
Add outlines package and fix Gradio message format compatibility
fa4aba4
Peter Larnholt
commited on
Enable verbose logging to diagnose chat completion errors
0e074c5
Peter Larnholt
commited on
Fix invalid --disable-guided-decoding flag and add airportsdata dependency
2e9c870
Peter Larnholt
commited on
Disable guided decoding to resolve chat completion errors
3356350
Peter Larnholt
commited on
Remove guided decoding backend override and add airportsdata dependency
4142581
Peter Larnholt
commited on
Switch guided decoding backend to lm-format-enforcer to avoid outlines issues
82c6e6d
Peter Larnholt
commited on
Disable HF_HUB_ENABLE_HF_TRANSFER to avoid missing dependency error
952d32f
Peter Larnholt
commited on
Fix HuggingFace cache directory permissions
cd11dff
Peter Larnholt
commited on
Fix torch version to 2.4.0 for vLLM 0.6.3.post1 compatibility
972cd35
Peter Larnholt
commited on
Upgrade to vLLM 0.6.3.post1 and remove pyairports workarounds
e48919a
Peter Larnholt
commited on
Add sitecustomize.py to Docker build
275a99c
Peter Larnholt
commited on
Add sitecustomize.py to patch pyairports module globally
5130472
Peter Larnholt
commited on
Install pyairports from GitHub source
cda3840
Peter Larnholt
commited on
Use py-airports package instead of pyairports and add debugging
951c827
Peter Larnholt
commited on
Add back outlines dependencies required by vLLM 0.5.5 imports
b56faa8
Peter Larnholt
commited on
Pass VLLM_USE_OUTLINES=0 to subprocess and remove outlines dependencies
aaa0398
Peter Larnholt
commited on
Fix pyairports version to 0.0.1
877eb8c
Peter Larnholt
commited on
Add pyairports dependency to fix vLLM import error
1d84d88
Peter Larnholt
commited on
Update requirements.txt
f308ba3
verified
Update app.py
eaa5923
verified
Fix issues
49c922d
Peter Larnholt
commited on
Update requirements.txt
0d65c8e
verified
Update requirements.txt
2848675
verified
Update requirements.txt
89e6e22
verified
Update requirements.txt
ebb4b06
verified
Update app.py
002f0f2
verified
Update Dockerfile
0db58b4
verified
Update requirements.txt
b29ecd9
verified
Delete requirements.txt
8856d66
verified
Update Dockerfile
b12d382
verified
Update requirements.txt
d133f37
verified
Update requirements.txt
5d28e80
verified
Create requirements.txt
e49c4d3
verified
Update requirements.txt
3f297e4
verified
Initial version
0d3d2c6
Peter Larnholt
commited on