Add YOLO-World forward and inference #530
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Thanks for your contribution! |
LokeZhou
reviewed
May 20, 2024
| ```bash | ||
| python pretrain/torch2paddle.py <path_to_weight.pth> -p <path_to_weight.pdparams> | ||
| ``` | ||
|
|
There was a problem hiding this comment.
可以把转后的权重分享，这边上传自动下载，省略这一步
There was a problem hiding this comment.
好的, 已在README中修改～
LokeZhou
reviewed
May 20, 2024
| # 安装2.6.0版本的paddlepaddle-gpu，当前我们选择了cuda12.0的版本，可以查看 https://www.paddlepaddle.org.cn/ 寻找自己适合的版本 | ||
| python -m pip install paddlepaddle-gpu==2.6.0.post120 -f https://www.paddlepaddle.org.cn/whl/linux/mkl/avx/stable.html | ||
|
|
||
| # 进入目录 |
There was a problem hiding this comment.
是不是少了一步pyproject里面的包安装？
There was a problem hiding this comment.
在30行 有提示使用 pip install -e . 安装pyproject中依赖
LokeZhou
reviewed
May 20, 2024
| import cv2 | ||
| import paddle.nn as nn | ||
| import supervision as sv | ||
| from ppdet.core.workspace import create, load_config, merge_config |
There was a problem hiding this comment.
supervision是否第三方库？如果是需要写一个requirments.txt
There was a problem hiding this comment.
supervision是第三方库，但已经作为依赖添加到了pyproject中，还需要另写一个requirments.txt吗？
LokeZhou
reviewed
May 20, 2024
|
整体文件移到PaddleMIX/paddlemix/examples下 |
LokeZhou
approved these changes
May 24, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Add YOLO-World forward and inference
some examples of forward alignment：
torch commands: python image_demo.py configs/pretrain/yolo_world_v2_x_vlpan_bn_2e-3_100e_4x8gpus_obj365v1_goldg_train_lvis_minival.py /home/onion/workspace/code/PaddleMIX/ppdiffusers/examples/YOLO-World/pretrain/yolo_world_v2_x_obj365v1_goldg_cc3mlite_pretrain-8698fbfa.pth /home/onion/
bus.jpg 'person,bus' --topk 100 --threshold 0.001 --output-dir /home/onion/out/
paddle commands: python infer.py --config configs/yolo_world_x.yml -o weights=./pretrain/yolo_world_v2_x_obj365v1_goldg_cc3mlite_pretrain-8698fbfa.pdparams --image /home/onion/bus.jpg --text 'person,bus' --topk 100 --threshold 0.01 --output_dir "/home/onion/out"
torch commands: python image_demo.py configs/pretrain/yolo_world_v2_x_vlpan_bn_2e-3_100e_4x8gpus_obj365v1_goldg_train_lvis_minival.py /home/onion/workspace/code/PaddleMIX/ppdiffusers/examples/YOLO-World/pretrain/yolo_world_v2_x_obj365v1_goldg_cc3mlite_pretrain-8698fbfa.pth /home/onion/
zidane.jpg 'bald man,white haired man' --topk 100 --threshold 0.001 --output-dir /home/onion/out/
paddle commands: python infer.py --config configs/yolo_world_x.yml -o weights=./pretrain/yolo_world_v2_x_obj365v1_goldg_cc3mlite_pretrain-8698fbfa.pdparams --image /home/onion/zidane.jpg --text 'bald man,white haired man' --topk 100 --threshold 0.001 --output_dir "/home/onion/out"