Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhanced Validation displays unique images #12645

Open
wants to merge 20 commits into
base: main
Choose a base branch
from

Conversation

sunmooncode
Copy link
Contributor

@sunmooncode sunmooncode commented May 13, 2024

Add a new parameter for users to choose from in the detected val script. The function of this parameter is to control the output method of images in the val result.

For more details please refer to here!

🛠️ PR Summary

Made with ❤️ by Ultralytics Actions

🌟 Summary

New feature to show detection results per class image count in Ultralytics' software.

📊 Key Changes

  • A configuration option per_class_img was added to control whether detection results are shown per class image count.
  • Additional internal tracking for the number of targets per image by class was implemented.
  • Adjustments in how detection validation metrics are recorded and reported, including support for this new per-class image count feature.

🎯 Purpose & Impact

  • Clarity in Results: This feature aims to provide more detailed insights into model performance, especially in scenarios with imbalanced datasets where some classes are more frequent than others. 📈
  • Improved Debugging: By understanding model performance on a per-class basis, developers and users can more easily pinpoint areas for improvement. 👀
  • User Choice: The addition is optional and controlled via a configuration setting, allowing users flexibility based on their needs. ⚙️

This update should help users better understand and optimize their models, potentially leading to more accurate and efficient object detection applications.

Copy link

codecov bot commented May 13, 2024

Codecov Report

Attention: Patch coverage is 66.66667% with 5 lines in your changes are missing coverage. Please review.

Project coverage is 70.91%. Comparing base (c8b6a8b) to head (4f3cc58).

Files Patch % Lines
ultralytics/models/yolo/detect/val.py 66.66% 3 Missing ⚠️
ultralytics/models/yolo/pose/val.py 66.66% 1 Missing ⚠️
ultralytics/models/yolo/segment/val.py 66.66% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main   #12645      +/-   ##
==========================================
- Coverage   75.21%   70.91%   -4.30%     
==========================================
  Files         123      123              
  Lines       15563    15573      +10     
==========================================
- Hits        11705    11044     -661     
- Misses       3858     4529     +671     
Flag Coverage Δ
Benchmarks 35.67% <60.00%> (-0.03%) ⬇️
GPU 37.44% <40.00%> (-5.68%) ⬇️
Tests 67.05% <66.66%> (-3.81%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@Burhan-Q Burhan-Q added the enhancement New feature or request label May 13, 2024
@Burhan-Q Burhan-Q linked an issue May 13, 2024 that may be closed by this pull request
2 tasks
@glenn-jocher
Copy link
Member

@sunmooncode hey great, this looks like a nice improvement. Once change is that can you please remove the argument so we use this change by default? Thanks!

@sunmooncode
Copy link
Contributor Author

I deleted the optional parameter and used it by default.

@glenn-jocher
Copy link
Member

That sounds great, @sunmooncode! Making the feature default simplifies the usage while providing enhanced insights consistently. Thanks for your contribution! 🚀 If anything else needs to be adjusted, feel free to let us know.

@glenn-jocher glenn-jocher changed the title Better evaluation results show! Enhanced Val mode with unique images May 17, 2024
@glenn-jocher glenn-jocher changed the title Enhanced Val mode with unique images Enhanced Validation displays unique images May 17, 2024
@glenn-jocher glenn-jocher added the TODO Items that needs completing label May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request TODO Items that needs completing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Better evaluation results show.
4 participants