Skip to content

Caption images across your datasets with state of the art models from Hugging Face and Replicate!

Notifications You must be signed in to change notification settings

jacobmarks/fiftyone-image-captioning-plugin

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Image Captioning Plugin

image_captioning

Plugin Overview

This plugin lets you generate and store captions for your samples using state-of-the-art image captioning models.

Supported Models

This version of the plugin supports the following models:

Feel free to fork this plugin and add support for other models!

Installation

Pre-requisites

  1. If you plan to use it, install the Hugging Face transformers library:
pip install transformers
  1. If you plan to use it, install the Replicate library:
pip install replicate

And add your Replicate API key to your environment:

export REPLICATE_API_TOKEN=<your-api-token>

Install the plugin

fiftyone plugins download https://github.com/jacobmarks/fiftyone-image-captioning-plugin

Operators

caption_images

  • Applies the selected image captioning model to the desired target view, and stores the resulting captions in the specified field on the samples.

About

Caption images across your datasets with state of the art models from Hugging Face and Replicate!

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages