Caption Generator
Generates textual descriptions of objects in a ROI, or of a ROI in the frame.
Overview
The Caption Generator node generates textual descriptions of objects within a Region of Interest (ROI), or of a ROI within the frame. This functionality is useful for applications requiring detailed descriptions of visual elements, enhancing accessibility, and providing contextual understanding.
Inputs & Outputs
- Inputs: 1, Media Format: Raw Video
- Outputs: 1, Media Format: Raw Video
- Output Metadata: Captions
Properties
| Property | Description | Type | Default | Required |
|---|---|---|---|---|
| roi_labels | Regions of interest labels | hidden | Yes | |
| rois | Regions of interest. Type: polygon. Conditional on roi_labels. | polygon | null | Yes |
| processing_mode | Processing mode. Options: ROIs, at an Interval (rois_interval), ROIs, upon a Trigger (rois_trigger), Objects in an ROI (objects). | enum | rois_interval | Yes |
| trigger | Trigger Condition. Queue ROI for lookup when this condition evaluates to true. Conditional on processing_mode being rois_trigger. | trigger-condition | null | |
| objects_to_process | Object types to process. ex. car,person,car.red. Conditional on processing_mode being objects. | model-label | null | |
| min_obj_size_pixels | Min. width and height of an object. Conditional on processing_mode being objects. | number | 64 | |
| obj_lookup_size_change_threshold | Object size ratio change threshold. Slider min: 0.1, max: 2.0, step: 0.2. Conditional on processing_mode being objects. | slider | 0.1 | |
| max_lookups_per_obj | Max. attempts per object. Conditional on processing_mode being objects. | number | 5 | |
| interval | Lookup interval in seconds. | number | 1 | |
| display_roi | Display ROI on video? | bool | true | |
| display_objinfo | Display results on video? Options: Disabled (disabled), Bottom left (bottom_left), Bottom right (bottom_right), Top left (top_left), Top right (top_right). | enum | bottom_left | |
| debug | Log debugging information? | bool | false |
Metadata
Output Metadata
| Metadata Property | Description |
|---|---|
nodes.node_id.recognized_objs | List of recognized objects within the ROI. |
nodes.node_id.recognized_obj_ids | Unique identifiers for recognized objects. |
nodes.node_id.recognized_obj_count | The number of recognized objects. |
nodes.node_id.recognized_obj_delta | Changes in the count of recognized objects. |
nodes.node_id.value_changed_delta | Changes in the values associated with recognized objects. |
nodes.node_id.unrecognized_obj_count | The number of unrecognized objects. |
nodes.node_id.unrecognized_obj_delta | Changes in the count of unrecognized objects. |
Example JSON
Updated 10 months ago