Overview

Lumeo's AI Search makes it easy to find the event or video you are looking for using natural language descriptions or appearance. AI Search is available via Monitor -> Search section in the Lumeo Console and in Lumeo mobile apps.

📘

Availability

Search is available on Lumeo's Core and Enterprise plans with a Lumeo Cloud Add-on, and requires that video clips be uploaded to Lumeo Cloud using the Save Clip node.

Text Search

After a media recordings have been indexed for relevant Data types, you can search for them with various types of metadata as outlined below:

Filters

The following filters are available to limit your search :

• Time range
• Data type
• Source
• Gateway

Relevance, Quantity, and Sorting

When Scene search is enabled, you can adjust the Sensitivity slider to return more relevant results (tighter match) or more number of results (loose match). You should adjust the slider to relax or tighten search matching depending on your query and the number of results returned.

Results

Following these guidelines will help you make the most out of the AI Search capability:

• When searching for objects or scenes, lead with nouns and pronouns where possible; prefix with "a". Start with the object type you are trying to find and then describe it. Example:
  • a red car
  • a person carrying a yellow object
  • a red car in a parking lot
• Event, Text, and Object labels such as license plates can be searched by just providing the exact value you are looking for.
• If your search yields too few or too many recordings, adjust the sensitivity slider ("Relevance" <---> "Quantity") to see more or fewer results.
• If search takes too long to return results, try restricting the Time range, Source or Gateway before searching.

Appearance Search

Appearance search lets you search for people or faces in apperaance-enabled recordings stored in Lumeo cloud by matching up their appearance against another image.

Filters

The following filters are available to limit your search :

• Time range
• Source
• Gateway

Relevance, Quantity, and Sorting

When Appearance search is enabled, you can adjust the Sensitivity slider to return more relevant results (tighter match) or more number of results (loose match). You should adjust the slider to relax or tighten search matching depending on your query and the number of results returned. Typical thresholds for good matches are:

• 0.8 / 80% for people
• 0.3 / 30% for faces

When appearance search is enabled, Text search options are disabled. You can start by searching using Text search "person in yellow shirt" and then use Appearance search on the results to narrow down.

Setup & Configuration

Text Search

Text search is enabled for all templates in the Search category in the Solutions Gallery. Deploy one to your source and you will be able to search for the results.

Appearance Search

To enable Appearance search on recordings, deploy the Appearance search workflow from the Solutions Gallery.

Build your own Workflows

Search is available for media recordings that are generated by a pipeline which have a Create Search Index node followed by a Save Clip or Save Snapshot node. Currently, GIFs are not indexed.

Create Search Index node lets you control the data types that are indexed. Indexing is performed on the Lumeo AI Gateway, and the results are uploaded to Lumeo Cloud along with the media. Note that indexing Signatures is computationally heavy. You can add this node to any pipeline to index it's contents.

Tip: Add aTrigger an Event node prior to the Create Search Index node to generate user-defined events that will then be searchable.