🍀 Publish to Lumeo Dashboard node makes it easy to publish metadata from any Rule nodes to the Lumeo dashboard.
Models
Person Reidentification Model
Vehicle Reidentification Model
Gateway (1.15.10)
RTSP server now listens on all NICs for output RTSP streams
New Tracker type : "Re-Id". Uses DeepSORT tracking algorithm to perform tracking using AI models for similarity matching.
Balena: Support to store models and configuration on an external partition using LUMEO_CONFIG_PARTITION env variable set in Balena device configuration.
Universal Bridge, Labels, Solink and Rhombus integrations, 360 People models, OSHA compliance and a host of other goodies packed into a fun action-packed spring release!
Hot off the press, here are the highlights from the latest release:
Platform
🍀 Universal Bridge : New cloud-based service that lets you add AI to any IP camera by configuring it to send clips to Lumeo's cloud on motion or at periodic intervals. Process these clips using any custom analytic designed in the Lumeo cloud. Read our press release here.
🍀 Labels : Simplify management of Cameras, Gateways, Streams using labels. Labels are hierarchical (nest them all you like), and provide a filtered view of your deployed infrastructure.
A brand new Console UX that makes it easier to navigate and get common tasks done!
🍀 Scene Change Detection : Detect scene changes in the camera view. Useful for OSHA compliance (Box stacking, pathways and fire extinguishers unblocked, and more).
🍀 Aggregate Metadata Node : Aggregate metadata with Wildcards and output a single trigger. Simplify your Trigger Conditions.
🍀 Merge Objects Node : Combine objects from multiple models (such as multiple people detection models) when they overlap. Makes it easy to build pipelines using different models such as day and night people models.
🍀 Time Trigger Node : Trigger at certain times of the day, periodic intervals, etc.
🍀 Deployment limits per gateway : limit how many deployments can run in parallel on a single gateway
🍀 Console UX enhancements: enhanced JSON log viewer, Snapshot previews in streams, incremental loading for large number of cameras/deployments/resources.
Nodes
🍀 Webhook Node updates to push snapshots and clips with Form multi-part POST.
🍀 Camera calibration Node support
🍀 Occupancy Monitor updated to add exited_objects and objected_entered_timestamp to metadata.
🍀 Deepstream 6.1 support, Jetson requires Jetpack 5.0, DGPU requires drivers 515.x+, Balena will work as is
🍀 gateway_id and gateway_name, pipeline_id, pipeline_name available in function node parameters
🍀 Set "Tensor::source_node_id" and add "source" to object and object attribute meta so you can easily tell which node/model generated that object type and attributes.
🍀 Support for processing models trained using Azure Custom Vision Service (https://customvision.ai)
🍀 [Balena] Auto assign gateway name from BALENA_DEVICE_NAME_AT_INIT env var if present
🍀 Add extra metadata to video source node
🐛 Reduce MQTT traffic when there are no subscribers to logs topic
🐛 On Jetson and dGPU, local snapshot nodes save every frame. This has been fixed.
File support for offline processing, Simplified BYO model experience, Pre-buffer for Clips, Homekit Streaming node, Docker containers for Jetson devices and Unattended install mode
Hot off the press, here are the highlights from the latest release:
Platform
🍀 File support : Upload files to Lumeo or link a self-hosted file to process it using any gateway. See Files section in left nav to start. See Stream page for details.
🍀 Simplified BYO Model experience: A more structured way to import your models into Lumeo. See Analytics Library -> My AI Models to start.
🍀 Export pipelines to JSON and import them into a new workspace.
🐛 Fix Bulk updating deployments causes ROI coordinates to be lost
Nodes
🍀 Save Clip Node Pre-buffer support. Save clips starting from a time before a trigger occurs.
🍀 Homekit Streaming node : Publish Lumeo output streams as Apple Homekit Cameras for quick viewing and trigger alerts based on any analytic condition.
🐛 Fix flickering when viewing square aspect ratio video snapshots in Line and ROI nodes.
Gateway (v 0.4.11)
(All connected Gateways will auto update and restart any running deployments)
🍀 Docker container support for Jetson devices, defaults to docker for new installs. See Setting Up a Gateway section for details.
🍀 Unattended install support. Specify LUMEO_APP_ID and LUMEO_API_KEY environment variables to the installer to automatically provision a gateway. See Unattended Install section for details.
🐛 Fix so that linked ONVIF cameras' streams update automatically. Fixes an issue with new streams not showing up automatically in the Milestone ONVIF Bridge.
🐛 Fix inferencing slowdowns for the full YOLO models. Typically yields a 2-3x speedup for YOLO models.
For more details, check out the Release notes.
Reorganized node navigation, Bug fixes and reliability updates
Hot off the press, here are the goodies from the latest release:
Nodes
🍀 Reorganized Node categories in the Node library to make it easier to find the one you need.
🍀 Proximity Detection node lets you choose the tracking point other than the centroid
🐛 Fix duplicate triggers and counts that did not respect the Occupancy Monitor node's object presence buffer
Lumeo Gateway (v 0.3.6)
(All connected Gateways will auto update and restart any running deployments)
🍀 Restart deployments automatically in more situations where the source is unresponsive of stops streaming
🐛 Fix inability to capture camera snapshots for some camera models
Multi-stream and Local License Plate Recognition pipelines, Send snapshots to Elasticsearch, Autoconfigure Milestone Camera IDs, and new nodes for Profiling Performance and Filter Objects
Core Platform
🔥 Pipelines
New template for Multi-stream pipelines that let you process more streams with a given GPU
New template for Local License Plate Recognition
Performance, Stability & Security
30% runtime performance improvement for pipelines with a large number of objects
Fixed processing slow down when ingesting variable frame rate streams
Console
Support double-click in multiline and polygon to finish or close a shape
Auto generate default URI stream name from URI/file + allow editing in creation form
Models
🔥 Models : Local License Plate Recognition so you can read license plates on the edge without making a trip to the cloud!
Pipeline Nodes
Rules
Line Counter NodeOccupancy Monitor - select alternate tracking points to improve performance when Centroid tracking doesn't work well enough.
Trigger Milestone Event Node - Automatically configures camera ID when you use Milestone ONVIF / Open Network Bridge as the source, making it even easier to associate alerts and events with the correct camera in Milestone.
Function Node - add, modify and delete object metadata using the Function node, for advanced use cases such as filtering out objects or creating new ones.
Docker container support for DGPU installs, New Models: Forklift, Face gear, Crowd People, New Integrations: Elasticsearch, SMS, Pushover, Azure Face Recognition and LPR enhancements.
Lumeo Core Platform
Pipelines
New, ready-to-use templates for more use cases
Performance, Stability & Security
Docker container support for DGPU installations, for ease of setup and deployment management
Installer enhancements to reduce memory utilization, free up disk space and support alternate disk installation for Jetson devices
Significant runtime performance and stability improvements in light of network issues.
Billing
View your invoices and update payment methods from the Lumeo Console.
Models
New Models : Forklift detection, Face gear, Crowd People Body detection (high density)
Jetpack 4.6 updates, New VMS Integration Nodes, New Rules: Proximity, Speed, Multi-line, and New Video transformations - Tile video, Multiplex/Demultiplex Nodes. Platform updates to enable easier ROI drawing, and Trigger Conditions for conditional actions.
Lumeo Core Platform
Pipelines
ROI Drawing Tools : Draw Lines and ROIs on video stream previews.
Trigger Metadata support: Most Lumeo Nodes now generate metadata that can be used in "Trigger Conditions" within other nodes to generate conditional actions (like take a snapshot when an object crosses a line).
Trigger Conditions : New Trigger Condition builder in Node properties makes it easier to build trigger conditions with drop down and autocompletion.
Performance, Stability & Security
Upgrade to Nvidia Jetpack 4.6 / Deepstream 6.0 (more models support with high accuracy & real-time performance).
This requires you to update any Jetson devices to Jetpack 4.6 to receive Lumeo software updates moving forward. Instructions here.
Auth updates : We've migrated to a new authentication system for console.lumeo.com. Use the "Forgot Password" link on https://console.lumeo.com to reset your password if you have trouble logging in.
Lumeo Pipeline Nodes
Integrations (read more here)
Send events and alarms to existing VMS installations.
Metadata format for the LPR, Line Counter, Presence Counter and Queue nodes has been updated to reduce duplicate information, and introduce a uniform structure with new properties that can be used to trigger snapshots, video clip capture, webhooks, etc.
Summary
Metadata format for the following nodes has been updated to reduce duplicate information, and introduce a uniform structure with new properties that can be used to trigger snapshots, video clip capture, webhooks, etc. :
These updates take effect when you create new deployments or update existing ones. Starting and stopping existing deployments will not be impacted.
If you are expecting the old(er) format metadata, you can turn on legacy metadata option in the node property to keep the older format while you transition to the new format.
What's changed
Metadata format updates
With this update, these nodes insert their metadata inside the root field nodes, while previously those nodes used top-level fields like lpr, lines, presence, queue. The contents of those fields have now been moved into nodes.<node_id> as per below:
lpr -> nodes.<node_id>.license_plates
lines -> nodes.<node_id>.lines
presence -> nodes.<node_id>.rois
queue -> nodes.<node_id>.rois
To provide for backward compatibility during this transition, the Line Counter Node and License Plate Detection Node have the option to turn ON the legacy metadata format in node properties. Enabling that option will revert the metadata for those deployments to the older format.
New metadata properties
These nodes now add new metadata to make it easier to trigger webhooks, snapshots, etc. based on the difference in counts between previous and current frame. This makes it easier to trigger when a new car is detected, or when a new object crosses a line, etc.
For specifics of the new format, see node documentation.
What you need to do
If you have code that parses Lumeo metadata, either in a Custom Function, or sent to you via webhooks, or from a saved clip, you will need to update it to account for the format changes.
If you are using the Publish to Google Sheets node, you will need to update the Metadata to Publish property to look for metadata in the new format. Here's an example of the new property value:
