New nodes for object flow counting, motion detection, tailgating, and presence monitoring expand analytics capabilities. Enhancements to Roboflow AI models, motion detection, object filtering, and speed estimation add flexibility and precision. Gateway 1.28.16 includes barcode recognition support, Jetson version reporting, and updated STUN server configuration.

Nodes

• 🍀 Object Flow Counter : Breakdown single or multi line counts by object types
• 🍀 Object Motion Detection : Detect moving objects
• 🍀 Tailgating : Detects tailgating instances
• 🍀 Presence Monitor : Simplified version of Occupancy Monitor node, primarily geared towards Alarm monitoring use cases.
• AI Model by Roboflow : Add classifier support
• Motion Detection : Add camera motion detection capability
• Filter Objects : Add tracking point support, fix property group name
• Speed Estimation : add motion sensitivity and flagged objects, add option to display only flagged objects

Gateway

1.28.16 (2024-05-21)

• Add libzbar0 to gateway containers for Recognize Barcodes node
• Report Jetson version to Lumeo
• Switch STUN server address to traverse.lumeo.com

Natural language search for recorded clips and event-triggered indexing now supported. Gateway hardware stats and performance metrics are visible in the console. Gateway v1.27.8 features include clip thumbnails, improved log handling, extended stream status checks, and GPU issue detection during restarts.

Nodes

• 🍀 Create Search Index : Index objects, events and scenes to enable natural language AI search for recorded clips.
• 🍀 Trigger an Event node : Generate events based on trigger conditions that can be indexed for search.

Platform

• Search : Search clips uploaded to Lumeo cloud using natural language!
• 🍀 Gateway hardware configuration and utilization stats are now visible via Lumeo console & Dashboard

Gateway

1.27.8 (2024-04-30)

Features

• 🍀 Report Gateway performance metrics (CPU & GPU Utilization and Memory, Disk space) to Lumeo Console.
• 🍀 Add Thumbnails for saved clips.

Bug fixes

• Prevent dropping log messages when the size is too large
• Increase online status check timeout for streams

Enhancements

• Detect GPU driver issues during deployment restarts, and restart container when such issues are detected

Enhanced nodes include GPU optimizations for Generic Detector, advanced object filters, MQTT version specification, and external certificate support for Google Chat alerts. Platform updates add SSL verification controls, automatic deployment cleanup for deleted sources, and improved gateway token security. Gateway 1.25.10 introduces SSL verification control and configurable update windows for streamlined updates.

Nodes

• Generic Detector: Use GPU to export model with FP16, run with CUDA by default and make TRT engine optional to improve start times. Also adds support for parallelized inference engine to reduce memory consumption.
• Filter Objects : remove / retain non specified objects, and add "object within object" filters (#298)
• Publish and Receive MQTT Messages : Explicitly specify MQTT version
• Trigger Google Chat Alert : Support external certificate files.

Platform

• 🍀 Allow turning off SSL cert verification for streams using the disable cert verification flag in stream and camera settings
• Delete a source's deployments when the video source is deleted
• Prevent gateway tokens from accessing routes for other gateways

Gateway

1.25.10 (2024-03-27)

• 🍀 Allow turning off SSL cert verification for streams that have the disable cert verification flag set.
• 🍀 Support for update windows. Set time range during which to check for Gateway updates using the installer script.

New nodes for Roboflow models, camera reporting, face recognition, and Google Chat enhance AI and alerting capabilities. Deployments now inherit labels from cameras and streams. Gateway 1.23.67 introduces multi-GPU load balancing, custom object insertion, improved deployment stop behavior, and prevents runaway restarts for file-based deployments.

Nodes

• 🍀 AI Model by Roboflow : Added support for Roboflow models, expanding integration options for AI-driven workflows
• Publish to Lumeo Dashboard : The Lumeo dashboard node now reports cameras as sources, improving source visibility in workflows.
• Face Recognition Edge : Updated face recognition with new models, yaw calculation, and other improvements for better accuracy.
• Trigger Google Chat Alert : Custom action button support added for Google Chat integration.

Platform

• Deployments now inherit Labels from cameras & streams

Gateway

1.23.67 (2024-02-22)

• Multi-gpu load-balancing support in parallelized inference engine
• Enable custom functions to insert new objects
• Stop restarting file deployments in case of errors to prevent runaway restart loops when the source is corrupted or yields a pipeline error
• Improve deployment stop behavior

New and updated nodes for Axis IO, Jetson GPIO, MQTT, speed estimation, and webhooks enhance integration and functionality. Platform gains security updates, API pagination, and improved gateway performance. Gateway release 1.22.17 fixes deployment and WebRTC issues while adding YOLO ONNX model support.

Nodes

• 🍀 Axis Network IO Read and Axis Network IO Write nodes make it easy to integrate with devices like sirens, strobes or other digital inputs.
• 🍀 Jetson GPIO Read Node and Jetson GPIO Write Node to read and write digital inputs on Jetson devices.
• 🍀 Publish and Receive MQTT Messages lets you integrate with MQTT for IOT device communications
• Speed Estimation node updated to support pps (pixels per second) unit and add motion types (stop_and_go, hover, regular).
• Send HTTP Webhook now lets you send webhooks at the start or end of the pipeline.

Platform

• Security updates and enhancements; support for new single-use Gateway provisioning tokens.
• Improved performance of starting and stopping cloud gateways
• Add pagination to all API endpoints.

Gateway (1.22.17)

1.22.17 (2024-01-29)

• Improved deployment state management and fix for deployments stuck in stopping state
• Support for new Lumeo YOLO ONNX model format in the parallelized inference engine
• Fix WebRTC playback issues

New quick-deploy workflow, GPT4 integration and large vision model nodes!

Platform

• 🍀 Quick Deploy workflow pre-built analytics en-masse to multiple cameras with a few clicks. This workflow is designed for integration and deployment teams to speed up analytics rollouts. Get started here : Quick Deploy Guide

Nodes

• 🍀 OCR to perform text recognition on regions of a frame or specific objects
• 🍀 OpenAI GPT4 Lookup looks up frame regions or objects using OpenAI GPT-4 APIs.
• 🍀 Generic Detector detects objects by providing their description
• 🍀 Generic Classifier classifies objects or frame regions by providing their description
• 🍀 Caption Generator captions a scene

Crowd and NSFW models, Labels for files, Improved streaming and new nodes for interfacing with external systems!

Hot off the press, here are the highlights from the latest release:

Platform

• Updated Model format support
  • 🍀 New format support : Azure YOLO CustomVision (General Compact S2) is now supported.
  • Custom models can now be set to use Parallelized (enhanced) or Default inference engine. Parallelized uses Triton to reduce memory consumption, but some model formats may not be supported. If you run into errors with the Parallelized model, you can fall back to Default.
• Files generated by Save Clip Node and Save Snapshot Node now support Labels and description for manual review workflows. Dashboard Files widget also supports displaying labels and description. Click on a file to view and set.
• Dashboards enhancements :
  • New metrics for data widgets : Latest Queue Size, Latest Estimated Wait time
  • Multistream widget now lets you enable / disable autoplay. When disabled, it periodically refreshes stream snapshots.

Nodes

• 🍀 Jetson GPIO Read Node and Jetson GPIO Write Node let you read and write GPIO pins on Jetson devices to integrate with external systems such as strobes and burglar alarms.
• 🍀 Webhook Receiver Node lets you receive webhooks from external services and inject the data into the pipeline. (requires Gateway 1.22.13).
• 🍀 AXIS Network IO Write Node
• Occupancy Monitor new metadata : estimated wait times, computed using Little's law.
• Trigger Google Chat Alert Node now supports serving media locally. When set, it will start a webserver to serve locally saved media for that specific deployment, and insert a media url that references itself. This is designed to help improve notification latencies for slow networks where uploads can take long time.
• Time Trigger Node now supports multiple, freeform time ranges so you can specify multiple times without having to use multiple time trigger nodes. Ex. weekdays 9am-5pm.
• Trigger Google Chat Alert Node, Trigger SMS Alert Node, Trigger Email Alert Node now support Jinja style templates in the message body fields so you can use metadata to populate the notification body.

Models

• 🍀 High Density Crowd model makes it possible to count hundreds of people in very high density environments such as events and concerts.
• 🍀 NSFW model detects content that can be classified as "Not-safe-for-work".

Gateway (1.22.13)

• Enhanced, persistent logging and diagnostics retrieval.
• Parallelized (Triton) inferencing now supports ONNX models.
• Supports Azure CustomVision Yolo models.
• Support for reading and writing GPIO pins on Jetson devices.
• Adds onnxruntime-gpu that can be used by custom function nodes to run custom models.
• Bug fixes:
  • Auto restart the deployments when GPU is unavailable because of driver updates.
  • Reduced the amount of time it takes to stop deployments.
  • RTSP and WebRTC playback is snappier and more reliable.

Role-based Access Controls, Lumeo-Ready Gateways, Time-bound trial gateways and RTSP playback in Console.

Hot off the press, here are the highlights from the latest release:

Platform

• 🍀 Roles Based Access Control : Assign organization and workspace level roles to limit what users can do. Available on Enterprise plans.
• 🍀 Lumeo-Ready Gateways : Lumeo-Ready gateways are Jetson and DGPU based devices that ship with Lumeo pre-installed, and make setup easy via a web interface in the field. You can order Lumeo-Ready gateways from select partners.
• 🍀 Lumeo Console now allows playback of RTSP streams from Cameras and pipeline output streams. Support to playback user-configured RTSP streams is coming next. (Requires Gateway v 1.19.1 or higher).
• Time-bound Trial Gateways : We heard you! Anyone can now create a Lumeo Cloud Trial Gateway with a 3 hour runtime. After 3 hours, the gateway will automatically shut down, and you can restart it in the Console. This allows us to offer Trial gateways to more users and never have to expire them.

Gateway (1.19.15)

• Supports Lumeo Console playback of RTSP streams.
• Triton-based (parallelized) inferencing now supports Nvidia ETLT models.
• Reduced memory utilization by lazy loading CUDA
• Supports exporting Metrics using OTLP HTTP push in addition to previously supported OTLP gRPC push.

Dashboard enhancements, auto-triggers to save you from writing triggers and Triton-based inferencing increases channel capacity by 2-3x!

Hot off the press, here are the highlights from the latest release:

Platform

• Dashboards now support Heatmaps, Grouped Bar charts and Stacked Bar charts.

Nodes

• 🍀 Webhook Node supports posting object snapshots.
• 🍀 Trigger Google Chat Alert Node now sends media delayed as a threaded attachment so that the initial alert goes out as soon as possible.
• 🍀 24x7 Incident Management System node to create an incident in 24x7 IMS
• 🍀 Save GIF Node : Saves a GIF based on trigger conditions.
• 🍀 Auto Triggers for Webhook Node, Publish to Google Sheets, Publish to Elasticsearch Node : No need to specify trigger conditions explicitly. Select Auto trigger mode to automatically publish metadata whenever significant data changes, at the specified interval.

  🚧

  Update existing nodes

  ⚠️ If you used these nodes previously, you should update your pipeline and choose "Custom Trigger" as the trigger type to preserve your existing triggers.

Gateway (1.16.25)

• Support for Triton-based inferencing that reduces memory consumption, allowing more pipelines to be run concurrently.
• Performance improvements improve inferencing and throughput by 1.5x
• Improved debug logs make it easier to find and fix issues.

Multimodal Data, Video and Image Dashboards, Reidentification Tracker and Models!

Hot off the press, here are the highlights from the latest release:

Platform

• Dashboards : Introducing multi-modal dashboards that make it easy to visualize live streams, snapshots, gifs and data extracted from video.

Nodes

• 🍀 Smart Zoom
• 🍀 ReIdentify Objects node
• 🍀 Trigger Google Chat Alert Node
• 🍀 Publish to Lumeo Dashboard node makes it easy to publish metadata from any Rule nodes to the Lumeo dashboard.

Models

• Person Reidentification Model
• Vehicle Reidentification Model

Gateway (1.15.10)

• RTSP server now listens on all NICs for output RTSP streams
• New Tracker type : "Re-Id". Uses DeepSORT tracking algorithm to perform tracking using AI models for similarity matching.
• Balena: Support to store models and configuration on an external partition using LUMEO_CONFIG_PARTITION env variable set in Balena device configuration.