v3.0.0b12 - Bugfixes and cleanup jobs

This release includes a multitude of fixes and changes to improve the stability of Viseron.
It also adds multiple clean up jobs to keep the database and filesystem in sync in case of any crashes.

If you have tried the v3 beta before and experienced issues, i highly suggest trying this release out since it contains loads fo fixes-

Fixes

• Remove volumes from the Dockerfile to avoid issues with bind mounts
• Use the process watchdog for Darknet so that it is restarted in case of crashes
• Add extra logging to shutdown procedure to pinpoint threads and processes that is slowing it down
• Allow empty passwords for cameras
• Run every thread using RestartableThread so that it gets awaited during shutdown
• Fixes the move_on_shutdown: true config option. Previously Viseron did not wait for the callback to finish before exiting.
• A condition was missing when searchng for files for move_on_shutdown causing files to be moved multiple times
• Delete from FilesMeta table manually instead of using a trigger
• Properly throttle the function that checks if any files should be moved. This cause issues with attempting to move files multiple times
• Event clips are now generated in the servers timezone instead of UTC

Cleanup jobs

Multiple cleanup jobs now run regularly to make sure to keep the database and filesystem clutter free.
For instance if you delete files manually while Viseron is not started, the cleanup jobs will make sure that they are removed from the database.

They are intentionally throttled to run quite slow to not degrade performance of your host.

• OrphanedFilesCleanup (Mondays, 3 AM)

  • Removes files that are no longer associated with any recordings or events

• OrphanedDatabaseFilesCleanup (Wednesdays, 3 AM)

  • Cleans up database entries that point to non-existent files

• OrphanedFilesMetaCleanup (Fridays, 3 AM)

  • Removes metadata for files that no longer exist

• EmptyFoldersCleanup (Daily at midnight)

  • Removes empty folders to keep storage structure tidy

• OrphanedThumbnailsCleanup (Daily at midnight)

  • Removes thumbnail images that are no longer linked to any recordings

• OrphanedClipsCleanup (Daily at midnight)

  • Removes video clips that are no longer associated with any events

• OrphanedRecordingsCleanup (Daily at midnight)

  • Removes recordings that are no longer linked to any events

• OrphanedPostProcessorResultsCleanup (Daily at midnight)

  • Removes post-processing results that are no longer needed

• OrphanedObjectsCleanup (Daily at midnight)

  • Removes detected object data that is no longer associated with any events

• OrphanedMotionCleanup (Daily at midnight)

  • Removes motion detection data that is no longer linked to any events

• OldEventsCleanup (Daily at midnight)

  • Removes expired system events based on retention settings

For discussions, please use this discussion: #721

Full Changelog: v3.0.0b11...v3.0.0b12

v3.0.0b11 - Timeline player syncing

This release mainly contains new functionality to keep all the players on the Event/Timeline views in sync.
It can currently be a bit unclear if a stream is paused or not when it gets out of sync due to missing segments, that will be improved in the next beta.

Many performance improvements have also been made:

• Fetching available timespans is now done over websocket instead of through the API which reduces the amount of requests made significantly.
• If many events came close together it could cause stalls since each event would trigger a refetch from the API. These refetches are now debounced to avoid this.
• The entries in the event table is now virtualized (and the thumbnails only load when you stop scrolling).
  This significantly reduces lag and sluggishness of the table when having lots of events displayed.

And lastly, React has been upgrade to version 18, along with MUI v6 and React Query v5.
Togheter these upgrades should also equate to some performance improvements.

Details of all changes

• Sync all active players on the Events/Timeline page
• Upgrade to React 18
• Upgrade to MUI v6
• Upgrade to react-query v5
• Update timespans over using websockets
• Use system event listeners to refetch event queries
• Custom video controls
• Pick correct stream format config for substreams
• Massive performance increase for the Event table when having many events

For discussions, please use this discussion: #721

Full Changelog: v3.0.0b10...v3.0.0b11

v3.0.0b10 - Streaming improvements

This release is focused mainly on a new layout for the Events page.
You can now select multiple cameras at once and they will be shown in a grid. Camera streams will automatically resize to give as much coverage as possible.
Selecting cameras is done using the floating action button in the bottom right corner.
The streams are not yet properly synchronized. I will work on that for a coming beta.
Here is a short demo of the grid:

There is also a new filter button located next to the Events/Timeline tabs that allows you to filter out only the relevant event types.

Details of all changes

• Adds filters to the Events and Timeline tabs so you can filter out only the events you want (Motion, object, ALPR etc)
• Upgrades HLS.js
• Fix calling loadSource twice when viewing 24/7 recordings, resulting in a browser console error
• Generate HLS segments directly from ffmpeg instead of writing mp4 files and manually fragmenting.
  This significantly improves the stream quality and removes some choppyness.
• Make Events page more compact by removing the camera selection grid. Selecting cameras is done using the floating action button in the bottom right corner
• Never delete a frame from memory if it is still the current frame.
  Should reduce some intermittent errors in the logs
• Use the ffmpeg hls_flags program_date_time option to get the exact creation time for segments. Previously milliseconds were discarded causing some timing issues
• Use settings under recorder for transcoding the generated segments
• Events page now allows selection of multiple cameras and shows them in a grid with a dynamic layout based on the screen size
• FFmpeg now deletes segments on its own in case of a Viseron crash
• RegEx performance improved to avoid hanging on large m3u8 playlists
• Improve speed of SQL queries
• Camera cards now has status text and indicators showing various states
• Frontend optimizations
• Fix missing sahred frames of motion and object detecors
• Enable safe mode if config fails to load (if a secret is missing for instance)
• Other minor bug fixes

For discussions, please use this discussion: #721

What's Changed

• Fix small doc typo by @nneul in #782
• Update NVIDIA link on installation doc by @afaulconbridge in #786
• rm sponsor by @gitsponsored in #784
• Events page and streaming improvements by @roflcoopter in #793
• Properly delete segments by @roflcoopter in #796
• Events page multiple camera layout and stability improvements by @roflcoopter in #802

New Contributors

• @nneul made their first contribution in #782
• @afaulconbridge made their first contribution in #786

Full Changelog: v3.0.0b9...v3.0.0b10

v3.0.0b9 - EdgeTPU fix

• Fix for edgetpu crashing (#721 (comment))

For discussions, please use this discussion: #721

Full Changelog: v3.0.0b8...v3.0.0b9

v3.0.0b8 - License plate recognition events

• OpenCV 4.10.0
• Annotate images with supervision for nicer looking text and bounding boxes
• Fix HLS playback bug when not using auth
• Darknet on CPU now runs in a separate python process
• Store License plate recognition snapshots
• Show License plate recognition in the timeline/events tabs
• Store Motion detection snapshots
• Show Motion detection in the events tab
• Correctly calculate event amounts in the date picker
• Allow running object and motion detectors with trigger_recorder: true at the same time without using scan_on_motion_only: true or recorder_keepalive

For discussions, please use this discussion: #721

Full Changelog: v3.0.0b7...v3.0.0b8

v3.0.0b7 - Face recognition events

Changes

• Show Face Recognition events on the Events and Timeline tabs
• Events on the Events tab is now grouped to avoid clutter
• Fix auth check always being enabled when viewing the timeline
• Escape camera passwords
• Add better logic for redacting sensitive information from the logs
• New config option check_interval for each storage tier to control the minimum time between moving/deleting files
• Allow running without any detectors to only store continuous recordings
• Upgrade all python dependencies

For discussions, please use this discussion: #721

Full Changelog: v3.0.0b6...v3.0.0b7

v3.0.0b6 - GStreamer fix and VAAPI support

Fixes

• Small fix to GStreamer. A bug was introduced when upgrading to Ubuntu 22.04 which caused pipelines to hang
• Support for VAAPI decoding of streams in GStreamer

Full Changelog: v3.0.0b5...v3.0.0b6

v3.0.0b5 - Delete unwanted files instead of moving

Fixes

• Make sure to instantly delete files instead of moving them to succeeding tiers that wont store them
• Crossbuild gpac so it works on aarch64, jetson-nano etc
• Make sure jetson-nano finds the correct postgresql version

Full Changelog: v3.0.0b4...v3.0.0b5

v3.0.0b4 - Ubuntu 22.04 Jammy

Fixes

• Improve handling of clip created by create_event_clip
• Frontend breadcrumbs partially blocking icons in header
• Show Viseron version in the footer and the logs
• Containers are now based on Ubuntu Jammy and Python 3.10
• EdgeTPU runs in a separate python 3.9 shell since it does not support Python 3.10 yet
• Automatic PostgreSQL version upgrades
• Upgrade CUDA to 12.3
• Upgrade OpenCV to 4.9.0
• Upgrade Darknet
• Upgrade Dlib to 19.24.1
• Upgrade OpenCL and VA-API
• Make sure that postgres major version upgrades succeed when superuser != postgres

Full Changelog: v3.0.0b3...v3.0.0b4

For discussions, please use this discussion: #721

v3.0.0b3 - Fix builds

Small version bump to fix failing Azure builds