rclone config file - UNRAID #78

idscomm · 2023-01-29T20:42:39Z

idscomm
Jan 29, 2023

Hello,

Quick question about Unraid. I installed the Docker and I am trying to configure an existing rclone drive that I am currently using in Unraid. I use rclone as a plugin in Unraid (the config file was found on my flash drive) ... I tried a few things but as per the log of your docker container my rclone drive is not found.... Any idea how to fix that?

PS: Great container by the way, can't believe Unifi did not come with a backup solution yet!!!

This is the log (I redacted a few things):

cont-init: info: running /etc/cont-init.d/30-config
cp: cannot stat '/root/.config/rclone/rclone.conf': No such file or directory
cont-init: info: /etc/cont-init.d/30-config exited 0
services-up: info: copying legacy longrun unifi-protect-backup (no readiness notification)
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : Config:
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : address='REDACTED'
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : port=443
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : username='REDACTED'
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : password=REDACTED
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : verify_ssl=False
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : rclone_destination='onedrive:backup'
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : retention='30d'
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : rclone_args=''
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : ignore_cameras=()
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : verbose=1
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : detection_types=['motion', 'person', 'vehicle', 'ring']
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : file_structure_format='{camera_name}/{event.start:%Y-%m-%d}/{event.end:%Y-%m-%dT%H-%M-%S} {detection_type}.mp4'
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : sqlite_path='/config/database/events.sqlite'
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : download_buffer_size=512.0MiB
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : purge_interval='1d'
2023-01-29 16:31:19 [ INFO ] unifi_protect_backup.unifi_protect_backup : Starting...
2023-01-29 16:31:19 [ INFO ] unifi_protect_backup.unifi_protect_backup : Checking rclone configuration...
2023-01-29 16:31:19 [ DEBUG ] unifi_protect_backup.unifi_protect_backup : rclone found: /usr/bin/rclone
2023-01-29 16:31:19 [ ERROR ] asyncio : Task exception was never retrieved
future: <Task finished name='Task-1' coro=<run..new_coro() done, defined at /usr/lib/python3.10/site-packages/aiorun.py:227> exception=ValueError('rclone does not have a remote called onedrive')>
Traceback (most recent call last):
File "/usr/lib/python3.10/site-packages/aiorun.py", line 237, in new_coro
await coro
File "/usr/lib/python3.10/site-packages/unifi_protect_backup/unifi_protect_backup.py", line 154, in start
await self._check_rclone()
File "/usr/lib/python3.10/site-packages/unifi_protect_backup/unifi_protect_backup.py", line 258, in _check_rclone
raise ValueError(f"rclone does not have a remote called {remote}")
ValueError: rclone does not have a remote called onedrive
[custom-init] No custom services found, skipping...
[migrations] started
[migrations] no migrations found
usermod: no changes

Thanks in advance!!!

Dom

idscomm · 2023-01-31T01:25:29Z

idscomm
Jan 31, 2023
Author

Hey, found the issue so you can disregard my previous message. So far so good, working great!!

Any idea is this docker will stop working at some point depending on Unifi mods to the firmware/Protect software?

3 replies

ep1cman Apr 21, 2023
Maintainer

They can always do something to break things, but so far this API has been very stable - its what they use for their apps. This application is built on top of https://github.com/AngellusMortis/pyunifiprotect so if things do break, I expect them to make the necessary fixes.

alonjr Sep 7, 2024

Hey, found the issue so you can disregard my previous message. So far so good, working great!!

@idscomm, what did you do to solve your initial issue (ValueError: rclone does not have a remote called onedrive)? The running container seems to locate rclone.config, but cannot find the remote i referenced in RCLONE_DESTINATION.

thanks

idscomm Sep 10, 2024
Author

I ended up using a plugin on Homebridge which sync my cameras with Homekit, since I am paying for Apple One, I sync my recordings to the Apple Cloud which stayed for 10 days which is good enough for me. (https://support.apple.com/en-ca/guide/icloud/mme054c72692/icloud)

alonjr · 2024-09-10T10:56:56Z

alonjr
Sep 10, 2024

Hello @ep1cman, I am hitting a similar issue. From the error messages (see below), it appears that:

rclone.conf was not found and therefore ...
the remote referenced in rclone.conf (in my case named 'gdrive') cannot be found,

What troubleshooting steps can I take?

thank you
Alon

% docker run   -e UFP_USERNAME=REDACTED   -e UFP_PASSWORD=REDACTED   -e UFP_ADDRESS=REDACTED  -e RCLONE_DESTINATION="gdrive" -e UFP_SSL_VERIFY='false'   -v '/home/alon/docker/unifi-prortect-backup/config':'/config/rclone' -v "/home/alon/docker/unifi-protect-backup/data":"/data" -v "/home/alon/docker/unifi-protect-backup/database":"/database" ghcr.io/ep1cman/unifi-protect-backup
[migrations] started
[migrations] no migrations found
cp: cannot stat '/root/.config/rclone/rclone.conf': No such file or directory
usermod: no changes
───────────────────────────────────────
  _____ __ __ _____ _____ _____ _____
 |     |  |  |   __|_   _|     |     |
 |   --|  |  |__   | | | |  |  | | | |
 |_____|_____|_____| |_| |_____|_|_|_|
       _____ __ __ _ __    ____
      | __  |  |  | |  |  |    \
      | __ -|  |  | |  |__|  |  |
      |_____|_____|_|_____|____/

  Based on images from linuxserver.io
───────────────────────────────────────

To support LSIO projects visit:
https://www.linuxserver.io/donate/

───────────────────────────────────────
GID/UID
───────────────────────────────────────

User UID:    911
User GID:    911
───────────────────────────────────────
[custom-init] No custom files found, skipping...
[ls.io-init] done.
v
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :  Config:
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    address=REDACTED
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    port=443
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    username=REDACTED
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    password=REDACTED
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    verify_ssl=False
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    rclone_destination='gdrive'
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    retention=relativedelta(days=+7)
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    rclone_args=''
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    rclone_purge_args=''
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    ignore_cameras=()
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    verbose=1
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    detection_types=['motion', 'person', 'vehicle', 'ring']
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    file_structure_format='{camera_name}/{event.start:%Y-%m-%d}/{event.end:%Y-%m-%dT%H-%M-%S} {detection_type}.mp4'
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    sqlite_path='/config/database/events.sqlite'
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    download_buffer_size=512.0MiB
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    purge_interval=relativedelta(days=+1)
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    apprise_notifiers=()
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    skip_missing=False
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    download_rate_limit=None events per minute
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    max_event_length=7200s
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :    use_experimental_downloader=False
2024-09-10 09:55:28 [   INFO    ] unifi_protect_backup.unifi_protect_backup_core :  Starting...
2024-09-10 09:55:28 [   INFO    ] unifi_protect_backup.unifi_protect_backup_core :  Checking rclone configuration...
2024-09-10 09:55:28 [   DEBUG   ] unifi_protect_backup.unifi_protect_backup_core :  rclone found: /usr/bin/rclone
2024-09-10 09:55:28 [   ERROR   ] unifi_protect_backup.unifi_protect_backup_core :  Unexpected exception occurred in main loop:
Traceback (most recent call last):
  File "/usr/lib/python3.12/site-packages/unifi_protect_backup/unifi_protect_backup_core.py", line 189, in start
    await self._check_rclone()
  File "/usr/lib/python3.12/site-packages/unifi_protect_backup/unifi_protect_backup_core.py", line 331, in _check_rclone
    raise ValueError(f"rclone does not have a remote called `{remote}`")
ValueError: rclone does not have a remote called `gdrive`
2024-09-10 09:55:38 [   ERROR   ] aiorun                                     :  Unhandled exception; stopping loop: 'Task exception was never retrieved'
Traceback (most recent call last):
  File "/usr/lib/python3.12/site-packages/aiorun.py", line 219, in new_coro
    await coro
  File "/usr/lib/python3.12/site-packages/unifi_protect_backup/unifi_protect_backup_core.py", line 189, in start
    await self._check_rclone()
  File "/usr/lib/python3.12/site-packages/unifi_protect_backup/unifi_protect_backup_core.py", line 331, in _check_rclone
    raise ValueError(f"rclone does not have a remote called `{remote}`")
ValueError: rclone does not have a remote called `gdrive`
Traceback (most recent call last):
  File "/usr/bin/unifi-protect-backup", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/lib/python3.12/site-packages/click/core.py", line 1137, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/site-packages/click/core.py", line 1062, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/site-packages/click/core.py", line 763, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/site-packages/unifi_protect_backup/cli.py", line 232, in main
    run(event_listener.start(), stop_on_unhandled_errors=True)
  File "/usr/lib/python3.12/site-packages/aiorun.py", line 371, in run
    raise pending_exception_to_raise
  File "/usr/lib/python3.12/site-packages/aiorun.py", line 219, in new_coro
    await coro
  File "/usr/lib/python3.12/site-packages/unifi_protect_backup/unifi_protect_backup_core.py", line 189, in start
    await self._check_rclone()
  File "/usr/lib/python3.12/site-packages/unifi_protect_backup/unifi_protect_backup_core.py", line 331, in _check_rclone
    raise ValueError(f"rclone does not have a remote called `{remote}`")
ValueError: rclone does not have a remote called `gdrive`

3 replies

ep1cman Sep 10, 2024
Maintainer

If this error is occuring it means you have not mounted the rclone config file into the container in the expected location.

Please look at the readme for an example of the command to use with the correct mount points, the command you ran above is incorrect.

alonjr Sep 10, 2024

@ep1cman thanks for answering.
I may not be understanding the readme instructions ... On the host, rclone.conf is located in this directory /home/alon/docker/unifi-prortect-backup/config/ while in the container rclone.conf is located here /config/rclone/
what am I doing wrong?

ep1cman Sep 10, 2024
Maintainer

The provided example is:

docker run \
  -e UFP_USERNAME='USERNAME' \
  -e UFP_PASSWORD='PASSWORD' \
  -e UFP_ADDRESS='UNIFI_PROTECT_IP' \
  -e UFP_SSL_VERIFY='false' \
  -e RCLONE_DESTINATION='my_remote:/unifi_protect_backup' \
  -v '/path/to/save/clips':'/data' \
  -v '/path/to/rclone.conf':'/config/rclone/rclone.conf' \
  -v '/path/to/save/database':/config/database/ \
  ghcr.io/ep1cman/unifi-protect-backup

Your path to the database I notice is /database, As for why the rclone config file is not detected, I would suggest opening an interactive shell into the container to see what actually got mounted inside to see why /config/rclone/rclone.conf does not have the settings you expect

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

rclone config file - UNRAID #78

{{title}}

Replies: 2 comments 6 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

rclone config file - UNRAID #78

idscomm Jan 29, 2023

Replies: 2 comments · 6 replies

idscomm Jan 31, 2023 Author

ep1cman Apr 21, 2023 Maintainer

alonjr Sep 7, 2024

idscomm Sep 10, 2024 Author

alonjr Sep 10, 2024

ep1cman Sep 10, 2024 Maintainer

alonjr Sep 10, 2024

ep1cman Sep 10, 2024 Maintainer

idscomm
Jan 29, 2023

Replies: 2 comments 6 replies

idscomm
Jan 31, 2023
Author

ep1cman Apr 21, 2023
Maintainer

idscomm Sep 10, 2024
Author

alonjr
Sep 10, 2024

ep1cman Sep 10, 2024
Maintainer

ep1cman Sep 10, 2024
Maintainer