After upgrading Truenas from 25.04.2.4 to 25.10.0 same repeated error messages, related to some Python scripts, are logged in /var/log/netdata/error.log. The problem described occurs also on a fresh 25.10.0 installation.
So, two scenarios were tested so far on the same Setup: upgrade from 25.04.2.4 to 25.10.0 and a fresh install of 25.10.0.
Setup: Truenas is running as VM in Proxmox; /dev/sda is the boot drive, storage device defined in Proxmox; this device is reported in the error messages.
Problem:
-
in /var/log/netdata/error.log some Python scripts are logging multiple errors/second. The size of /var/log/netdata/error.log reaches tens of MB in less than 24h.
-
probably as a consequence of this error in Reporting, Disks view I am not able to see any Stats for boot drive /dev/sda; however the Stats are available for all the other drives, they are OK
Next testing steps: will also try to install again Truenas 25.04.2.x on the same Setup and check behaviour; comparison asked by Truenas team in “truenas-25-10-0-is-now-available” thread.
- Output of “tail -50 /var/log/netdata/error.log”:
root@tnas[/home/truenas_admin]# tail -50 /var/log/netdata/error.log^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_io.py”, line 86, in read_gptdev_fd = os.open(devobj, os.O_RDONLY)^^^^^^^^^^^^^^^^^^^^^^^^^^^^PermissionError: [Errno 13] Permission denied: ‘/dev/sda’Unexpected error reading partitions for device: ‘/dev/sda’Traceback (most recent call last):File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_class.py”, line 397, in partitionsreturn read_gpt(dev_fd or self.devpath, self.lbs)^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_io.py”, line 86, in read_gptdev_fd = os.open(devobj, os.O_RDONLY)^^^^^^^^^^^^^^^^^^^^^^^^^^^^PermissionError: [Errno 13] Permission denied: ‘/dev/sda’Unexpected error reading partitions for device: ‘/dev/sda’Traceback (most recent call last):File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_class.py”, line 397, in partitionsreturn read_gpt(dev_fd or self.devpath, self.lbs)^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_io.py”, line 86, in read_gptdev_fd = os.open(devobj, os.O_RDONLY)^^^^^^^^^^^^^^^^^^^^^^^^^^^^PermissionError: [Errno 13] Permission denied: ‘/dev/sda’Unexpected error reading partitions for device: ‘/dev/sda’Traceback (most recent call last):File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_class.py”, line 397, in partitionsreturn read_gpt(dev_fd or self.devpath, self.lbs)^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_io.py”, line 86, in read_gptdev_fd = os.open(devobj, os.O_RDONLY)^^^^^^^^^^^^^^^^^^^^^^^^^^^^PermissionError: [Errno 13] Permission denied: ‘/dev/sda’Unexpected error reading partitions for device: ‘/dev/sda’Traceback (most recent call last):File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_class.py”, line 397, in partitionsreturn read_gpt(dev_fd or self.devpath, self.lbs)^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File “/usr/lib/python3/dist-packages/middlewared/utils/disks_/disk_io.py”, line 86, in read_gptdev_fd = os.open(devobj, os.O_RDONLY)^^^^^^^^^^^^^^^^^^^^^^^^^^^^
- Listing content of folder /var/log/netdata/
root@tnas[/home/truenas_admin]# ls -l /var/log/netdata/
total 646
-rw-r--r-- 1 netdata netdata 0 Nov 3 23:11 debug.log
-rw-r--r-- 1 netdata netdata 20376745 Nov 5 10:19 error.log
-rw-r--r-- 1 netdata netdata 70991 Nov 5 00:00 error.log.1.gz
-rw-r--r-- 1 netdata netdata 0 Nov 3 23:11 health.log
root@tnas[/home/truenas_admin]# tail -50 /var/log/netdata/error.log
- Output of lsblk:
root@tnas[/home/truenas_admin]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 64G 0 disk
├─sda1 8:1 0 1M 0 part
├─sda2 8:2 0 512M 0 part
└─sda3 8:3 0 63.5G 0 part
sdb 8:16 0 1.7T 0 disk
└─sdb1 8:17 0 1.7T 0 part
sdc 8:32 0 1.7T 0 disk
└─sdc1 8:33 0 1.7T 0 part
sdd 8:48 0 1.7T 0 disk
└─sdd1 8:49 0 1.7T 0 part
sde 8:64 0 1.7T 0 disk
└─sde1 8:65 0 1.7T 0 part
sdf 8:80 0 12.7T 0 disk
└─sdf1 8:81 0 12.7T 0 part
sdg 8:96 0 12.7T 0 disk
└─sdg1 8:97 0 12.7T 0 part
nvme1n1 259:0 0 894.3G 0 disk
└─nvme1n1p1 259:2 0 892.3G 0 part
nvme0n1 259:1 0 894.3G 0 disk
└─nvme0n1p1 259:3 0 892.3G 0 part
Anyone else reporting this problem?
Any idea on how we can limit this logging as a temporarily fix?
Thank you, Sorin
