Not expecting much here since there’s a few somewhat similar topics with little resolve, and the issue seems rather context specific, but hey…
I’m not sure when this started exactly, but I’m fairly certain this only cropped up sometime in the past 1-3 months.
At a shockingly consistent interval, the middleware will hitch for a second or two, for example:
- Holding a key in the terminal, the echoing of the characters will lock up and then catch up a second later
- The widgets on the main dashboard will stop updating for that time
- Pages will take longer to load (if caught on the interval)
- etc
Funny enough the terminal through ssh does not seem to be effected, nor does a terminal in say a docker container that’s accessible via HTTP. Its mainly the middleware that gets bogged down.
What I’ve been able to determine is that the hitches are occurring due to (or at least at the same time as) the asyncio_loop process suddenly swelling all the way up to 100%+ usage.
I run about 20 docker stacks and a single HAOS VM (on a bridge with the host if it matters). As I spin these services down one after another, the interval at which this happens slows at an almost linear rate, until eventually when all services are stop the issue appears to cease. But even with just the VM or one or two containers up it will happen every 90 seconds or so.
With everything up it’s about every 18 seconds, though I’ve seen it be as bad as every 10.
I have another X570 system with a 3700X that doesn’t seem to do this even with a good number of docker containers (though no VM running).
I imagine it might be storage related, but I’m not really sure what to make of this. I checked the audit log, and there’s nothing odd in there (especially not anything that matches the period) other than me breaking things /s.
System is in sig.