Macvlan issue on Scale

Apps and Virtualization
,
1

I have been running homebridge as a Truenas scale app for several months now, and it’s been running very smoothly. Seemingly randomly, a couple days ago, both of my macvlan adapters(one for management and one for the smart home network) associated with this container went bad, and homebridge can’t reach out to the network. Previously, I could access the host machine, router, and the internet, but now, It can’t reach any of these. It is receiving the IPs it is supposed to, but isn’t able to make proper use of them and pings just time out.

I have tried manually removing the networks from the command line (docker network rm ix-homebridge_homebridge_net), and this hasn’t changed anything. Pertinent networks on the truenas machine all look as expected to me, but are shown below:

vlan192 - management network
vlan44 - isolated network through VPN on router
vlan153 - Smart home network
vlan1 - Default network
br0 - 10.101.101.1

networks:
  homebridge_net:
    driver: macvlan
    driver_opts:
      parent: vlan153
    ipam:
      config:
        - gateway: 192.168.53.1
          subnet: 192.168.53.0/24
  ix-manage_management:
    external: True
***this portion is not included in this container, but another container that is also not working***
  management:
    driver: macvlan
    driver_opts:
      parent: vlan192
    ipam:
      config:
        - gateway: 192.168.0.1
          subnet: 192.168.0.0/24
***end external portion***
services:
  homebridge:
    container_name: homebridge
    deploy:
      resources:
        limits:
          cpus: '4'
          memory: 4096M
    image: homebridge/homebridge:latest
    networks:
      homebridge_net:
        ipv4_address: 192.168.53.11
      ix-manage_management:
        ipv4_address: 192.168.0.21
    restart: unless-stopped
    volumes:
      - /mnt/Pool/Apps/homebridge:/homebridge
      - /mnt/Pool/Recordings:/Recordings
2

New to truenas, and a fresh install and funny enough I’m having issues with VMs. Ran fine for 3 days. Then all of a sudden randomly loses network now.

3

I don’t have experience with vlans, macvlans and truenas apps. But I have some questions:

  1. Can your homebridge container access smart network devices?
  2. Can you access homebridge container from the management network? Or at least ping it?
  3. Is it considered normal to have multiple gateways with macvlans? I have very high doubts about it, but as I said, I have no experience with it.
4

No network access in or out on any network. 100% packet loss when pinging anything.

The management and homebridge_net networks are two completely separate networks. homebridge gets an IP of 192.168.53.11 in the 192.168.53.0/24 range to communicate with devices, and the UI is managed from 192.168.0.21 in the 192.168.0.0/24 range.

The idea is that by isolating the management UI for all of my services, I am able to improve granularity of access control.

5

Yeah, I got it.

What about multiple gateways? If you also don’t know whether it’s normal or not with macvlan networks, I suggest you to remove the gateway option from homebridge_net.

6

Worth a shot, but unfortunately didn’t change anything. I also tried removing and rebuilding the macvlan networks, which also did not change anything.

7

Not a TrueNAS issue at all. My switch had failed and needed a config reset. Thanks for the help from everybody.