Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kernel Panic macOs client #1896

Open
asvataa opened this issue Apr 27, 2024 · 23 comments
Open

Kernel Panic macOs client #1896

asvataa opened this issue Apr 27, 2024 · 23 comments

Comments

@asvataa
Copy link

asvataa commented Apr 27, 2024

After installing an application on mac os, the system crashes with kernel panic error. It's not clear what this is related to, because on some macos everything works fine, but we've seen this error on two mac os.

We use self-hosted netbird version 0.27.3

laptops versions

  1. Operating System = Darwin 14.4.1

  2. Agent Version = 0.27.3

  3. Operating System = Darwin 12.4

  4. Agent Version = 0.27.3

@jiangslee
Copy link

It maybe the same issue with me. MacOS crashed when I enabled the exit node route. plase check your macos crash log.Is there has a remoted service hang?

@jiangslee
Copy link

@asvataa
Copy link
Author

asvataa commented Apr 28, 2024

@jiangslee Hi, thx for sharing a slack link.
The most interesting thing is that on my personal pc this does not happen, although the netbird network settings are the same as on the problematic pc, exit node is installed.
Getting crash logs from people who have this problem will be problematic.
Were you able to solve this problem?

@jiangslee
Copy link

@asvataa I tested another macbook air m1 and no crashes occurred.

The official recommendation is to try reinstalling the system, but I don’t want to reinstall it.

I have no choice but to temporarily disable the exit node route of netbird 0.27.3.

Hope this can be resolved.

@mlsmaycon
Copy link
Collaborator

@jiangslee @asvataa can you confirm if you have installed or run any “cleaning”, “optimizing”, “speed-up” or anti-virus apps on your Mac?

And if you have an external authentication service (ldap, active directory, etc) configured for your Mac?

Lastly, @asvataa can you share the panic log?

@asvataa
Copy link
Author

asvataa commented May 2, 2024

Hi @mlsmaycon

Sorry for a late answer.
Of all the things you've written, none of them have been installed. There is no authorization on the macbook side either.
We also tried to update server and client to the latest version 0.27.4, that didn't work either.

Here is the full kernel panic logs

panic-full-2024-05-02-094234.0003.ips.txt

contents.panic.txt

@reflet-devops
Copy link

reflet-devops commented May 2, 2024

Hello,

we are having the same issue with our macOS users on a selfhosted netbird instance on version 0.27.3
Just like @asvataa explained, some macOS users have kernel panic after launching netbird. The delay between the "netbird up" and the kernel panic is arbitrary. Sometimes it is immediately and sometimes it happen after several minutes. The only constant is that users do not have panic when netbird is down.

Information on user with kernel panic

  1. Darwin 14.1.1, Intel Core i7, 16Go RAM
  2. Darwin 12.2.1, Intel Core i9, 32Go RAM
  3. Darwin 12.5, Apple M1 Pro, 32 Go RAM

Information on user with no kernel panic:

  1. Darwin 14.4.1, Apple M2, 24Go RAM
  2. Darwin 14.4.1, Apple M1 Max, 32Go RAM

All these users uses client's version 0.27.3

We hope that these information can help you

@mlsmaycon
Copy link
Collaborator

@asvataa thanks for the logs.

@reflet-devops, can you share your panic logs and confirm that exit nodes were enabled for them?

@asvataa @jiangslee @reflet-devops can you also confirm that you have nameservers configured in the dashboard without a match domain and distributed to these peers?

@reflet-devops
Copy link

@reflet-devops, can you share your panic logs and confirm that exit nodes were enabled for them?

Yes, I forgot to mention that an exit-node was enabled for all users.

Here is a full panic log:

panic(cpu 8 caller 0xffffff801d05c89b): userspace watchdog timeout: no successful checkins from remoted (3 induced crashes) in 180 seconds
remoted returned not alive with context : is_alive_func returned unhealthy : device not connected (code: 0x2
service: logd, total successful checkins in 49717 seconds: 4416, last successful checkin: 0 seconds ago
service: WindowServer, total successful checkins in 49682 seconds: 4412, last successful checkin: 0 seconds ago
service: remoted (3 induced crashes), total successful checkins in 49717 seconds: 4385, last successful checkin: 180 seconds ago
service: opendirectoryd, total successful checkins in 49717 seconds: 4415, last successful checkin: 0 seconds ago
service: configd, total successful checkins in 49717 seconds: 4415, last successful checkin: 0 seconds ago

Panicked task 0xffffffa443054df8: 3 threads: pid 124: watchdogd
Backtrace (CPU 8), panicked thread: 0xffffffaddc49e598, Frame : Return Address
0xffffffb47e2f7510 : 0xffffff801a43aca1 
0xffffffb47e2f7560 : 0xffffff801a5993c0 
0xffffffb47e2f75a0 : 0xffffff801a588b0c 
0xffffffb47e2f7620 : 0xffffff801a3d7971 
0xffffffb47e2f7640 : 0xffffff801a43af8d 
0xffffffb47e2f7730 : 0xffffff801a43a633 
0xffffffb47e2f7790 : 0xffffff801abd96de 
0xffffffb47e2f7880 : 0xffffff801d05c89b 
0xffffffb47e2f7890 : 0xffffff801d05c364 
0xffffffb47e2f78b0 : 0xffffff801d05b42b 
0xffffffb47e2f79e0 : 0xffffff801ab4ee56 
0xffffffb47e2f7a10 : 0xffffff801ab4f1cd 
0xffffffb47e2f7b80 : 0xffffff801a5445df 
0xffffffb47e2f7ca0 : 0xffffff801a4138a0 
0xffffffb47e2f7d60 : 0xffffff801a42b6b8 
0xffffffb47e2f7dd0 : 0xffffff801a42bd28 
0xffffffb47e2f7ef0 : 0xffffff801a56e102 
0xffffffb47e2f7fa0 : 0xffffff801a3d7dd6 
      Kernel Extensions in backtrace:
         com.apple.driver.watchdog(1.0)[F1797B78-7645-3FC6-AD29-624DD0826DA0]@0xffffff801d05a000->0xffffff801d05cfff

Process name corresponding to current thread (0xffffffaddc49e598): watchdogd

Mac OS version:
23B81

Kernel version:
Darwin Kernel Version 23.1.0: Mon Oct  9 21:27:27 PDT 2023; root:xnu-10002.41.9~6/RELEASE_X86_64
Kernel UUID: 7C8FE931-57C6-38AD-9EBB-CC5572293AE6
roots installed: 0
KernelCache slide: 0x000000001a000000
KernelCache base:  0xffffff801a200000
Kernel slide:      0x000000001a0e0000
Kernel text base:  0xffffff801a2e0000
__HIB  text base: 0xffffff801a100000
System model name: MacBookPro16,1 (Mac-E1008331FDC96864)
System shutdown begun: NO
Hibernation exit count: 3

System uptime in nanoseconds: 49717860466268
Last Sleep:           absolute           base_tsc          base_nano
  Uptime  : 0x00002d37d769837b
  Sleep   : 0x00001cb94afac04f 0x00006b8fa5b962ae 0x00001cb48602fd3a
  Wake    : 0x00001cb9804f917c 0x00006bb680304b24 0x00001cb95f7b6712
Compressor Info: 5% of compressed pages limit (OK) and 6% of segments limit (OK) with 2 swapfiles and OK swap space
Zone info:
  Zone map: 0xffffff94429e0000 - 0xffffffb4429e0000
  . PGZ   : 0xffffff94429e0000 - 0xffffff94449e1000
  . VM    : 0xffffff94449e1000 - 0xffffff99111e0000
  . RO    : 0xffffff99111e0000 - 0xffffff9aaa9e0000
  . GEN0  : 0xffffff9aaa9e0000 - 0xffffff9f771e0000
  . GEN1  : 0xffffff9f771e0000 - 0xffffffa4439e0000
  . GEN2  : 0xffffffa4439e0000 - 0xffffffa9101e0000
  . GEN3  : 0xffffffa9101e0000 - 0xffffffaddc9e0000
  . DATA  : 0xffffffaddc9e0000 - 0xffffffb4429e0000
  Metadata: 0xffffffb4429f0000 - 0xffffffb4629f0000
  Bitmaps : 0xffffffb4629f0000 - 0xffffffb4659f0000
  Extra   : 0 - 0

last started kext at 10392612215: >!ATopCaseHIDEventDriver	7400.26 (addr 0xffffff801bd30000, size 36864)
loaded kexts:
>!ATopCaseHIDEventDriver	7400.26
>!AHIDALSService	1
>!APlatformEnabler	2.7.0d0
>AGPM	135
>X86PlatformShim	1.0.0
@filesystems.autofs	3.0
@kext.AMDRadeonX6000	5.0.1
@kext.AMDRadeonServiceManager	5.0.1
>!AUpstreamUserClient	3.6.11
>!AGraphicsDevicePolicy	8.1.9
>!ABridgeAudio!C	400.1
>!AGFXHDA	300.1
@AGDCPluginDisplayMetrics	8.1.9
>!AMuxControl2	8.1.9
>pmtelemetry	1
@filesystems.nfs	1
|IOUserEthernet	1.0.1
>usb.!UUserHCI	1
>!ASunrise	1
>!AHV	1
>AGDCBacklightControl	8.1.9
>!A!IKBLGraphics	22.0.1
>!ABacklight	180.9
>!AThunderboltIP	4.0.3
>!AFIVRDriver	4.1.0
>ACPI_SMC_PlatformPlugin	1.0.0
>!A!ISlowAdaptiveClocking	4.0.0
>BridgeAudioCommunication	400.1
>!AAVEBridge	6.1
>!A!IPCHPMC	2.0.1
@UVCService	1
>!AMCCSControl	1.17
>!A!ICFLGraphicsFramebuffer	22.0.1
>BCMWLANFirmware4388.Hashstore	1
>BCMWLANFirmware4387.Hashstore	1
>BCMWLANFirmware4378.Hashstore	1
>BCMWLANFirmware4377.Hashstore	1
>BCMWLANFirmware4364.Hashstore	1
>BCMWLANFirmware4355.Hashstore	1
>!AFileSystemDriver	3.0.1
@filesystems.tmpfs	1
@filesystems.lifs	1
@filesystems.hfs.kext	650.0.2
@BootCache	40
@!AFSCompression.!AFSCompressionTypeZlib	1.0.0
@!AFSCompression.!AFSCompressionTypeDataless	1.0.0d1
@filesystems.apfs	2235.41.1
>!ABCMWLANBusInterfacePCIeMac	1
@private.KextAudit	1.0
>!ASmartBatteryManager	161.0.0
>!AACPIButtons	6.1
>!ASMBIOS	2.1
>!AACPIEC	6.1
>!AAPIC	1.7
@!ASystemPolicy	2.0.0
@nke.applicationfirewall	404
|IOKitRegistryCompatibility	1
|EndpointSecurity	1
@Dont_Steal_Mac_OS_X	7.0.0
>!ADiskImages2	273
@kec.!AEncryptedArchive	1
>!AHS!BDriver	7400.26
>IO!BHIDDriver	9.0.0
>!AActuatorDriver	7400.42
>!AMultitouchDriver	7400.42
>!AInputDeviceSupport	7410.1
>!AHIDKeyboard	7400.2
@kext.AMDRadeonX6100HWLibs	1.0
@kext.AMDRadeonX6000HWServices	5.0.1
>!UAudio	610.3
>!AAudioClockLibs	300.1
>!A!ILpssUARTv1	3.0.60
>!A!ILpssUARTCommon	3.0.60
>!AOnboardSerial	1.0
>!AHDA!C	500.3
|IOHDA!F	500.3
|IOAudio!F	500.4
@vecLib.kext	1.2.0
>!AGraphicsControl	8.1.9
@kext.triggers	1.0
>IOHIDPowerSource	1
>!ACallbackPowerSource	1
|IOAVB!F	1200.18
>!ARSMChannel	1
|IORSM!F	1
>!AIPAppender	1.0
>!ASMBusPCI	1.0.14d1
@kext.AMDRadeonX6000Framebuffer	5.0.1
@kext.AMDSupport	5.0.1
>!ABacklightExpert	1.1.0
|IONDRVSupport	598
@plugin.IOgPTPPlugin	1200.91
>!AThunderboltEDMSink	5.0.3
>!AThunderboltDPOutAdapter	8.5.1
>IOPlatformPluginLegacy	1.0.0
>X86PlatformPlugin	1.0.0
@!AGPUWrangler	8.1.9
|IOSlowAdaptiveClocking!F	1.0.0
>IOPlatformPlugin!F	6.0.0d8
>!ASMBus!C	1.0.18d1
|IOAccelerator!F2	481.0.1
@!AGraphicsDeviceControl	8.1.9
|IOGraphics!F	598
>driverkit.serial	6.0.0
>usb.cdc.ecm	5.0.0
>usb.cdc.ncm	5.0.0
>usb.IOUSBHostHIDDevice	1.2
>usb.cdc	5.0.0
>usb.networking	5.0.0
>usb.!UHostCompositeDevice	1.2
>!AThunderboltPCIDownAdapter	4.1.1
>!AThunderboltDPInAdapter	8.5.1
>!AThunderboltDPAdapter!F	8.5.1
>!AHPM	3.4.4
>!A!ILpssI2C!C	3.0.60
>!A!ILpssI2C	3.0.60
>!A!ILpssDmac	3.0.60
>!ABSDKextStarter	3
|IOSurface	352.0.3
@filesystems.hfs.encodings.kext	1
>!ASyntheticGame!C	11.1.9
>!AXsanScheme	3
>!AThunderboltNHI	7.2.81
|IOThunderbolt!F	9.3.3
>usb.!UVHCIBCE	1.2
>usb.!UVHCICommonBCE	1.0
>usb.!UVHCI	1.2
>usb.!UVHCICommon	1.0
>!AEffaceableNOR	1.0
|IOBufferCopy!C	1.1.0
|IOBufferCopyEngine!F	1
|IONVMe!F	2.1.0
>!ABCMWLANCoreMac	1.0.0
|IO80211!F	1200.13.0
>IOImageLoader	1.0.0
>!AOLYHALMac	1
|IOSerial!F	11
>corecapture	1.0.4
>usb.!UHostPacketFilter	1.0
|IOUSB!F	900.4.2
>usb.!UXHCIPCI	1.2
>usb.!UXHCI	1.2
>!AEFINVRAM	2.1
>!AEFIRuntime	2.1
>!ASMCRTC	1.0
|IOSMBus!F	1.1
|IOHID!F	2.0.0
|IOTimeSync!F	1200.91
|IOSkywalk!F	1.0
>mDNSOffloadUserClient	1.0.1b8
|IONetworking!F	3.4
>DiskImages	493.0.0
|IO!B!F	9.0.0
|IOReport!F	47
$quarantine	4
$sandbox	300.0
@kext.!AMatch	1.0.0d1
>!ASSE	1.0
>!ALockdownMode	1
>!AKeyStore	2
>!UTDM	556
|IOUSBMass!SDriver	243
|IOSCSIBlockCommandsDevice	492
|IOSCSIArchitectureModel!F	492
>!AFDEKeyStore	28.30
>!AEffaceable!S	1.0
|IO!S!F	2.1
>!ACyrus	1
>!ACredentialManager	1.0
>KernelRelayHost	1
|IOUSBHost!F	1.2
>!UHostMergeProperties	1.2
>usb.!UCommon	1.0
>!AMobileFileIntegrity	1.0.5
$!AImage4	5.0.0
@kext.CoreTrust	1
|CoreAnalytics!F	1
>!ABusPower!C	1.0
>!ASEPManager	1.0.1
>IOSlaveProcessor	1
>!AACPIPlatform	6.1
>!ASMC	3.1.9
|IOPCI!F	2.9
|IOACPI!F	1.4
>watchdog	1
@kec.pthread	1
@kec.XrtHostedXnu	1
@kec.Libm	1
@kec.Compression	1.0
@kec.corecrypto	14.0

@asvataa @jiangslee @reflet-devops can you also confirm that you have nameservers configured in the dashboard without a match domain and distributed to these peers?

Aside from the domain name for the VPN network (--dns-domain on the management cmd), we do not have specific DNS configurations.

@mlsmaycon
Copy link
Collaborator

@reflet-devops can you specify a name server similar to the screenshot below and see if this helps?

image It should use a distribution group to which the affected peers belong.

@reflet-devops
Copy link

We add Google and Cloudflare DNS for testing. We will keep you updated on how it changes this panic behaviors on our macOS users

@reflet-devops
Copy link

Unfortunately, a panic occur several minutes after launching netbird on the first user in the list presented previously.

Can this issue be linked with the OS version ?
On our macOS users, panics only occur on user with a OS version different from 14.4.1.

@asvataa
Copy link
Author

asvataa commented May 3, 2024

Can this issue be linked with the OS version ?
On our macOS users, panics only occur on user with a OS version different from 14.4.1.

I guess the problem is not in the system version because we had this problem on both 14.4.1 and 12.4 versions.

We have these dns settings @mlsmaycon
Снимок экрана 2024-05-03 в 16 29 25

Unfortunately, a panic occur several minutes after launching netbird on the first user in the list presented previously.

As @reflet-devops said, that's probably not the case.

@CampbellL
Copy link

Any news on this? I am facing the same issue on my 2018 Macbook Pro running MacOs 14.3.1 (23D60)

@greatbody
Copy link

My panic log
`
panic(cpu 4 caller 0xffffff80048ab89b): userspace watchdog timeout: no successful checkins from remoted (2 induced crashes) in 180 seconds
remoted returned not alive with context : is_alive_func returned unhealthy : device not connected (code: 0x2
service: logd, total successful checkins in 225 seconds: 23, last successful checkin: 0 seconds ago
service: WindowServer, total successful checkins in 190 seconds: 19, last successful checkin: 0 seconds ago
service: remoted (2 induced crashes), total successful checkins in 225 seconds: 3, last successful checkin: 180 seconds ago
service: opendirectoryd, total successful checkins in 225 seconds: 22, last successful checkin: 0 seconds ago
service: configd, total successful checkins in 225 seconds: 23, last successful checkin: 0 seconds ago

Panicked task 0xffffff8698d555d8: 3 threads: pid 120: watchdogd
Backtrace (CPU 4), panicked thread: 0xffffff8b64232598, Frame : Return Address
0xffffffe3ff0c3520 : 0xffffff8001c253b1
0xffffffe3ff0c3570 : 0xffffff8001d8ac80
0xffffffe3ff0c35b0 : 0xffffff8001d7a34c
0xffffffe3ff0c3630 : 0xffffff8001bbe971
0xffffffe3ff0c3650 : 0xffffff8001c2569d
0xffffffe3ff0c3740 : 0xffffff8001c24d43
0xffffffe3ff0c37a0 : 0xffffff80023db15e
0xffffffe3ff0c3890 : 0xffffff80048ab89b
0xffffffe3ff0c38a0 : 0xffffff80048ab356
0xffffffe3ff0c38c0 : 0xffffff80048aa41d
0xffffffe3ff0c39f0 : 0xffffff8002350526
0xffffffe3ff0c3a20 : 0xffffff800235089d
0xffffffe3ff0c3b90 : 0xffffff8001d32bbf
0xffffffe3ff0c3cb0 : 0xffffff8001bfd7bc
0xffffffe3ff0c3d70 : 0xffffff8001c15da4
0xffffffe3ff0c3de0 : 0xffffff8001c1636f
0xffffffe3ff0c3ee0 : 0xffffff8001d5f1ab
0xffffffe3ff0c3fa0 : 0xffffff8001bbedd6
Kernel Extensions in backtrace:
com.apple.driver.watchdog(1.0)[8A8FE7EC-EA12-31BB-A485-BA21D40BF3B9]@0xffffff80048a9000->0xffffff80048abfff

Process name corresponding to current thread (0xffffff8b64232598): watchdogd

Mac OS version:
23E224

Kernel version:
Darwin Kernel Version 23.4.0: Fri Mar 15 00:11:05 PDT 2024; root:xnu-10063.101.17~1/RELEASE_X86_64
Kernel UUID: F1663C03-D822-3B5E-9D84-B324A759EC85
roots installed: 0
KernelCache slide: 0x0000000001800000
KernelCache base: 0xffffff8001a00000
Kernel slide: 0x00000000018e4000
Kernel text base: 0xffffff8001ae4000
__HIB text base: 0xffffff8001900000
System model name: MacBookPro16,1 (Mac-E1008331FDC96864)
System shutdown begun: NO
Hibernation exit count: 0

System uptime in nanoseconds: 225734682198
Last Sleep: absolute base_tsc base_nano
Uptime : 0x000000348ed5ea69
Sleep : 0x0000000000000000 0x0000000000000000 0x0000000000000000
Wake : 0x0000000000000000 0x00000015dc19be06 0x0000000000000000
Compressor Info: 2% of compressed pages limit (OK) and 2% of segments limit (OK) with 1 swapfiles and OK swap space
Zone info:
Zone map: 0xffffff8030408000 - 0xffffffa030408000
. PGZ : 0xffffff8030408000 - 0xffffff8032409000
. VM : 0xffffff8032409000 - 0xffffff84fec08000
. RO : 0xffffff84fec08000 - 0xffffff8698408000
. GEN0 : 0xffffff8698408000 - 0xffffff8b64c08000
. GEN1 : 0xffffff8b64c08000 - 0xffffff9031408000
. GEN2 : 0xffffff9031408000 - 0xffffff94fdc08000
. GEN3 : 0xffffff94fdc08000 - 0xffffff99ca408000
. DATA : 0xffffff99ca408000 - 0xffffffa030408000
Metadata: 0xffffffaa8ce45000 - 0xffffffaaace45000
Bitmaps : 0xffffffaaace45000 - 0xffffffaaafe45000
Extra : 0 - 0

last started kext at 17347595806: >!AActuatorDriver 7440.9 (addr 0xffffff8002c6e000, size 32768)
loaded kexts:

!ATopCaseHIDEventDriver 7440.8
!AHIDALSService 1
!APlatformEnabler 2.7.0d0
AGPM 135
X86PlatformShim 1.0.0
@filesystems.autofs 3.0
@kext.AMDRadeonX6000 5.0.5
!AGFXHDA 340.1
!AUpstreamUserClient 3.6.11
@kext.AMDRadeonServiceManager 5.0.5
!ABridgeAudio!C 440.1
!A!IKBLGraphics 22.0.5
!AGraphicsDevicePolicy 8.1.9
!AMuxControl2 8.1.9
@AGDCPluginDisplayMetrics 8.1.9
AGDCBacklightControl 8.1.9
pmtelemetry 1
@filesystems.nfs 1
|IOUserEthernet 1.0.1
usb.!UUserHCI 1
!AUIO 1
!ASunrise 1
!AHV 1
!AFIVRDriver 4.1.0
!ABacklight 180.9
!A!IPCHPMC 2.0.1
!A!ISlowAdaptiveClocking 4.0.0
!AMCCSControl 1.17
@UVCService 1
ACPI_SMC_PlatformPlugin 1.0.0
BridgeAudioCommunication 440.1
!AAVEBridge 6.1
!AThunderboltIP 4.0.3
!A!ICFLGraphicsFramebuffer 22.0.5
BCMWLANFirmware4388.Hashstore 1
BCMWLANFirmware4387.Hashstore 1
BCMWLANFirmware4378.Hashstore 1
BCMWLANFirmware4377.Hashstore 1
BCMWLANFirmware4364.Hashstore 1
BCMWLANFirmware4355.Hashstore 1
!AFileSystemDriver 3.0.1
@filesystems.tmpfs 1
@filesystems.lifs 1
@filesystems.hfs.kext 650.0.2
@BootCache 40
@!AFSCompression.!AFSCompressionTypeZlib 1.0.0
@!AFSCompression.!AFSCompressionTypeDataless 1.0.0d1
@filesystems.apfs 2236.101.1
!ABCMWLANBusInterfacePCIeMac 1
@private.KextAudit 1.0
!ASmartBatteryManager 161.0.0
!AACPIButtons 6.1
!ASMBIOS 2.1
!AACPIEC 6.1
!AAPIC 1.7
@!ASystemPolicy 2.0.0
@nke.applicationfirewall 404
|IOKitRegistryCompatibility 1
|EndpointSecurity 1
@Dont_Steal_Mac_OS_X 7.0.0
!ADiskImages2 276.100.16
@kec.!AEncryptedArchive 1
!AActuatorDriver 7440.9
!AHIDKeyboard 7440.3
!AMultitouchDriver 7440.9
!AInputDeviceSupport 7440.1
!AHS!BDriver 7440.8
IO!BHIDDriver 9.0.0
@kext.AMDRadeonX6100HWLibs 1.0
!UAudio 640.12
!AAudioClockLibs 340.8
@kext.AMDRadeonX6000HWServices 5.0.5
!AHDA!C 540.3
|IOHDA!F 540.3
|IOAudio!F 540.3
@vecLib.kext 1.2.0
!ASMBusPCI 1.0.14d1
!A!ILpssUARTv1 3.0.60
!A!ILpssUARTCommon 3.0.60
!AOnboardSerial 1.0
!AGraphicsControl 8.1.9
@kext.AMDRadeonX6000Framebuffer 5.0.5
@kext.AMDSupport 5.0.5
@kext.triggers 1.0
IOHIDPowerSource 1
!ACallbackPowerSource 1
|IOAVB!F 1220.1
!ARSMChannel 1
|IORSM!F 1
!AIPAppender 1.0
!ABacklightExpert 1.1.0
|IONDRVSupport 598
@plugin.IOgPTPPlugin 1240.15
@!AGPUWrangler 8.1.9
|IOSlowAdaptiveClocking!F 1.0.0
!ASMBus!C 1.0.18d1
IOPlatformPluginLegacy 1.0.0
X86PlatformPlugin 1.0.0
IOPlatformPlugin!F 6.0.0d8
driverkit.serial 6.0.0
!AThunderboltEDMSink 5.0.3
!AThunderboltDPOutAdapter 8.5.1
|IOAccelerator!F2 481.40.2
@!AGraphicsDeviceControl 8.1.9
|IOGraphics!F 598
usb.IOUSBHostHIDDevice 1.2
usb.cdc.ecm 5.0.0
usb.cdc.ncm 5.0.0
usb.cdc 5.0.0
usb.networking 5.0.0
usb.!UHostCompositeDevice 1.2
!AThunderboltDPInAdapter 8.5.1
!AThunderboltDPAdapter!F 8.5.1
!AThunderboltPCIDownAdapter 4.1.1
!AHPM 3.4.4
!A!ILpssI2C!C 3.0.60
!A!ILpssI2C 3.0.60
!A!ILpssDmac 3.0.60
!ABSDKextStarter 3
|IOSurface 352.41.7
@filesystems.hfs.encodings.kext 1
!ASyntheticGame!C 11.4.11
!AXsanScheme 3
!AThunderboltNHI 7.2.81
|IOThunderbolt!F 9.3.3
usb.!UVHCIBCE 1.2
usb.!UVHCICommonBCE 1.0
usb.!UVHCI 1.2
usb.!UVHCICommon 1.0
!AEffaceableNOR 1.0
|IONVMe!F 2.1.0
|IOBufferCopy!C 1.1.0
|IOBufferCopyEngine!F 1
!ABCMWLANCoreMac 1.0.0
|IO80211!F 1200.13.0
IOImageLoader 1.0.0
!AOLYHALMac 1
|IOSerial!F 11
corecapture 1.0.4
usb.!UHostPacketFilter 1.0
|IOUSB!F 900.4.2
usb.!UXHCIPCI 1.2
usb.!UXHCI 1.2
!AEFINVRAM 2.1
!AEFIRuntime 2.1
!ASMCRTC 1.0
|IOSMBus!F 1.1
|IOHID!F 2.0.0
|IOTimeSync!F 1240.15
|IOSkywalk!F 1.0
mDNSOffloadUserClient 1.0.1b8
|IONetworking!F 3.4
DiskImages 493.0.0
|IO!B!F 9.0.0
|IOReport!F 47
$quarantine 4
$sandbox 300.0
@kext.!AMatch 1.0.0d1
!ASSE 1.0
!ALockdownMode 1
!AKeyStore 2
!UTDM 556
|IOUSBMass!SDriver 245
|IOUSBHost!F 1.2
!UHostMergeProperties 1.2
usb.!UCommon 1.0
!ABusPower!C 1.0
|IOSCSIBlockCommandsDevice 495
|IOSCSIArchitectureModel!F 495
!AFDEKeyStore 28.30
!AEffaceable!S 1.0
|IO!S!F 2.1
!ACyrus 1
!AMobileFileIntegrity 1.0.5
$!AImage4 6.3.0
@kext.CoreTrust 1
!ACredentialManager 1.0
|CoreAnalytics!F 1
!ASEPManager 1.0.1
IOSlaveProcessor 1
!AACPIPlatform 6.1
!ASMC 3.1.9
|IOPCI!F 2.9
|IOACPI!F 1.4
watchdog 1
@kec.pthread 1
@kec.XrtHostedXnu 1
@kec.Libm 1
@kec.Compression 1.0
@kec.corecrypto 14.0

`

@mlsmaycon
Copy link
Collaborator

Hello Folks,

Thanks for reporting the issue. We are attempting to reproduce it, but so far, we have had no success.

If possible, it would be great to have a troubleshooting session with one of you to go over some steps to help us understand the issue better and to confirm that there is no alternative we can apply for default routes.

If anyone is available, please join our Slack workspace and reach out, you can search for mlsmaycon and you will find me.

@greatbody
Copy link

Love to help, but how can I be helpful? Usually the system crash because of a panic after start Netbird with Exit Node enabled.

@mlsmaycon
Copy link
Collaborator

mlsmaycon commented May 10, 2024

Hello Folks, I've done a call with @greatbody and notice that the issue doesn't happen with a VPN client that adds a route using IP. so I've generated a build with the same. If you want to help us validate it, you can follow the steps below:

This assumes you installed using our pkg installer:

Stop the service:

sudo netbird service stop

Download the package from https://github.com/netbirdio/netbird/actions/runs/9032428624/artifacts/1491144082

Then extract and copy the one for your CPU arch, arm64 for M1-3 chips, or amd64 for intel.

Copy it to: /Applications/NetBird.app/Contents/MacOS/netbird

Start the service:

sudo netbird service start

After a few seconds run netstate -rn -f inet to collect the routes added by netbird. Share these with us.

@mlsmaycon
Copy link
Collaborator

@greatbody
Copy link

This is the new testing build: https://github.com/netbirdio/netbird/actions/runs/9060597722/artifacts/1496522187

Let me try.

@mlsmaycon
Copy link
Collaborator

@greatbody I've updated the branch with a DNS fix, this is the new build: https://github.com/netbirdio/netbird/actions/runs/9068136301/artifacts/1498352095

@asvataa
Copy link
Author

asvataa commented May 15, 2024

@mlsmaycon
Hi, we have tested the latest build that you uploaded and the pc reboots the same way
Here is an output of this command netstate -rn -f inet

Routing tables

Internet:
Destination        Gateway            Flags               Netif Expire
0/1                100.87.145.78      UGScg             utun100       
default            192.168.68.1       UGScg                 en0       
{removed}       192.168.68.1       UGHS                  en0       
10.20/16           utun100            USc               utun100       
10.30/16           utun100            USc               utun100       
100.87/16          utun100            USc               utun100       
100.87.152.54      100.87.152.55      UH                utun100       
127                127.0.0.1          UCS                   lo0       
127.0.0.1          127.0.0.1          UH                    lo0       
128.0/1            100.87.145.78      UGSc              utun100       
169.254            link#6             UCS                   en0      !
169.254.169.254    link#6             UHRLSW                en0      !
192.168.68         link#6             UCS                   en0      !
192.168.68.1/32    link#6             UCS                   en0      !
192.168.68.1       60:a4:b7:bd:71:0   UHLWIir               en0   1199
192.168.68.103/32  link#6             UCS                   en0      !
192.168.68.109     cc:8:fa:5c:aa:ad   UHLWI                 en0    816
192.168.68.119     86:f5:3f:59:d6:c1  UHLWI                 en0   1141
192.168.68.128     aa:5f:4f:44:c3:3e  UHLWIi                en0   1101
192.168.68.130     e:20:f9:4b:a7:81   UHLWI                 en0   1180
192.168.68.131     8a:e1:13:e0:a7:95  UHLWI                 en0    644
224.0.0/4          link#6             UmCS                  en0      !
224.0.0.251        1:0:5e:0:0:fb      UHmLWI                en0       
239.192.152.143    1:0:5e:40:98:8f    UHmLWI                en0       
239.255.255.250    1:0:5e:7f:ff:fa    UHmLWI                en0       
255.255.255.255/32 link#6             UCS                   en0      !

@mlsmaycon
Copy link
Collaborator

@asvataa After working with @greatbody on some tests, we found the same case. But the last test we wanted to do to confirm if the issue is related to NetBird or Wireguard is to validate plain Wireguard using wg-quick, especially after we checked that the issue doesn't happen with OpenVPN with Tunnelblick.

As it seems random with macOS, we have been unable to reproduce it that's why we are asking for help to test it out as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

7 participants