ASL 3 / system locks up RPI 4B/3B

1

Some yet unknown reason ASL 3 on my Raspberry Pi 3B and 4B’s lock up the device.

Power supplies are CanaKit 3.5A Raspberry Pi 4 Power Supply (USB-C)
All connected to UPS’s at 2 different physical sites.

SSH will not respond, Web interface will not respond, repeater will not respond to RF, however Network ping responds without issue.

Can’t establish new connection via SSH or HTTP.
This seems to happen after 24 or so hours, give or take.
Sometimes the system feels very sluggish, as in when typing over SSH, it will take 10 or so seconds to respond, yet the load is minimal < 0.5. (this maybe something else, have only seen it sporadically. Repeater appears to work normally at that time.

Pi3B is older 1GB, so I moved to Pi 4B with 2GB of RAM, and 2 brand new Pi 4B boards.
Also using 3 new PNY 32GB Elite Class 10 U1 microSDHC Flash Memory Cards
(New Pi’s have 8GB of RAM) currently have a cron rebooting the new ones every 24 hours.

All Pi’s are connected via Ethernet. This was a fresh install, didn’t even add any significant software
none of what I added such as lynx or Piper TTS was in use at the time of the lockup.

Soundcard interfaces are all URI’s.
No other hardware is connected, no monitor/mouse/keyboard etc. Just power/ethernet/URI

I am not using the Beta (as far as I know) just the new RPI image
I have run apt-get update; apt-get upgrade -y and show fully up to date.

I have streamming audio to broadcastify on the old Pi4B, but this happened before that was setup
the stream stopped, the heartbeat LED on the URI was still flashing, and the red and green lights on the back of the Pi were on solid, did a hard restart/pulling power.

Feed was reported down about 17:10 local

Log shows this

6:47 PM
/usr/lib/udev/rules.d/60-dahdi.rules:23 Invalid value for OPTIONS key, ignoring: ‘event_timeout=180’
systemd-udevd2.
6:47 PM
pam_ssh_add: Failed adding some keys
cockpit-session
6:47 PM
cockpit-tls[3200]: memfd_create() called without MFD_EXEC or MFD_NOEXEC_SEAL set
kernel
6:45 PM
/usr/lib/udev/rules.d/60-dahdi.rules:23 Invalid value for OPTIONS key, ignoring: ‘event_timeout=180’
systemd-udevd
6:16 PM
warning: `pmdalinux’ uses wireless extensions which will stop working for Wi-Fi 7 hardware; use
l80211
kernel
6:16 PM
/usr/lib/udev/rules.d/60-dahdi.rules:23 Invalid value for OPTIONS key, ignoring: ‘event_timeout=180’
systemd-udevd
6:16 PM
event4: Process ‘/usr/sbin/th-cmd --socket /var/run/thd.socket --passfd --udev’ failed with exit code 1.
(udev-worker)
6:16 PM
event3: Process ‘/usr/sbin/th-cmd --socket /var/run/thd.socket --passfd --udev’ failed with exit code 1.
(udev-worker)
6:16 PM
event1: Process ‘/usr/sbin/th-cmd --socket /var/run/thd.socket --passfd --udev’ failed with exit code 1.
(udev-worker)
6:16 PM
event2: Process ‘/usr/sbin/th-cmd --socket /var/run/thd.socket --passfd --udev’ failed with exit code 1.
(udev-worker)
6:16 PM
/usr/lib/udev/rules.d/60-dahdi.rules:23 Invalid value for OPTIONS key, ignoring: ‘event_timeout=180’
systemd-udevd
4:17 PM
event0: Process ‘/usr/sbin/th-cmd --socket /var/run/thd.socket --passfd --udev’ failed with exit code 1.
(udev-worker)
4:17 PM
bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
kernel
4:17 PM
bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
kernel
4:17 PM
rpivid_hevc: module is from the staging directory, the quality is unknown, you have been warned.
kernel
4:17 PM
bcm2835_v4l2: module is from the staging directory, the quality is unknown, you have been warned.
kernel
4:17 PM
bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
kernel
4:17 PM
vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
kernel
4:17 PM
snd_bcm2835: module is from the staging directory, the quality is unknown, you have been warned.
kernel
4:17 PM
/usr/lib/udev/rules.d/60-dahdi.rules:23 Invalid value for OPTIONS key, ignoring: ‘event_timeout=180’
systemd-udevd
4:17 PM
dahdi: loading out-of-tree module taints kernel.
kernel
4:17 PM
pci_bus 0000:01: supply vpcie12v not found, using dummy regulator
kernel
4:17 PM
pci_bus 0000:01: supply vpcie3v3aux not found, using dummy regulator
kernel
4:17 PM
pci_bus 0000:01: supply vpcie3v3 not found, using dummy regulator
kernel

2

Does dmesg show any errors? Does this crash happen with the stock Pi image without you adding any other software?

3

I’m fairly sure it does, but I’ll load up another pi and see what it does without a URI/radio as I’m out of them, lol
I don’t think dmesg will show anything as it refreshes when I force the reboot, i’ll see if I can run it locally or not, if the stock install crashes, though I’m fairly sure it will.

As adding a web browser (text based lynx) and TTS that’s not even running shouldn’t be able to crash/freeze up the system.

4 
[    0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034]
[    0.000000] Linux version 6.6.31+rpt-rpi-v8 (serge@raspberrypi.com) (gcc-12 (Debian 12.2.0-14) 12.2.0, GNU ld (GNU Binutils for Debian) 2.40) #1 SMP PREEMPT Debian 1:6.6.31-1+rpt1 (2024-05-29)
[    0.000000] KASLR enabled
[    0.000000] random: crng init done
[    0.000000] Machine model: Raspberry Pi 3 Model B Rev 1.2
[    0.000000] efi: UEFI not found.
[    0.000000] Reserved memory: created CMA memory pool at 0x000000001e400000, size 256 MiB
[    0.000000] OF: reserved mem: initialized node linux,cma, compatible id shared-dma-pool
[    0.000000] OF: reserved mem: 0x000000001e400000..0x000000002e3fffff (262144 KiB) map reusable linux,cma
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000]   DMA32    empty
[    0.000000]   Normal   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x000000003b3fffff]
[    0.000000] On node 0, zone DMA: 19456 pages in unavailable ranges
[    0.000000] percpu: Embedded 30 pages/cpu s85672 r8192 d29016 u122880
[    0.000000] pcpu-alloc: s85672 r8192 d29016 u122880 alloc=30*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 
[    0.000000] Detected VIPT I-cache on CPU0
[    0.000000] CPU features: kernel page table isolation forced ON by KASLR
[    0.000000] CPU features: detected: Kernel page table isolation (KPTI)
[    0.000000] CPU features: detected: ARM erratum 843419
[    0.000000] CPU features: detected: ARM erratum 845719
[    0.000000] alternatives: applying boot alternatives
[    0.000000] Kernel command line: coherent_pool=1M 8250.nr_uarts=1 snd_bcm2835.enable_headphones=0 snd_bcm2835.enable_headphones=1 snd_bcm2835.enable_hdmi=1 snd_bcm2835.enable_hdmi=0  vc_mem.mem_base=0x3ec00000 vc_mem.mem_size=0x40000000  console=tty1 root=PARTUUID=f2159055-02 rootfstype=ext4 fsck.repair=yes rootwait
[    0.000000] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[    0.000000] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 238896
[    0.000000] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[    0.000000] Memory: 650236K/970752K available (13376K kernel code, 2210K rwdata, 4264K rodata, 4864K init, 1083K bss, 58372K reserved, 262144K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] ftrace: allocating 43180 entries in 169 pages
[    0.000000] ftrace: allocated 169 pages with 4 groups
[    0.000000] trace event string verifier disabled
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu: 	RCU event tracing is enabled.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=4.
[    0.000000] 	Trampoline variant of Tasks RCU enabled.
[    0.000000] 	Rude variant of Tasks RCU enabled.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] Root IRQ handler: bcm2836_arm_irqchip_handle_irq
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.000000] arch_timer: cp15 timer(s) running at 19.20MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0x46d987e47, max_idle_ns: 440795202767 ns
[    0.000001] sched_clock: 56 bits at 19MHz, resolution 52ns, wraps every 4398046511078ns
[    0.000425] Console: colour dummy device 80x25
[    0.000442] printk: console [tty1] enabled
[    0.001345] Calibrating delay loop (skipped), value calculated using timer frequency.. 38.40 BogoMIPS (lpj=76800)
[    0.001397] pid_max: default: 32768 minimum: 301
[    0.001521] LSM: initializing lsm=capability,integrity
[    0.001802] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.001859] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes, linear)
[    0.002984] cgroup: Disabling memory control group subsystem
[    0.005204] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1.
[    0.005361] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1.
[    0.005531] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1.
[    0.005869] rcu: Hierarchical SRCU implementation.
[    0.005895] rcu: 	Max phase no-delay instances is 1000.
[    0.008166] EFI services will not be available.
[    0.008628] smp: Bringing up secondary CPUs ...
[    0.009475] Detected VIPT I-cache on CPU1
[    0.009644] CPU1: Booted secondary processor 0x0000000001 [0x410fd034]
[    0.010568] Detected VIPT I-cache on CPU2
[    0.010685] CPU2: Booted secondary processor 0x0000000002 [0x410fd034]
[    0.011531] Detected VIPT I-cache on CPU3
[    0.011634] CPU3: Booted secondary processor 0x0000000003 [0x410fd034]
[    0.011759] smp: Brought up 1 node, 4 CPUs
[    0.011890] SMP: Total of 4 processors activated.
[    0.011915] CPU features: detected: 32-bit EL0 Support
[    0.011936] CPU features: detected: 32-bit EL1 Support
[    0.011961] CPU features: detected: CRC32 instructions
[    0.012331] CPU: All CPU(s) started at EL2
[    0.012373] alternatives: applying system-wide alternatives
[    0.015411] devtmpfs: initialized
[    0.028727] Enabled cp15_barrier support
[    0.028797] Enabled setend support
[    0.029090] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.029148] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.042243] pinctrl core: initialized pinctrl subsystem
[    0.043137] DMI not present or invalid.
[    0.043926] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.051039] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations
[    0.051446] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    0.052053] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    0.052218] audit: initializing netlink subsys (disabled)
[    0.052575] audit: type=2000 audit(0.052:1): state=initialized audit_enabled=0 res=1
[    0.053472] thermal_sys: Registered thermal governor 'step_wise'
[    0.053542] cpuidle: using governor menu
[    0.053878] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    0.054056] ASID allocator initialised with 32768 entries
[    0.055209] Serial: AMBA PL011 UART driver
[    0.061645] bcm2835-mbox 3f00b880.mailbox: mailbox enabled
[    0.072543] raspberrypi-firmware soc:firmware: Attached to firmware from 2024-05-24T15:31:28, variant start
[    0.076539] raspberrypi-firmware soc:firmware: Firmware hash is 4942b7633c0ff1af1ee95a51a33b56a9dae47529
[    0.084923] Modules: 2G module region forced by RANDOMIZE_MODULE_REGION_FULL
[    0.084965] Modules: 0 pages in range for non-PLT usage
[    0.084973] Modules: 517792 pages in range for PLT usage
[    0.090435] bcm2835-dma 3f007000.dma-controller: DMA legacy API manager, dmachans=0x1
[    0.092274] iommu: Default domain type: Translated
[    0.092306] iommu: DMA domain TLB invalidation policy: strict mode
[    0.092911] SCSI subsystem initialized
[    0.093208] usbcore: registered new interface driver usbfs
[    0.093279] usbcore: registered new interface driver hub
[    0.093366] usbcore: registered new device driver usb
[    0.093913] pps_core: LinuxPPS API ver. 1 registered
[    0.093940] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.093992] PTP clock support registered
[    0.096929] vgaarb: loaded
[    0.097574] clocksource: Switched to clocksource arch_sys_counter
[    1.720229] VFS: Disk quotas dquot_6.6.0
[    1.720334] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.720516] FS-Cache: Loaded
[    1.720831] CacheFiles: Loaded
[    1.731499] NET: Registered PF_INET protocol family
[    1.731833] IP idents hash table entries: 16384 (order: 5, 131072 bytes, linear)
[    1.733875] tcp_listen_portaddr_hash hash table entries: 512 (order: 1, 8192 bytes, linear)
[    1.733947] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    1.733995] TCP established hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    1.734212] TCP bind hash table entries: 8192 (order: 6, 262144 bytes, linear)
[    1.734652] TCP: Hash tables configured (established 8192 bind 8192)
[    1.735101] MPTCP token hash table entries: 1024 (order: 2, 24576 bytes, linear)
[    1.735217] UDP hash table entries: 512 (order: 2, 16384 bytes, linear)
[    1.735297] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes, linear)
[    1.735568] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    1.736357] RPC: Registered named UNIX socket transport module.
[    1.736388] RPC: Registered udp transport module.
[    1.736409] RPC: Registered tcp transport module.
[    1.736431] RPC: Registered tcp-with-tls transport module.
[    1.736453] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.736503] PCI: CLS 0 bytes, default 64
[    1.737182] Trying to unpack rootfs image as initramfs...
[    1.737204] kvm [1]: IPA Size Limit: 40 bits
[    1.739067] kvm [1]: Hyp mode initialized successfully
[    1.743605] Initialise system trusted keyrings
[    1.744081] workingset: timestamp_bits=46 max_order=18 bucket_order=0
[    1.744188] zbud: loaded
[    1.745257] NFS: Registering the id_resolver key type
[    1.745334] Key type id_resolver registered
[    1.745357] Key type id_legacy registered
[    1.745410] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.745442] nfs4flexfilelayout_init: NFSv4 Flexfile Layout Driver Registering...
[    1.746626] Key type asymmetric registered
[    1.746678] Asymmetric key parser 'x509' registered
[    1.746778] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247)
[    1.747178] io scheduler mq-deadline registered
[    1.747209] io scheduler kyber registered
[    1.747267] io scheduler bfq registered
[    1.750439] pinctrl-bcm2835 3f200000.gpio: GPIO_OUT persistence: yes
[    1.754756] simple-framebuffer 3e402000.framebuffer: framebuffer at 0x3e402000, 0x7f8000 bytes
[    1.754839] simple-framebuffer 3e402000.framebuffer: format=a8r8g8b8, mode=1920x1080x32, linelength=7680
[    1.776642] Console: switching to colour frame buffer device 240x67
[    1.796460] simple-framebuffer 3e402000.framebuffer: fb0: simplefb registered!
[    1.801725] Serial: 8250/16550 driver, 1 ports, IRQ sharing enabled
[    1.805059] bcm2835-rng 3f104000.rng: hwrng registered
[    1.805978] vc-mem: phys_addr:0x00000000 mem_base=0x3ec00000 mem_size:0x40000000(1024 MiB)
[    1.826554] brd: module loaded
[    1.837789] loop: module loaded
[    1.838749] Loading iSCSI transport class v2.0-870.
[    1.845116] usbcore: registered new device driver r8152-cfgselector
[    1.845367] usbcore: registered new interface driver r8152
[    1.845528] usbcore: registered new interface driver lan78xx
[    1.845744] usbcore: registered new interface driver smsc95xx
[    1.846190] dwc_otg: version 3.00a 10-AUG-2012 (platform bus)
[    2.574970] Core Release: 2.80a
[    2.575149] Setting default values for core params
[    2.575274] Finished setting default values for core params
[    2.762951] Freeing initrd memory: 11860K
[    2.775840] Using Buffer DMA mode
[    2.775917] Periodic Transfer Interrupt Enhancement - disabled
[    2.776028] Multiprocessor Interrupt Enhancement - disabled
[    2.776135] OTG VER PARAM: 0, OTG VER FLAG: 0
[    2.776234] Dedicated Tx FIFOs mode

[    2.777921] WARN::dwc_otg_hcd_init:1072: FIQ DMA bounce buffers: virt = ffffffc080b9a000 dma = 0x00000000de800000 len=9024
[    2.778186] FIQ FSM acceleration enabled for :
               Non-periodic Split Transactions
               Periodic Split Transactions
               High-Speed Isochronous Endpoints
               Interrupt/Control Split Transaction hack enabled
[    2.778564] dwc_otg: Microframe scheduler enabled

[    2.778615] WARN::hcd_init_fiq:496: MPHI regs_base at ffffffc08006d000
[    2.778847] dwc_otg 3f980000.usb: DWC OTG Controller
[    2.778981] dwc_otg 3f980000.usb: new USB bus registered, assigned bus number 1
[    2.779154] dwc_otg 3f980000.usb: irq 74, io mem 0x00000000
[    2.779312] Init: Port Power? op_state=1
[    2.779392] Init: Power Port (0)
[    2.779745] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.06
[    2.779905] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.784733] usb usb1: Product: DWC OTG Controller
[    2.789430] usb usb1: Manufacturer: Linux 6.6.31+rpt-rpi-v8 dwc_otg_hcd
[    2.794203] usb usb1: SerialNumber: 3f980000.usb
[    2.799864] hub 1-0:1.0: USB hub found
[    2.804674] hub 1-0:1.0: 1 port detected
[    2.810075] dwc_otg: FIQ enabled
[    2.810085] dwc_otg: NAK holdoff enabled
[    2.810093] dwc_otg: FIQ split-transaction FSM enabled
[    2.810111] Module dwc_common_port init
[    2.811089] usbcore: registered new interface driver uas
[    2.815949] usbcore: registered new interface driver usb-storage
[    2.821489] mousedev: PS/2 mouse device common for all mice
[    2.829249] sdhci: Secure Digital Host Controller Interface driver
[    2.834073] sdhci: Copyright(c) Pierre Ossman
[    2.838972] sdhci-pltfm: SDHCI platform and OF driver helper
[    2.846110] ledtrig-cpu: registered to indicate activity on CPUs
[    2.851243] hid: raw HID events driver (C) Jiri Kosina
[    2.856167] usbcore: registered new interface driver usbhid
[    2.860863] usbhid: USB HID core driver
[    2.871770] hw perfevents: enabled with armv8_cortex_a53 PMU driver, 7 counters available
[    2.878097] NET: Registered PF_PACKET protocol family
[    2.883059] Key type dns_resolver registered
[    2.921760] Indeed it is in host mode hprt0 = 00021501
[    2.925548] registered taskstats version 1
[    2.932704] Loading compiled-in X.509 certificates
[    2.951900] Key type .fscrypt registered
[    2.956605] Key type fscrypt-provisioning registered
[    2.974096] bcm2835-wdt bcm2835-wdt: Broadcom BCM2835 watchdog timer
[    2.979315] bcm2835-power bcm2835-power: Broadcom BCM2835 power domains driver
[    2.985785] mmc-bcm2835 3f300000.mmcnr: mmc_debug:0 mmc_debug2:0
[    2.990401] mmc-bcm2835 3f300000.mmcnr: DMA channel allocated
[    3.019022] sdhost: log_buf @ 000000005e818ab9 (c57b3000)
[    3.074243] mmc0: sdhost-bcm2835 loaded - DMA enabled (>1)
[    3.079017] uart-pl011 3f201000.serial: there is not valid maps for state default
[    3.084023] uart-pl011 3f201000.serial: cts_event_workaround enabled
[    3.089110] 3f201000.serial: ttyAMA0 at MMIO 0x3f201000 (irq = 99, base_baud = 0) is a PL011 rev2
[    3.096597] of_cfs_init
[    3.101485] of_cfs_init: OK
[    3.106425] clk: Disabling unused clocks
[    3.113651] usb 1-1: new high-speed USB device number 2 using dwc_otg
[    3.118807] Indeed it is in host mode hprt0 = 00001101
[    3.126791] mmc0: host does not support reading read-only switch, assuming write-enable
[    3.127039] Freeing unused kernel memory: 4864K
[    3.136573] mmc0: Host Software Queue enabled
[    3.136613] Run /init as init process
[    3.141307] mmc0: new high speed SDHC card at address 5048
[    3.145935]   with arguments:
[    3.145940]     /init
[    3.150675]   with environment:
[    3.150681]     HOME=/
[    3.150688]     TERM=linux
[    3.152551] mmcblk0: mmc0:5048 SD32G 28.8 GiB
[    3.162588]  mmcblk0: p1 p2
[    3.168780] mmcblk0: mmc0:5048 SD32G 28.8 GiB
[    3.222386] mmc1: new high speed SDIO card at address 0001
[    3.338202] usb 1-1: New USB device found, idVendor=0424, idProduct=9514, bcdDevice= 2.00
[    3.338229] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    3.339131] hub 1-1:1.0: USB hub found
[    3.339278] hub 1-1:1.0: 5 ports detected
[    3.633652] usb 1-1.1: new high-speed USB device number 3 using dwc_otg
[    3.742170] usb 1-1.1: New USB device found, idVendor=0424, idProduct=ec00, bcdDevice= 2.00
[    3.749624] usb 1-1.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    3.761037] smsc95xx v2.0.0
[    3.891573] SMSC LAN8700 usb-001:003:01: attached PHY driver (mii_bus:phy_addr=usb-001:003:01, irq=184)
[    3.903279] smsc95xx 1-1.1:1.0 eth0: register 'smsc95xx' at usb-3f980000.usb-1.1, smsc95xx USB 2.0 Ethernet, b8:27:eb:7a:bf:88
[    3.989978] usb 1-1.4: new low-speed USB device number 4 using dwc_otg
[    4.271565] usb 1-1.4: New USB device found, idVendor=03f0, idProduct=034a, bcdDevice= 1.21
[    4.276896] usb 1-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.282415] usb 1-1.4: Product: HP Elite USB Keyboard
[    4.288021] usb 1-1.4: Manufacturer: Chicony
[    4.364936] input: Chicony HP Elite USB Keyboard as /devices/platform/soc/3f980000.usb/usb1/1-1/1-1.4/1-1.4:1.0/0003:03F0:034A.0001/input/input0
[    4.393581] raid6: neonx8   gen()  1095 MB/s
[    4.430674] hid-generic 0003:03F0:034A.0001: input,hidraw0: USB HID v1.10 Keyboard [Chicony HP Elite USB Keyboard] on usb-3f980000.usb-1.4/input0
[    4.465654] raid6: neonx4   gen()  1076 MB/s
[    4.490425] input: Chicony HP Elite USB Keyboard System Control as /devices/platform/soc/3f980000.usb/usb1/1-1/1-1.4/1-1.4:1.1/0003:03F0:034A.0002/input/input1
[    4.537577] raid6: neonx2   gen()  1032 MB/s
[    4.554273] input: Chicony HP Elite USB Keyboard Consumer Control as /devices/platform/soc/3f980000.usb/usb1/1-1/1-1.4/1-1.4:1.1/0003:03F0:034A.0002/input/input2
[    4.560979] hid-generic 0003:03F0:034A.0002: input,hidraw1: USB HID v1.10 Device [Chicony HP Elite USB Keyboard] on usb-3f980000.usb-1.4/input1
[    4.609611] raid6: neonx1   gen()   877 MB/s
[    4.681635] raid6: int64x8  gen()   694 MB/s
[    4.753585] raid6: int64x4  gen()   764 MB/s
[    4.825592] raid6: int64x2  gen()   685 MB/s
[    4.897633] raid6: int64x1  gen()   506 MB/s
[    4.903666] raid6: using algorithm neonx8 gen() 1095 MB/s
[    4.977574] raid6: .... xor() 810 MB/s, rmw enabled
[    4.983508] raid6: using neon recovery algorithm
[    4.992225] xor: measuring software checksum speed
[    5.006343]    8regs           :  1241 MB/sec
[    5.020244]    32regs          :  1252 MB/sec
[    5.034874]    arm64_neon      :  1148 MB/sec
[    5.040672] xor: using function: 32regs (1252 MB/sec)
[    5.048008] async_tx: api initialized (async)
[    5.467711] EXT4-fs (mmcblk0p2): INFO: recovery required on readonly filesystem
[    5.473904] EXT4-fs (mmcblk0p2): write access will be enabled during recovery
[    6.355810] EXT4-fs (mmcblk0p2): recovery complete
[    6.363825] EXT4-fs (mmcblk0p2): mounted filesystem 56f80fa2-e005-4cca-86e6-19da1069914d ro with ordered data mode. Quota mode: none.
[    7.232287] systemd[1]: System time before build time, advancing clock.
[    7.495828] NET: Registered PF_INET6 protocol family
[    7.503926] Segment Routing with IPv6
[    7.510011] In-situ OAM (IOAM) with IPv6
[    7.614952] systemd[1]: systemd 252.26-1~deb12u2 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -BPF_FRAMEWORK -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    7.628035] systemd[1]: Detected architecture arm64.
[    7.674144] systemd[1]: Hostname set to <node29627>.
[    8.996957] systemd[1]: Queued start job for default target multi-user.target.
[    9.026445] systemd[1]: Created slice system-getty.slice - Slice /system/getty.
[    9.043292] systemd[1]: Created slice system-modprobe.slice - Slice /system/modprobe.
[    9.059712] systemd[1]: Created slice system-systemd\x2dfsck.slice - Slice /system/systemd-fsck.
[    9.075433] systemd[1]: Created slice user.slice - User and Session Slice.
[    9.090242] systemd[1]: Started systemd-ask-password-console.path - Dispatch Password Requests to Console Directory Watch.
[    9.105016] systemd[1]: Started systemd-ask-password-wall.path - Forward Password Requests to Wall Directory Watch.
[    9.120623] systemd[1]: Set up automount proc-sys-fs-binfmt_misc.automount - Arbitrary Executable File Formats File System Automount Point.
[    9.135361] systemd[1]: Expecting device dev-disk-by\x2dpartuuid-f2159055\x2d01.device - /dev/disk/by-partuuid/f2159055-01...
[    9.150084] systemd[1]: Reached target cryptsetup.target - Local Encrypted Volumes.
[    9.164580] systemd[1]: Reached target integritysetup.target - Local Integrity Protected Volumes.
[    9.179020] systemd[1]: Reached target paths.target - Path Units.
[    9.193028] systemd[1]: Reached target slices.target - Slice Units.
[    9.206645] systemd[1]: Reached target swap.target - Swaps.
[    9.220308] systemd[1]: Reached target veritysetup.target - Local Verity Protected Volumes.
[    9.235286] systemd[1]: Listening on systemd-fsckd.socket - fsck to fsckd communication Socket.
[    9.250198] systemd[1]: Listening on systemd-initctl.socket - initctl Compatibility Named Pipe.
[    9.266734] systemd[1]: Listening on systemd-journald-audit.socket - Journal Audit Socket.
[    9.282912] systemd[1]: Listening on systemd-journald-dev-log.socket - Journal Socket (/dev/log).
[    9.299623] systemd[1]: Listening on systemd-journald.socket - Journal Socket.
[    9.316581] systemd[1]: Listening on systemd-udevd-control.socket - udev Control Socket.
[    9.333133] systemd[1]: Listening on systemd-udevd-kernel.socket - udev Kernel Socket.
[    9.350082] systemd[1]: dev-hugepages.mount - Huge Pages File System was skipped because of an unmet condition check (ConditionPathExists=/sys/kernel/mm/hugepages).
[    9.382157] systemd[1]: Mounting dev-mqueue.mount - POSIX Message Queue File System...
[    9.405766] systemd[1]: Mounting sys-kernel-debug.mount - Kernel Debug File System...
[    9.428771] systemd[1]: Mounting sys-kernel-tracing.mount - Kernel Trace File System...
[    9.447111] systemd[1]: auth-rpcgss-module.service - Kernel Module supporting RPCSEC_GSS was skipped because of an unmet condition check (ConditionPathExists=/etc/krb5.keytab).
[    9.463874] systemd[1]: Starting fake-hwclock.service - Restore / save the current clock...
[    9.518714] systemd[1]: Starting keyboard-setup.service - Set the console keyboard layout...
[    9.544471] systemd[1]: Starting kmod-static-nodes.service - Create List of Static Device Nodes...
[    9.572970] systemd[1]: Starting modprobe@configfs.service - Load Kernel Module configfs...
[    9.600271] systemd[1]: Starting modprobe@dm_mod.service - Load Kernel Module dm_mod...
[    9.626497] systemd[1]: Starting modprobe@drm.service - Load Kernel Module drm...
[    9.654123] systemd[1]: Starting modprobe@efi_pstore.service - Load Kernel Module efi_pstore...
[    9.681950] systemd[1]: Starting modprobe@fuse.service - Load Kernel Module fuse...
[    9.698613] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com
[    9.738815] systemd[1]: Starting modprobe@loop.service - Load Kernel Module loop...
[    9.766399] systemd[1]: Starting systemd-fsck-root.service - File System Check on Root Device...
[    9.788120] fuse: init (API version 7.39)
[    9.818448] systemd[1]: Starting systemd-journald.service - Journal Service...
[    9.848920] systemd[1]: Starting systemd-modules-load.service - Load Kernel Modules...
[    9.903175] systemd[1]: Starting systemd-time-wait-sync.service - Wait Until Kernel Time Synchronized...
[    9.932819] systemd[1]: Starting systemd-udev-trigger.service - Coldplug All udev Devices...
[    9.975725] systemd[1]: Mounted dev-mqueue.mount - POSIX Message Queue File System.
[   10.008077] systemd[1]: Mounted sys-kernel-debug.mount - Kernel Debug File System.
[   10.026160] systemd[1]: Mounted sys-kernel-tracing.mount - Kernel Trace File System.
[   10.045397] systemd[1]: Finished fake-hwclock.service - Restore / save the current clock.
[   10.069515] systemd[1]: Finished kmod-static-nodes.service - Create List of Static Device Nodes.
[   10.090003] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[   10.102022] systemd[1]: Finished modprobe@configfs.service - Load Kernel Module configfs.
[   10.121841] systemd[1]: modprobe@dm_mod.service: Deactivated successfully.
[   10.138097] systemd[1]: Finished modprobe@dm_mod.service - Load Kernel Module dm_mod.
[   10.159012] systemd[1]: modprobe@drm.service: Deactivated successfully.
[   10.168699] systemd[1]: Finished modprobe@drm.service - Load Kernel Module drm.
[   10.188047] systemd[1]: Started systemd-journald.service - Journal Service.
[   10.297738] dahdi: loading out-of-tree module taints kernel.
[   10.318286] dahdi: Version: 3.3.0
[   10.332655] dahdi: Telephony Interface Registered on major 196
[   10.349965] dahdi_transcode: Loaded.
[   10.364970] dahdi: Warning: Span DAHDI_DUMMY/1 didn't specify a spantype. Please fix driver!
[   10.366584] dahdi_dummy: Trying to load High Resolution Timer
[   10.366607] dahdi_dummy: Initialized High Resolution Timer
[   10.366611] dahdi_dummy: Starting High Resolution Timer
[   10.366628] dahdi_dummy: High Resolution Timer started, good to go
[   10.564048] EXT4-fs (mmcblk0p2): re-mounted 56f80fa2-e005-4cca-86e6-19da1069914d r/w. Quota mode: none.
[   10.674908] systemd-journald[270]: Received client request to flush runtime journal.
[   12.659250] snd_bcm2835: module is from the staging directory, the quality is unknown, you have been warned.
[   12.684259] vc_sm_cma: module is from the staging directory, the quality is unknown, you have been warned.
[   12.686371] mc: Linux media interface: v0.10
[   12.688403] bcm2835_vc_sm_cma_probe: Videocore shared memory driver
[   12.688433] [vc_sm_connected_init]: start
[   12.701789] rpi-gpiomem 3f200000.gpiomem: window base 0x3f200000 size 0x00001000
[   12.703247] rpi-gpiomem 3f200000.gpiomem: initialised 1 regions as /dev/gpiomem
[   12.703448] [vc_sm_connected_init]: installed successfully
[   12.747638] bcm2835_audio bcm2835_audio: card created with 8 channels
[   12.853193] videodev: Linux video capture interface: v2.00
[   12.992232] bcm2835_mmal_vchiq: module is from the staging directory, the quality is unknown, you have been warned.
[   13.026198] bcm2835_v4l2: module is from the staging directory, the quality is unknown, you have been warned.
[   13.040379] bcm2835_isp: module is from the staging directory, the quality is unknown, you have been warned.
[   13.105132] bcm2835_codec: module is from the staging directory, the quality is unknown, you have been warned.
[   13.140316] bcm2835-isp bcm2835-isp: Device node output[0] registered as /dev/video13
[   13.156709] bcm2835-isp bcm2835-isp: Device node capture[0] registered as /dev/video14
[   13.179922] bcm2835-codec bcm2835-codec: Device registered as /dev/video10
[   13.180011] bcm2835-codec bcm2835-codec: Loaded V4L2 decode
[   13.191324] bcm2835-codec bcm2835-codec: Device registered as /dev/video11
[   13.191428] bcm2835-codec bcm2835-codec: Loaded V4L2 encode
[   13.194125] bcm2835-isp bcm2835-isp: Device node capture[1] registered as /dev/video15
[   13.201538] bcm2835-isp bcm2835-isp: Device node stats[2] registered as /dev/video16
[   13.201641] bcm2835-isp bcm2835-isp: Register output node 0 with media controller
[   13.201665] bcm2835-isp bcm2835-isp: Register capture node 1 with media controller
[   13.201681] bcm2835-isp bcm2835-isp: Register capture node 2 with media controller
[   13.201696] bcm2835-isp bcm2835-isp: Register capture node 3 with media controller
[   13.208049] bcm2835-codec bcm2835-codec: Device registered as /dev/video12
[   13.208119] bcm2835-codec bcm2835-codec: Loaded V4L2 isp
[   13.212742] bcm2835-codec bcm2835-codec: Device registered as /dev/video18
[   13.212821] bcm2835-codec bcm2835-codec: Loaded V4L2 image_fx
[   13.223205] bcm2835-codec bcm2835-codec: Device registered as /dev/video31
[   13.223282] bcm2835-codec bcm2835-codec: Loaded V4L2 encode_image
[   13.270454] bcm2835-isp bcm2835-isp: Device node output[0] registered as /dev/video20
[   13.282055] bcm2835-isp bcm2835-isp: Device node capture[0] registered as /dev/video21
[   13.283589] bcm2835-isp bcm2835-isp: Device node capture[1] registered as /dev/video22
[   13.286611] bcm2835-isp bcm2835-isp: Device node stats[2] registered as /dev/video23
[   13.286663] bcm2835-isp bcm2835-isp: Register output node 0 with media controller
[   13.286686] bcm2835-isp bcm2835-isp: Register capture node 1 with media controller
[   13.286704] bcm2835-isp bcm2835-isp: Register capture node 2 with media controller
[   13.286719] bcm2835-isp bcm2835-isp: Register capture node 3 with media controller
[   13.298842] bcm2835-isp bcm2835-isp: Loaded V4L2 bcm2835-isp
[   13.510993] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[   13.567611] Loaded X.509 cert 'benh@debian.org: 577e021cb980e0e820821ba7b54b4961b8b4fadf'
[   13.569329] Loaded X.509 cert 'romain.perier@gmail.com: 3abbc6ec146e09d1b6016ab9d6cf71dd233f0328'
[   13.572199] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[   13.578139] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'
[   13.950040] brcmfmac: F1 signature read @0x18000000=0x1541a9a6
[   13.964618] brcmfmac: brcmf_fw_alloc_request: using brcm/brcmfmac43430-sdio for chip BCM43430/1
[   13.966871] usbcore: registered new interface driver brcmfmac
[   14.066229] Console: switching to colour dummy device 80x25
[   14.073673] vc4-drm soc:gpu: bound 3f400000.hvs (ops vc4_hvs_ops [vc4])
[   14.108775] Registered IR keymap rc-cec
[   14.109099] rc rc0: vc4-hdmi as /devices/platform/soc/3f902000.hdmi/rc/rc0
[   14.109422] input: vc4-hdmi as /devices/platform/soc/3f902000.hdmi/rc/rc0/input3
[   14.134105] input: vc4-hdmi HDMI Jack as /devices/platform/soc/3f902000.hdmi/sound/card1/input4
[   14.144668] vc4-drm soc:gpu: bound 3f902000.hdmi (ops vc4_hdmi_ops [vc4])
[   14.145244] vc4-drm soc:gpu: bound 3f004000.txp (ops vc4_txp_ops [vc4])
[   14.145742] vc4-drm soc:gpu: bound 3f206000.pixelvalve (ops vc4_crtc_ops [vc4])
[   14.146288] vc4-drm soc:gpu: bound 3f207000.pixelvalve (ops vc4_crtc_ops [vc4])
[   14.146629] vc4-drm soc:gpu: bound 3f807000.pixelvalve (ops vc4_crtc_ops [vc4])
[   14.146884] vc4-drm soc:gpu: bound 3fc00000.v3d (ops vc4_v3d_ops [vc4])
[   14.186520] [drm] Initialized vc4 0.0.0 20140616 for soc:gpu on minor 0
[   14.243494] brcmfmac: brcmf_c_process_txcap_blob: no txcap_blob available (err=-2)
[   14.244513] brcmfmac: brcmf_c_preinit_dcmds: Firmware: BCM43430/1 wl0: Jul 19 2021 03:24:18 version 7.45.98 (TOB) (56df937 CY) FWID 01-8e14b897
[   14.360905] Console: switching to colour frame buffer device 240x67
[   14.410059] vc4-drm soc:gpu: [drm] fb0: vc4drmfb frame buffer device
[   14.828829] systemd-journald[270]: Data hash table of /run/log/journal/24a4fcffbf80ba7bdad51376668fd303/system.journal has a fill level at 75.0 (1552 of 2069 items, 1191936 file size, 768 bytes per hash table item), suggesting rotation.
[   14.828898] systemd-journald[270]: /run/log/journal/24a4fcffbf80ba7bdad51376668fd303/system.journal: Journal header limits reached or header out-of-date, rotating.
[   15.224615] Adding 1878012k swap on /var/swap.  Priority:-2 extents:19 across:14548988k SS
[   19.092535] smsc95xx 1-1.1:1.0 eth0: hardware isn't capable of remote wakeup
[   19.096546] smsc95xx 1-1.1:1.0 eth0: Link is Up - 100Mbps/Full - flow control off
[   19.163207] brcmfmac: brcmf_cfg80211_set_power_mgmt: power save disabled
[   23.109561] sched: RT throttling activated
[   33.210141] systemd[1003]: memfd_create() called without MFD_EXEC or MFD_NOEXEC_SEAL set
5

Fresh install, no added software, configured has hub node, so no added hardware, fully up to date, ran apt-get update; apt-get upgrade -y

64 bytes from 192.168.0.68: icmp_seq=3137 ttl=64 time=1.404 ms
64 bytes from 192.168.0.68: icmp_seq=3138 ttl=64 time=2.168 ms
64 bytes from 192.168.0.68: icmp_seq=3139 ttl=64 time=0.969 ms
64 bytes from 192.168.0.68: icmp_seq=3140 ttl=64 time=0.877 ms
64 bytes from 192.168.0.68: icmp_seq=3141 ttl=64 time=0.964 ms
64 bytes from 192.168.0.68: icmp_seq=3142 ttl=64 time=1.359 ms
64 bytes from 192.168.0.68: icmp_seq=3143 ttl=64 time=0.945 ms
64 bytes from 192.168.0.68: icmp_seq=3144 ttl=64 time=1.113 ms
64 bytes from 192.168.0.68: icmp_seq=3145 ttl=64 time=0.913 ms
64 bytes from 192.168.0.68: icmp_seq=3146 ttl=64 time=0.990 ms
64 bytes from 192.168.0.68: icmp_seq=3147 ttl=64 time=0.842 ms
64 bytes from 192.168.0.68: icmp_seq=3148 ttl=64 time=0.921 ms
64 bytes from 192.168.0.68: icmp_seq=3149 ttl=64 time=0.955 ms

— 192.168.0.68 ping statistics —
3150 packets transmitted, 3150 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.739/1.203/3.725/0.287 ms

Tried to log in locally, but only got far enough to enter the username, could not get a password prompt even after waiting about 30 mins.

IMG_5223
IMG_52231920×2560 628 KB

Had to pull power to get logged in, not sure what else I can share to figure out the issue here?
This has happened on multiple Pi’s, multiple SD cards, multiple power supplies.

Seems like something just isn’t very stable, i’m wondering why I’m the only one to have this issue?
The other Pi’s I still have rebooting once a day are good so far.

6

Sounds like a bad PI but perhaps not.
Perhaps try a change in the imaging software you use to write the SD.

And a second test would be to load a sd card with just a rasbian 12 and see what happens.

7

Wow, 4 bad Raspberry pi’s? 2 are brand new, and 2 are older a year or 3.
The older ones ran other distros for pi-star without fail/issue for a year or more.

I would be shocked if I had that many bad pi’s…

What would you suggest for software, I’m using the “Raspberry Pi Imager v 1.8.5”
I believe this is what’s recommended by Allstarlink?
I could try dd command, but i’m not sure how I would add the user account that way?
Since there is no default user apparently…

What about if I shutdown asterisk or allmon or the webserver etc?
Also found today the repeater got stuck keyed, thankful to timeout timers, but still…

8

This sounds like some sort of network issue, possibly a DNS problem? Taking 19 seconds for it to report its IP address like your screenshot shows above is not correct behavior. Is this wired or wireless? Are you setting any special IP configuration by hand? If so, are you using Cockpit to set it or something else. Whatever this is, it’s local to your environment.

9

I’m using this as my router/DHCP server
https://www.amazon.com/gp/product/B086967C9X/ref=ppx_yo_dt_b_search_asin_title?ie=UTF8&psc=1

I have 48 devices on the network, and the only ones that crash are running Allstar on a Pi.
All Pi’s are hardwired.

Only network setting I have is the hostname using the Raspberry pi imager.
I do have the IP address set to fixed IP, so that port forwards will work, and I don’t
have to keep chasing the IP.

I have another pi on the same network, using some wx software called weewx

pi@raspberrypi:~ $ uptime
18:17:07 up 283 days, 17:32, 1 user, load average: 1.00, 1.04, 1.07
pi@raspberrypi:~ $ uname -a
Linux raspberrypi 5.4.83-v7+ #1379 SMP Mon Dec 14 13:08:57 GMT 2020 armv7l GNU/Linux
pi@raspberrypi:~ $ cat /etc/os-release
PRETTY_NAME=“Raspbian GNU/Linux 10 (buster)”
NAME=“Raspbian GNU/Linux”
VERSION_ID=“10”
VERSION=“10 (buster)”
VERSION_CODENAME=buster

It hasn’t crashed in > 6 months, if it’s my network it should be crashing too.
Same network, same router, same type of config, assigning it an IP as well.

If this is my environment, why aren’t other devices/Pi’s crashing?

One node I shut down allstar. astdn.sh
2nd node I shut down allmon killall almmon3

See which one crashes if either.

10

Since you aren’t providing any logs or answering my questions I am not sure what you’re looking for here. There over 800 installs of ASL3 and what you’re describing isn’t happening to anyone else. There have been a few issues of crashes that were all bad hardware or bad power supplies. So it has to be something unique to your environment or something you’re setting that’s causing a unique problem.

11

How are you setting a fixed IP? And are you properly setting the DNS server? Is it set properly when you can login? Have you tried using DHCP with no customization?