We continue to release updates to the ASL3 project. With all new packages, we start off sharing the updates with our developers. Then, the packages are moved to the “beta” package channel for those who want to test fixes to their problems or get the “latest and greatest” as quickly as possible. When we believe that the changes are OK for all we push them out to the production channel.
Before opting to install the "beta" (or "devel") packages we ask that you carefully read Beta Testing about the caveats and potential pitfalls of beta packages.
The following ASL3 packages are now available from the "beta" channel. The changes include:
asl3-asterisk 22.10.1+asl3-3.10.6-1
app_rpt
app_rpt: Prevent echolink and tlb retry loop without call PR #1171
app_rpt: Stop permanent links from reconnecting after ilink 11 PR #1217
These packages will be available for the next 1-2 weeks. If we do not hear of any issues or problems with the updates we will promote them to the production/main channel.
Again, please see Beta Testing for information on how to use package software and the caveats and warnings about beta test software.
Happening on both. Main hub node, which has been having this occur every other day, is on an x86_64 machine, but I have had it also occur since the update, on Pi5 nodes.
It's not specific to this beta release. This has been going on for awhile and we're trying to nail it. Unfortunately it's been very very difficult to track down the root cause.
on the x86_64 hub machine I found the best solution is to change the kernel to the rt kernel, that should take care of the problem there. If you could test that and report back on the hub would be very appreciated.
Installing a real-time (RT) kernel on Debian—specifically using the PREEMPT_RT patch—gives your system deterministic response times, which is essential for low-latency tasks like audio processing, robotics, and industrial automation.
Only install the Linux "RT scheduler" kernels if you're on real hardware. It won't help on virtual machines / VPSs and will, in fact, make other things worse. Also, this doesn't "fix" the problem, it's just masking one of the symptoms.
If possible, setting the debug level on app_rpt to 4 or higher, may help us figure out what is going on around one of these crashes. It seems to be some "non normal" path that is hiding from us....
Somewhat recently, ASL3 was installed on X64 hardware for a local repeater. I unfortunately don't have access to the machine or it's logs, but anecdotally, I can say that it tends to stop accepting connections around the time a few echolink users connect, and requires Asterisk to be restarted.
I know that isn't much to go on, as I have (not recently) seen the exceptionally long queue messages on systems not connected to echolink. I'm going to try and get access to that system soon, so I can look at it's debug logs when this happens, which seems to be every couple of days.