Test suite failures for GNU Guix packaging

[vivien-builds-sofia-sip]

Dear Sofia-sip developers,

In order to get GNOME Calls, Guix packages sofia-sip. I sent an initial message to the sofia-sip-devel mailing list, but I later realized it should be posted here instead. The build and tests run in an isolated container where access to the outside network is disabled, so maybe this is a problem for sofia-sip.

We have a few test failures. check_nta and check_nua fail after many of the libcheck tests timeout (even with a large multiplier).

run_test_nta sometimes fail:
run_test_nta.log

su_source_test and torture_su_glib_timer (in libsofia-sip-ua-glib/su-glib) seems to block forever, until I kill it. I get no log output.

In tests, test_nua fails:
test_nua.log

check_sofia also has lots of libcheck unit tests that timeout.

Finally, I would like to report that libsofia-sip-ua/nta/Makefile.am sets

TESTS_ENVIRONMENT = $(SHELL)

According to the Automake manual, this is wrong on 2 counts:

https://www.gnu.org/software/automake/manual/automake.html#Testsuite-Environment-Overrides
https://www.gnu.org/software/automake/manual/automake.html#Parallel-Test-Harness

1. You should use AM_TESTS_ENVIRONMENT;
2. If non-empty, it should end with a semicolon.

Maybe you want to use:

LOG_COMPILER = $(SHELL)

However, I’m not sure this is required at all.

For Guix, we disable these tests. For the libcheck-backed tests,
maybe you could disable the most expensive tests by default?

Best regards,

Vivien