libosmocore and GNU autotest

This is merely a historical archive of years 2008-2021, before the migration to mailman3.

A maintained and still updated list archive can be found at https://lists.osmocom.org/hyperkitty/list/OpenBSC@lists.osmocom.org/.

Pablo Neira Ayuso pablo at gnumonks.org
Sun Nov 13 16:54:13 UTC 2011


On Sun, Nov 13, 2011 at 09:05:41AM +0100, Holger Hans Peter Freyther wrote:
> On 11/13/2011 02:25 AM, Pablo Neira Ayuso wrote:
> 
> > Interesting, never played with this autotest stuff so far.
> 
> I saw it in GNU Smalltalk. Somehow the testsuite.at is too verbose and we
> would deserve an osmo.m4 macro but then we are in trouble in regard to
> installing this one. :}

Not sure I understood the problem. We can store the custom xyz.m4 file
under the m4/ directory and distribute it with the tarball, if needed.

> > Patch attached for this.
> 
> thanks, picked into the branch.
> 
> > Can we tell the tool to compare stdout but to ignore stderr? If so, we
> > can display the repeatable output in stdout and the non-repeatable output
> > in stderr.
> 
> Good idea, I comitted a patch to do this, would be awesome if you play with
> sending things to stdout/stderr.

Thanks for applying the patch. I made one patch for this.

> > Yes, with lots of timers, the expiration may not be done in time on
> > a loaded machine. If we can ignore the stderr output, we can put the
> > information about timers not expiring in time to stderr.
> 
> Not expiring at all should probably be counted as test failure?

You mean not expiring in time? I think so. If we use very few timers
for the test (like it is the case for 5 steps), it seems to me very
unlikely that we'll fail to make it in time. Well, if you launch some
very CPU intensive tasks I might be wrong, but I don't think this will
be the case for people running make check. After all, if we start getting
reports of people that run the test that bogusly fail, we can relax the
checkings.

Mreover it's a good idea to set some maximum wait time for the test to
finish via signals. Check the second patch attached to this email, apply
it if you like it.

Btw, please, don't remove me from the Cc, I check the list often but
my mail client has a filter to put emails directed to me (To or Cc) in
one specific folder, so I can prioritize emails that require some
reply from me.


More information about the OpenBSC mailing list