osmo-ttcn3-hacks[master]: add compare-results.sh, call from start-testsuite.sh

This is merely a historical archive of years 2008-2021, before the migration to mailman3.

A maintained and still updated list archive can be found at https://lists.osmocom.org/hyperkitty/list/gerrit-log@lists.osmocom.org/.

Neels Hofmeyr gerrit-no-reply at lists.osmocom.org
Thu Apr 5 16:31:19 UTC 2018


Patch Set 1:

I don't understand why you see a neat summary as a problem.
No current schemes of deciding on success or failure are affected.
This "just" prints a summary in the end, showing things like:

  pass   -- we expect it to pass, and it passed
  xfail  -- we know this fails and still does
  pass->FAIL -- i've broken another test with my patch
  xfail->pass  -- i've fixed a test

This doesn't hide anything, and so far the outcome of jenkins jobs isn't affected (if at all then it is failing more often now instead of hiding failures)

Furthermore it is highly valuable information while testing patches and ttcn files, which so far needs to be looked up manually.

Please try it out and revisit your remarks, I frankly think they don't hold.

-- 
To view, visit https://gerrit.osmocom.org/7646
To unsubscribe, visit https://gerrit.osmocom.org/settings

Gerrit-MessageType: comment
Gerrit-Change-Id: I87d62a8be73d73a5eeff61a842e7c27a0066079d
Gerrit-PatchSet: 1
Gerrit-Project: osmo-ttcn3-hacks
Gerrit-Branch: master
Gerrit-Owner: Neels Hofmeyr <nhofmeyr at sysmocom.de>
Gerrit-Reviewer: Harald Welte <laforge at gnumonks.org>
Gerrit-Reviewer: Jenkins Builder
Gerrit-Reviewer: Neels Hofmeyr <nhofmeyr at sysmocom.de>
Gerrit-HasComments: No



More information about the gerrit-log mailing list