See https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/display/redirect?page=changes

Changes:

[Oliver Smith] ttcn3-bts-test: add env var to not run all configs

[Oliver Smith] ttcn3-ggsn-test/jenkins: add functions for start ggsn/testsuite

[Oliver Smith] ttcn3-ggsn-test: move confgs to subdirs

[Oliver Smith] ttcn3-ggsn-test: run with multiple configurations

------------------------------------------ [...truncated 414.07 KB...] MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_pdp6_clients_interact fail'. Mon Mar 25 12:25:35 UTC 2024 ------ GGSN_Tests.TC_pdp6_clients_interact fail ------

Saving talloc report from 172.18.159.200:4260 to GGSN_Tests.TC_pdp6_clients_interact.talloc

ERROR: failed to get talloc report via vty

Waiting for packet dumper to finish... 0 (prev_count=-1, count=1284) Waiting for packet dumper to finish... 1 (prev_count=1284, count=1348) MTC@eb7879d523c7: External command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_pdp6_clients_interact fail' was executed successfully (exit status: 0). MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-start.sh GGSN_Tests.TC_echo_req_resp'. ------ GGSN_Tests.TC_echo_req_resp ------ Mon Mar 25 12:25:42 UTC 2024 NOTE: unable to use dumpcap due to missing capabilities or suid bit Waiting for packet dumper to start... 0 MTC@eb7879d523c7: External command `../ttcn3-tcpdump-start.sh GGSN_Tests.TC_echo_req_resp' was executed successfully (exit status: 0). MTC@eb7879d523c7: Test case TC_echo_req_resp started. MTC@eb7879d523c7: GTP1C ConnectionID: 1 MTC@eb7879d523c7: setverdict(fail): none -> fail reason: ""VTY Timeout for prompt: enable"", new component reason: ""VTY Timeout for prompt: enable"" MTC@eb7879d523c7: Setting final verdict of the test case. MTC@eb7879d523c7: Local verdict of MTC: fail reason: ""VTY Timeout for prompt: enable"" MTC@eb7879d523c7: No PTCs were created. MTC@eb7879d523c7: Test case TC_echo_req_resp finished. Verdict: fail reason: "VTY Timeout for prompt: enable" MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_echo_req_resp fail'. Mon Mar 25 12:25:48 UTC 2024 ------ GGSN_Tests.TC_echo_req_resp fail ------

Saving talloc report from 172.18.159.200:4260 to GGSN_Tests.TC_echo_req_resp.talloc

ERROR: failed to get talloc report via vty

Waiting for packet dumper to finish... 0 (prev_count=-1, count=1100) Waiting for packet dumper to finish... 1 (prev_count=1100, count=1164) MTC@eb7879d523c7: External command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_echo_req_resp fail' was executed successfully (exit status: 0). MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-start.sh GGSN_Tests.TC_echo_req_resp_gtpu'. ------ GGSN_Tests.TC_echo_req_resp_gtpu ------ Mon Mar 25 12:25:55 UTC 2024 NOTE: unable to use dumpcap due to missing capabilities or suid bit Waiting for packet dumper to start... 0 MTC@eb7879d523c7: External command `../ttcn3-tcpdump-start.sh GGSN_Tests.TC_echo_req_resp_gtpu' was executed successfully (exit status: 0). MTC@eb7879d523c7: Test case TC_echo_req_resp_gtpu started. MTC@eb7879d523c7: GTP1C ConnectionID: 1 MTC@eb7879d523c7: setverdict(fail): none -> fail reason: ""VTY Timeout for prompt: enable"", new component reason: ""VTY Timeout for prompt: enable"" MTC@eb7879d523c7: Setting final verdict of the test case. MTC@eb7879d523c7: Local verdict of MTC: fail reason: ""VTY Timeout for prompt: enable"" MTC@eb7879d523c7: No PTCs were created. MTC@eb7879d523c7: Test case TC_echo_req_resp_gtpu finished. Verdict: fail reason: "VTY Timeout for prompt: enable" MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_echo_req_resp_gtpu fail'. Mon Mar 25 12:26:01 UTC 2024 ------ GGSN_Tests.TC_echo_req_resp_gtpu fail ------

Saving talloc report from 172.18.159.200:4260 to GGSN_Tests.TC_echo_req_resp_gtpu.talloc

ERROR: failed to get talloc report via vty

Waiting for packet dumper to finish... 0 (prev_count=-1, count=1036) Waiting for packet dumper to finish... 1 (prev_count=1036, count=1100) MTC@eb7879d523c7: External command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_echo_req_resp_gtpu fail' was executed successfully (exit status: 0). MC@eb7879d523c7: Test execution finished. Execution of [EXECUTE] section finished. emtc MC@eb7879d523c7: Terminating MTC. MC@eb7879d523c7: MTC terminated. MC2> exit MC@eb7879d523c7: Shutting down session. MC@eb7879d523c7: Shutdown complete.

Comparing expected results '/osmo-ttcn3-hacks/ggsn_tests/expected-results.xml' against results in 'junit-xml-21.log' -------------------- pass->FAIL GGSN_Tests.TC_pdp6_act_deact pass->FAIL GGSN_Tests.TC_pdp6_act_deact_pcodns pass->FAIL GGSN_Tests.TC_pdp6_act_deact_icmp6 pass->FAIL GGSN_Tests.TC_pdp6_act_deact_gtpu_access pass->FAIL GGSN_Tests.TC_pdp6_clients_interact pass->FAIL GGSN_Tests.TC_echo_req_resp NEW: FAIL GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr NEW: FAIL GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr NEW: FAIL GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6 NEW: FAIL GGSN_Tests.TC_echo_req_resp_gtpu

Summary: pass->FAIL: 6 NEW: FAIL: 4 skip: 20

+ exit_code=0 + /osmo-ttcn3-hacks/log_merge.sh GGSN_Tests --rm Generated GGSN_Tests.TC_echo_req_resp.merged Generated GGSN_Tests.TC_echo_req_resp_gtpu.merged Generated GGSN_Tests.TC_pdp6_act_deact.merged Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access.merged Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6.merged Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr.merged Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr.merged Generated GGSN_Tests.TC_pdp6_act_deact_icmp6.merged Generated GGSN_Tests.TC_pdp6_act_deact_pcodns.merged Generated GGSN_Tests.TC_pdp6_clients_interact.merged Removing Input log files !!! + exit 0 + docker_kill_wait jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn + docker kill jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn Error response from daemon: Cannot kill container: jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn: No such container: jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn + clean_up_common + set +e + set +x

### Clean up ###

+ trap - EXIT INT TERM 0 + type clean_up + clean_up + local i + local log + [ all = all ] + continue + [ v4_only = all ] + [ -e https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log ] + sed -i s/classname='([^']+)'/classname='\1_v4_only'/g https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log + [ v6_only = all ] + [ -e https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log ] + sed -i s/classname='([^']+)'/classname='\1_v6_only'/g https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log + [ v4v6_only = all ] + [ -e https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4v6_only/junit-xml-*.log ] + continue + network_clean + docker network inspect ttcn3-ggsn-test-159 + grep Name + cut -d : -f2 + awk -F" NR>1{print $2} + local containers= + [ -n ] + network_remove + set +x Removing network ttcn3-ggsn-test-159 + docker network remove ttcn3-ggsn-test-159 ttcn3-ggsn-test-159 + rm -rf https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/unix + fix_perms + set +x Fixing permissions + docker run --rm -v https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/ws/logs:/data -v https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/ws/_cache:/cache --name jenkins-ttcn3-ggsn-test-kernel-latest-1138-cleaner debian:bookworm chmod -R a+rX /data/ /cache/ + collect_logs + cat https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log <?xml version="1.0"?> <testsuite name='GGSN_Tests' tests='20' failures='3' errors='0' skipped='0' inconc='0' time='257.00'> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact' time='2.099326'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_ipcp' time='2.032887'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_ipcp_pap_broken' time='2.019731'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_pcodns' time='2.020817'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_gtpu_access' time='2.025193'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_gtpu_access_wrong_saddr' time='5.021738'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_gtpu_access_ipv6_apn4' time='5.027318'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_clients_interact_with_txseq' time='5.027623'> <failure type='fail-verdict'> GGSN_Tests.ttcn:2229 GGSN_Tests control part GGSN_Tests.ttcn:1353 TC_pdp4_clients_interact_with_txseq testcase </failure> </testcase> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_clients_interact_without_txseq' time='5.029024'> <failure type='fail-verdict'> GGSN_Tests.ttcn:2230 GGSN_Tests control part GGSN_Tests.ttcn:1360 TC_pdp4_clients_interact_without_txseq testcase </failure> </testcase> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_with_single_dns' time='2.024419'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact_with_separate_dns' time='2.019826'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_update_teic' time='2.021655'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_update_teid' time='2.025862'> <failure type='fail-verdict'>Received wrong local TEID GGSN_Tests.ttcn:2234 GGSN_Tests control part GGSN_Tests.ttcn:1513 TC_pdp4_act_update_teid testcase </failure> </testcase> <testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp' time='2.015846'/> <testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp_gtpu' time='2.015362'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp_act2_recovery' time='2.027093'/> <testcase classname='GGSN_Tests_v4_only' name='TC_act_deact_retrans_duplicate' time='3.026056'/> <testcase classname='GGSN_Tests_v4_only' name='TC_pdp_act_restart_ctr_echo' time='12.026722'/> <testcase classname='GGSN_Tests_v4_only' name='TC_lots_of_concurrent_pdp_ctx' time='23.325508'/> <testcase classname='GGSN_Tests_v4_only' name='TC_addr_pool_exhaustion' time='13.550627'/> </testsuite> <?xml version="1.0"?> <testsuite name='GGSN_Tests' tests='10' failures='10' errors='0' skipped='0' inconc='0' time='129.00'> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact' time='5.071720'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2238 GGSN_Tests control part GGSN_Tests.ttcn:1006 TC_pdp6_act_deact testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact_pcodns' time='5.058090'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2239 GGSN_Tests control part GGSN_Tests.ttcn:1016 TC_pdp6_act_deact_pcodns testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact_icmp6' time='5.078489'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2240 GGSN_Tests control part GGSN_Tests.ttcn:1040 TC_pdp6_act_deact_icmp6 testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact_gtpu_access' time='5.057790'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2241 GGSN_Tests control part GGSN_Tests.ttcn:1059 TC_pdp6_act_deact_gtpu_access testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr' time='5.062285'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2242 GGSN_Tests control part GGSN_Tests.ttcn:1090 TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact_gtpu_access_wrong_global_saddr' time='5.062854'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2243 GGSN_Tests control part GGSN_Tests.ttcn:1110 TC_pdp6_act_deact_gtpu_access_wrong_global_saddr testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact_gtpu_access_ipv4_apn6' time='5.063249'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2244 GGSN_Tests control part GGSN_Tests.ttcn:1131 TC_pdp6_act_deact_gtpu_access_ipv4_apn6 testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_clients_interact' time='5.069836'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2245 GGSN_Tests control part GGSN_Tests.ttcn:1151 TC_pdp6_clients_interact testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp' time='5.067103'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2265 GGSN_Tests control part GGSN_Tests.ttcn:1364 TC_echo_req_resp testcase </failure> </testcase> <testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp_gtpu' time='5.057039'> <failure type='fail-verdict'>"VTY Timeout for prompt: enable" GGSN_Tests.ttcn:2266 GGSN_Tests control part GGSN_Tests.ttcn:1377 TC_echo_req_resp_gtpu testcase </failure> </testcase> </testsuite> Build step 'Execute shell' marked build as failure Recording test results [Checks API] No suitable checks publisher found.