See
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/display/redirect?page=changes>
Changes:
[Oliver Smith] ttcn3-bts-test: add env var to not run all configs
[Oliver Smith] ttcn3-ggsn-test/jenkins: add functions for start ggsn/testsuite
[Oliver Smith] ttcn3-ggsn-test: move confgs to subdirs
[Oliver Smith] ttcn3-ggsn-test: run with multiple configurations
------------------------------------------
[...truncated 414.07 KB...]
MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_pdp6_clients_interact fail'.
Mon Mar 25 12:25:35 UTC 2024
[1;31m------ GGSN_Tests.TC_pdp6_clients_interact fail ------[0m
Saving talloc report from 172.18.159.200:4260 to
GGSN_Tests.TC_pdp6_clients_interact.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1284)
Waiting for packet dumper to finish... 1 (prev_count=1284, count=1348)
MTC@eb7879d523c7: External command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_pdp6_clients_interact fail' was executed successfully (exit status: 0).
MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp'.
------ GGSN_Tests.TC_echo_req_resp ------
Mon Mar 25 12:25:42 UTC 2024
NOTE: unable to use dumpcap due to missing capabilities or suid bit
Waiting for packet dumper to start... 0
MTC@eb7879d523c7: External command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp' was executed successfully (exit status: 0).
MTC@eb7879d523c7: Test case TC_echo_req_resp started.
MTC@eb7879d523c7: GTP1C ConnectionID: 1
MTC@eb7879d523c7: setverdict(fail): none -> fail reason: ""VTY Timeout for
prompt: enable"", new component reason: ""VTY Timeout for prompt:
enable""
MTC@eb7879d523c7: Setting final verdict of the test case.
MTC@eb7879d523c7: Local verdict of MTC: fail reason: ""VTY Timeout for prompt:
enable""
MTC@eb7879d523c7: No PTCs were created.
MTC@eb7879d523c7: Test case TC_echo_req_resp finished. Verdict: fail reason: "VTY
Timeout for prompt: enable"
MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp fail'.
Mon Mar 25 12:25:48 UTC 2024
[1;31m------ GGSN_Tests.TC_echo_req_resp fail ------[0m
Saving talloc report from 172.18.159.200:4260 to GGSN_Tests.TC_echo_req_resp.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1100)
Waiting for packet dumper to finish... 1 (prev_count=1100, count=1164)
MTC@eb7879d523c7: External command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_echo_req_resp
fail' was executed successfully (exit status: 0).
MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp_gtpu'.
------ GGSN_Tests.TC_echo_req_resp_gtpu ------
Mon Mar 25 12:25:55 UTC 2024
NOTE: unable to use dumpcap due to missing capabilities or suid bit
Waiting for packet dumper to start... 0
MTC@eb7879d523c7: External command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp_gtpu' was executed successfully (exit status: 0).
MTC@eb7879d523c7: Test case TC_echo_req_resp_gtpu started.
MTC@eb7879d523c7: GTP1C ConnectionID: 1
MTC@eb7879d523c7: setverdict(fail): none -> fail reason: ""VTY Timeout for
prompt: enable"", new component reason: ""VTY Timeout for prompt:
enable""
MTC@eb7879d523c7: Setting final verdict of the test case.
MTC@eb7879d523c7: Local verdict of MTC: fail reason: ""VTY Timeout for prompt:
enable""
MTC@eb7879d523c7: No PTCs were created.
MTC@eb7879d523c7: Test case TC_echo_req_resp_gtpu finished. Verdict: fail reason:
"VTY Timeout for prompt: enable"
MTC@eb7879d523c7: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp_gtpu fail'.
Mon Mar 25 12:26:01 UTC 2024
[1;31m------ GGSN_Tests.TC_echo_req_resp_gtpu fail ------[0m
Saving talloc report from 172.18.159.200:4260 to GGSN_Tests.TC_echo_req_resp_gtpu.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1036)
Waiting for packet dumper to finish... 1 (prev_count=1036, count=1100)
MTC@eb7879d523c7: External command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp_gtpu fail' was executed successfully (exit status: 0).
MC@eb7879d523c7: Test execution finished.
Execution of [EXECUTE] section finished.
emtc
MC@eb7879d523c7: Terminating MTC.
MC@eb7879d523c7: MTC terminated.
MC2> exit
MC@eb7879d523c7: Shutting down session.
MC@eb7879d523c7: Shutdown complete.
Comparing expected results '/osmo-ttcn3-hacks/ggsn_tests/expected-results.xml'
against results in 'junit-xml-21.log'
--------------------
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_pcodns
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_icmp6
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_clients_interact
[1;31mpass->FAIL[0;m GGSN_Tests.TC_echo_req_resp
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_echo_req_resp_gtpu
Summary:
[1;31mpass->FAIL[0;m: 6
[1;31mNEW: FAIL[0;m: 4
[1;34mskip[0;m: 20
+ exit_code=0
+ /osmo-ttcn3-hacks/log_merge.sh GGSN_Tests --rm
Generated GGSN_Tests.TC_echo_req_resp.merged
Generated GGSN_Tests.TC_echo_req_resp_gtpu.merged
Generated GGSN_Tests.TC_pdp6_act_deact.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr.merged
Generated GGSN_Tests.TC_pdp6_act_deact_icmp6.merged
Generated GGSN_Tests.TC_pdp6_act_deact_pcodns.merged
Generated GGSN_Tests.TC_pdp6_clients_interact.merged
Removing Input log files !!!
+ exit 0
+ docker_kill_wait jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn
+ docker kill jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn
Error response from daemon: Cannot kill container:
jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn: No such container:
jenkins-ttcn3-ggsn-test-kernel-latest-1138-ggsn
+ clean_up_common
+ set +e
+ set +x
### Clean up ###
+ trap - EXIT INT TERM 0
+ type clean_up
+ clean_up
+ local i
+ local log
+ [ all = all ]
+ continue
+ [ v4_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log>
]
+ sed -i s/classname='\([^']\+\)'/classname='\1_v4_only'/g
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log>
+ [ v6_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
]
+ sed -i s/classname='\([^']\+\)'/classname='\1_v6_only'/g
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
+ [ v4v6_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4v6_only/junit-xml-*.log>
]
+ continue
+ network_clean
+ docker network inspect ttcn3-ggsn-test-159
+ grep Name
+ cut -d : -f2
+ awk -F" NR>1{print $2}
+ local containers=
+ [ -n ]
+ network_remove
+ set +x
Removing network ttcn3-ggsn-test-159
+ docker network remove ttcn3-ggsn-test-159
ttcn3-ggsn-test-159
+ rm -rf
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/unix>
+ fix_perms
+ set +x
Fixing permissions
+ docker run --rm -v
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/ws/logs>:/data
-v
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/ws/_cache>:/cache
--name jenkins-ttcn3-ggsn-test-kernel-latest-1138-cleaner debian:bookworm chmod -R a+rX
/data/ /cache/
+ collect_logs
+ cat
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log>
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest/1138/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
<?xml version="1.0"?>
<testsuite name='GGSN_Tests' tests='20' failures='3'
errors='0' skipped='0' inconc='0' time='257.00'>
<testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact'
time='2.099326'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_ipcp' time='2.032887'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_ipcp_pap_broken' time='2.019731'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_pcodns' time='2.020817'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access' time='2.025193'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access_wrong_saddr' time='5.021738'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access_ipv6_apn4' time='5.027318'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_clients_interact_with_txseq' time='5.027623'>
<failure type='fail-verdict'>
GGSN_Tests.ttcn:2229 GGSN_Tests control part
GGSN_Tests.ttcn:1353 TC_pdp4_clients_interact_with_txseq testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_clients_interact_without_txseq' time='5.029024'>
<failure type='fail-verdict'>
GGSN_Tests.ttcn:2230 GGSN_Tests control part
GGSN_Tests.ttcn:1360 TC_pdp4_clients_interact_without_txseq testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_with_single_dns' time='2.024419'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_with_separate_dns' time='2.019826'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_update_teic' time='2.021655'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_update_teid' time='2.025862'>
<failure type='fail-verdict'>Received wrong local TEID
GGSN_Tests.ttcn:2234 GGSN_Tests control part
GGSN_Tests.ttcn:1513 TC_pdp4_act_update_teid testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp'
time='2.015846'/>
<testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp_gtpu'
time='2.015362'/>
<testcase classname='GGSN_Tests_v4_only' name='TC_pdp_act2_recovery'
time='2.027093'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_act_deact_retrans_duplicate' time='3.026056'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp_act_restart_ctr_echo' time='12.026722'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_lots_of_concurrent_pdp_ctx' time='23.325508'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_addr_pool_exhaustion' time='13.550627'/>
</testsuite>
<?xml version="1.0"?>
<testsuite name='GGSN_Tests' tests='10' failures='10'
errors='0' skipped='0' inconc='0' time='129.00'>
<testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact'
time='5.071720'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2238 GGSN_Tests control part
GGSN_Tests.ttcn:1006 TC_pdp6_act_deact testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_pcodns' time='5.058090'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2239 GGSN_Tests control part
GGSN_Tests.ttcn:1016 TC_pdp6_act_deact_pcodns testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_icmp6' time='5.078489'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2240 GGSN_Tests control part
GGSN_Tests.ttcn:1040 TC_pdp6_act_deact_icmp6 testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access' time='5.057790'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2241 GGSN_Tests control part
GGSN_Tests.ttcn:1059 TC_pdp6_act_deact_gtpu_access testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr' time='5.062285'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2242 GGSN_Tests control part
GGSN_Tests.ttcn:1090 TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_wrong_global_saddr'
time='5.062854'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2243 GGSN_Tests control part
GGSN_Tests.ttcn:1110 TC_pdp6_act_deact_gtpu_access_wrong_global_saddr testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_ipv4_apn6' time='5.063249'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2244 GGSN_Tests control part
GGSN_Tests.ttcn:1131 TC_pdp6_act_deact_gtpu_access_ipv4_apn6 testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_clients_interact' time='5.069836'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2245 GGSN_Tests control part
GGSN_Tests.ttcn:1151 TC_pdp6_clients_interact testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp'
time='5.067103'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2265 GGSN_Tests control part
GGSN_Tests.ttcn:1364 TC_echo_req_resp testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp_gtpu'
time='5.057039'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2266 GGSN_Tests control part
GGSN_Tests.ttcn:1377 TC_echo_req_resp_gtpu testcase
</failure>
</testcase>
</testsuite>
Build step 'Execute shell' marked build as failure
Recording test results
[Checks API] No suitable checks publisher found.
Show replies by date