See
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/display/redirect?page=changes>
Changes:
[Oliver Smith] ttcn3-bts-test: add env var to not run all configs
[Oliver Smith] ttcn3-ggsn-test/jenkins: add functions for start ggsn/testsuite
[Oliver Smith] ttcn3-ggsn-test: move confgs to subdirs
[Oliver Smith] ttcn3-ggsn-test: run with multiple configurations
------------------------------------------
[...truncated 429.42 KB...]
Saving talloc report from 172.18.57.200:4260 to
GGSN_Tests.TC_pdp6_clients_interact.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1036)
Waiting for packet dumper to finish... 1 (prev_count=1036, count=1100)
MTC@cba55b10ae35: External command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_pdp6_clients_interact fail' was executed successfully (exit status: 0).
MTC@cba55b10ae35: Starting external command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp'.
------ GGSN_Tests.TC_echo_req_resp ------
Mon Mar 25 12:27:11 UTC 2024
NOTE: unable to use dumpcap due to missing capabilities or suid bit
Waiting for packet dumper to start... 0
MTC@cba55b10ae35: External command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp' was executed successfully (exit status: 0).
MTC@cba55b10ae35: Test case TC_echo_req_resp started.
MTC@cba55b10ae35: GTP1C ConnectionID: 1
MTC@cba55b10ae35: setverdict(fail): none -> fail reason: ""VTY Timeout for
prompt: enable"", new component reason: ""VTY Timeout for prompt:
enable""
MTC@cba55b10ae35: Setting final verdict of the test case.
MTC@cba55b10ae35: Local verdict of MTC: fail reason: ""VTY Timeout for prompt:
enable""
MTC@cba55b10ae35: No PTCs were created.
MTC@cba55b10ae35: Test case TC_echo_req_resp finished. Verdict: fail reason: "VTY
Timeout for prompt: enable"
MTC@cba55b10ae35: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp fail'.
Mon Mar 25 12:27:17 UTC 2024
[1;31m------ GGSN_Tests.TC_echo_req_resp fail ------[0m
Saving talloc report from 172.18.57.200:4260 to GGSN_Tests.TC_echo_req_resp.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1192)
MTC@cba55b10ae35: External command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_echo_req_resp
fail' was executed successfully (exit status: 0).
MTC@cba55b10ae35: Starting external command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp_gtpu'.
------ GGSN_Tests.TC_echo_req_resp_gtpu ------
Mon Mar 25 12:27:23 UTC 2024
NOTE: unable to use dumpcap due to missing capabilities or suid bit
Waiting for packet dumper to start... 0
MTC@cba55b10ae35: External command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp_gtpu' was executed successfully (exit status: 0).
MTC@cba55b10ae35: Test case TC_echo_req_resp_gtpu started.
MTC@cba55b10ae35: GTP1C ConnectionID: 1
MTC@cba55b10ae35: setverdict(fail): none -> fail reason: ""VTY Timeout for
prompt: enable"", new component reason: ""VTY Timeout for prompt:
enable""
MTC@cba55b10ae35: Setting final verdict of the test case.
MTC@cba55b10ae35: Local verdict of MTC: fail reason: ""VTY Timeout for prompt:
enable""
MTC@cba55b10ae35: No PTCs were created.
MTC@cba55b10ae35: Test case TC_echo_req_resp_gtpu finished. Verdict: fail reason:
"VTY Timeout for prompt: enable"
MTC@cba55b10ae35: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp_gtpu fail'.
Mon Mar 25 12:27:29 UTC 2024
[1;31m------ GGSN_Tests.TC_echo_req_resp_gtpu fail ------[0m
Saving talloc report from 172.18.57.200:4260 to GGSN_Tests.TC_echo_req_resp_gtpu.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1284)
Waiting for packet dumper to finish... 1 (prev_count=1284, count=1348)
MTC@cba55b10ae35: External command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp_gtpu fail' was executed successfully (exit status: 0).
MC@cba55b10ae35: Test execution finished.
Execution of [EXECUTE] section finished.
emtc
MC@cba55b10ae35: Terminating MTC.
MC@cba55b10ae35: MTC terminated.
MC2> exit
MC@cba55b10ae35: Shutting down session.
MC@cba55b10ae35: Shutdown complete.
Comparing expected results '/osmo-ttcn3-hacks/ggsn_tests/expected-results.xml'
against results in 'junit-xml-21.log'
--------------------
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_pcodns
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_icmp6
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_clients_interact
[1;31mpass->FAIL[0;m GGSN_Tests.TC_echo_req_resp
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_echo_req_resp_gtpu
Summary:
[1;31mpass->FAIL[0;m: 6
[1;31mNEW: FAIL[0;m: 4
[1;34mskip[0;m: 20
+ exit_code=0
+ /osmo-ttcn3-hacks/log_merge.sh GGSN_Tests --rm
Generated GGSN_Tests.TC_echo_req_resp.merged
Generated GGSN_Tests.TC_echo_req_resp_gtpu.merged
Generated GGSN_Tests.TC_pdp6_act_deact.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr.merged
Generated GGSN_Tests.TC_pdp6_act_deact_icmp6.merged
Generated GGSN_Tests.TC_pdp6_act_deact_pcodns.merged
Generated GGSN_Tests.TC_pdp6_clients_interact.merged
Removing Input log files !!!
+ exit 0
+ docker_kill_wait jenkins-ttcn3-ggsn-test-kernel-latest-torvalds-1125-ggsn
+ docker kill jenkins-ttcn3-ggsn-test-kernel-latest-torvalds-1125-ggsn
Error response from daemon: Cannot kill container:
jenkins-ttcn3-ggsn-test-kernel-latest-torvalds-1125-ggsn: No such container:
jenkins-ttcn3-ggsn-test-kernel-latest-torvalds-1125-ggsn
+ clean_up_common
+ set +e
+ set +x
### Clean up ###
+ trap - EXIT INT TERM 0
+ type clean_up
+ clean_up
+ local i
+ local log
+ [ all = all ]
+ continue
+ [ v4_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log>
]
+ sed -i s/classname='\([^']\+\)'/classname='\1_v4_only'/g
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log>
+ [ v6_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
]
+ sed -i s/classname='\([^']\+\)'/classname='\1_v6_only'/g
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
+ [ v4v6_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/ggsn-tester-v4v6_only/junit-xml-*.log>
]
+ continue
+ network_clean
+ docker network inspect ttcn3-ggsn-test-57
+ grep Name
+ cut -d : -f2
+ awk -F" NR>1{print $2}
+ local containers=
+ [ -n ]
+ network_remove
+ set +x
Removing network ttcn3-ggsn-test-57
+ docker network remove ttcn3-ggsn-test-57
ttcn3-ggsn-test-57
+ rm -rf
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/unix>
+ fix_perms
+ set +x
Fixing permissions
+ docker run --rm -v
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/ws/logs>:/data
-v
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/ws/_cache>:/cache
--name jenkins-ttcn3-ggsn-test-kernel-latest-torvalds-1125-cleaner debian:bookworm chmod
-R a+rX /data/ /cache/
+ collect_logs
+ cat
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/ggsn-tester-v4_only/junit-xml-21.log>
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-torvalds/1125/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
<?xml version="1.0"?>
<testsuite name='GGSN_Tests' tests='20' failures='4'
errors='0' skipped='0' inconc='0' time='244.00'>
<testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact'
time='2.061872'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_ipcp' time='2.021383'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_ipcp_pap_broken' time='2.023984'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_pcodns' time='2.020476'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access' time='2.023693'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access_wrong_saddr' time='5.021396'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access_ipv6_apn4' time='5.020708'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_clients_interact_with_txseq' time='5.031465'>
<failure type='fail-verdict'>
GGSN_Tests.ttcn:2229 GGSN_Tests control part
GGSN_Tests.ttcn:1353 TC_pdp4_clients_interact_with_txseq testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_clients_interact_without_txseq' time='5.023219'>
<failure type='fail-verdict'>
GGSN_Tests.ttcn:2230 GGSN_Tests control part
GGSN_Tests.ttcn:1360 TC_pdp4_clients_interact_without_txseq testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_with_single_dns' time='2.027046'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_with_separate_dns' time='2.018552'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_update_teic' time='2.024088'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_update_teid' time='2.025920'>
<failure type='fail-verdict'>Received wrong local TEID
GGSN_Tests.ttcn:2234 GGSN_Tests control part
GGSN_Tests.ttcn:1513 TC_pdp4_act_update_teid testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp'
time='2.015645'/>
<testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp_gtpu'
time='2.015336'/>
<testcase classname='GGSN_Tests_v4_only' name='TC_pdp_act2_recovery'
time='2.024969'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_act_deact_retrans_duplicate' time='3.025466'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp_act_restart_ctr_echo' time='12.025025'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_lots_of_concurrent_pdp_ctx' time='23.281439'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_addr_pool_exhaustion' time='0.020977'>
<failure type='fail-verdict'>"GGSN_Tests.ttcn:2071 : Rx Unexpected
GTPC"
GGSN_Tests.ttcn:2278 GGSN_Tests control part
GGSN_Tests.ttcn:2071 TC_addr_pool_exhaustion testcase
</failure>
</testcase>
</testsuite>
<?xml version="1.0"?>
<testsuite name='GGSN_Tests' tests='10' failures='10'
errors='0' skipped='0' inconc='0' time='129.00'>
<testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact'
time='5.077855'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2238 GGSN_Tests control part
GGSN_Tests.ttcn:1006 TC_pdp6_act_deact testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_pcodns' time='5.062461'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2239 GGSN_Tests control part
GGSN_Tests.ttcn:1016 TC_pdp6_act_deact_pcodns testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_icmp6' time='5.070300'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2240 GGSN_Tests control part
GGSN_Tests.ttcn:1040 TC_pdp6_act_deact_icmp6 testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access' time='5.060439'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2241 GGSN_Tests control part
GGSN_Tests.ttcn:1059 TC_pdp6_act_deact_gtpu_access testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr' time='5.066795'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2242 GGSN_Tests control part
GGSN_Tests.ttcn:1090 TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_wrong_global_saddr'
time='5.066415'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2243 GGSN_Tests control part
GGSN_Tests.ttcn:1110 TC_pdp6_act_deact_gtpu_access_wrong_global_saddr testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_ipv4_apn6' time='5.059529'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2244 GGSN_Tests control part
GGSN_Tests.ttcn:1131 TC_pdp6_act_deact_gtpu_access_ipv4_apn6 testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_clients_interact' time='5.059647'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2245 GGSN_Tests control part
GGSN_Tests.ttcn:1151 TC_pdp6_clients_interact testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp'
time='5.059604'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2265 GGSN_Tests control part
GGSN_Tests.ttcn:1364 TC_echo_req_resp testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp_gtpu'
time='5.071470'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2266 GGSN_Tests control part
GGSN_Tests.ttcn:1377 TC_echo_req_resp_gtpu testcase
</failure>
</testcase>
</testsuite>
Build step 'Execute shell' marked build as failure
Recording test results
[Checks API] No suitable checks publisher found.
Show replies by date