See
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/display/redirect?page=changes>
Changes:
[Oliver Smith] ttcn3-bts-test: add env var to not run all configs
[Oliver Smith] ttcn3-ggsn-test/jenkins: add functions for start ggsn/testsuite
[Oliver Smith] ttcn3-ggsn-test: move confgs to subdirs
[Oliver Smith] ttcn3-ggsn-test: run with multiple configurations
------------------------------------------
[...truncated 429.31 KB...]
MTC@b3533cb04b3b: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_pdp6_clients_interact fail'.
Mon Mar 25 12:27:23 UTC 2024
[1;31m------ GGSN_Tests.TC_pdp6_clients_interact fail ------[0m
Saving talloc report from 172.18.91.200:4260 to
GGSN_Tests.TC_pdp6_clients_interact.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1036)
Waiting for packet dumper to finish... 1 (prev_count=1036, count=1100)
MTC@b3533cb04b3b: External command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_pdp6_clients_interact fail' was executed successfully (exit status: 0).
MTC@b3533cb04b3b: Starting external command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp'.
------ GGSN_Tests.TC_echo_req_resp ------
Mon Mar 25 12:27:30 UTC 2024
NOTE: unable to use dumpcap due to missing capabilities or suid bit
Waiting for packet dumper to start... 0
MTC@b3533cb04b3b: External command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp' was executed successfully (exit status: 0).
MTC@b3533cb04b3b: Test case TC_echo_req_resp started.
MTC@b3533cb04b3b: GTP1C ConnectionID: 1
MTC@b3533cb04b3b: setverdict(fail): none -> fail reason: ""VTY Timeout for
prompt: enable"", new component reason: ""VTY Timeout for prompt:
enable""
MTC@b3533cb04b3b: Setting final verdict of the test case.
MTC@b3533cb04b3b: Local verdict of MTC: fail reason: ""VTY Timeout for prompt:
enable""
MTC@b3533cb04b3b: No PTCs were created.
MTC@b3533cb04b3b: Test case TC_echo_req_resp finished. Verdict: fail reason: "VTY
Timeout for prompt: enable"
MTC@b3533cb04b3b: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp fail'.
Mon Mar 25 12:27:36 UTC 2024
[1;31m------ GGSN_Tests.TC_echo_req_resp fail ------[0m
Saving talloc report from 172.18.91.200:4260 to GGSN_Tests.TC_echo_req_resp.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1036)
Waiting for packet dumper to finish... 1 (prev_count=1036, count=1164)
MTC@b3533cb04b3b: External command `../ttcn3-tcpdump-stop.sh GGSN_Tests.TC_echo_req_resp
fail' was executed successfully (exit status: 0).
MTC@b3533cb04b3b: Starting external command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp_gtpu'.
------ GGSN_Tests.TC_echo_req_resp_gtpu ------
Mon Mar 25 12:27:43 UTC 2024
NOTE: unable to use dumpcap due to missing capabilities or suid bit
Waiting for packet dumper to start... 0
MTC@b3533cb04b3b: External command `../ttcn3-tcpdump-start.sh
GGSN_Tests.TC_echo_req_resp_gtpu' was executed successfully (exit status: 0).
MTC@b3533cb04b3b: Test case TC_echo_req_resp_gtpu started.
MTC@b3533cb04b3b: GTP1C ConnectionID: 1
MTC@b3533cb04b3b: setverdict(fail): none -> fail reason: ""VTY Timeout for
prompt: enable"", new component reason: ""VTY Timeout for prompt:
enable""
MTC@b3533cb04b3b: Setting final verdict of the test case.
MTC@b3533cb04b3b: Local verdict of MTC: fail reason: ""VTY Timeout for prompt:
enable""
MTC@b3533cb04b3b: No PTCs were created.
MTC@b3533cb04b3b: Test case TC_echo_req_resp_gtpu finished. Verdict: fail reason:
"VTY Timeout for prompt: enable"
MTC@b3533cb04b3b: Starting external command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp_gtpu fail'.
Mon Mar 25 12:27:49 UTC 2024
[1;31m------ GGSN_Tests.TC_echo_req_resp_gtpu fail ------[0m
Saving talloc report from 172.18.91.200:4260 to GGSN_Tests.TC_echo_req_resp_gtpu.talloc
ERROR: failed to get talloc report via vty
Waiting for packet dumper to finish... 0 (prev_count=-1, count=1036)
Waiting for packet dumper to finish... 1 (prev_count=1036, count=1100)
MTC@b3533cb04b3b: External command `../ttcn3-tcpdump-stop.sh
GGSN_Tests.TC_echo_req_resp_gtpu fail' was executed successfully (exit status: 0).
MC@b3533cb04b3b: Test execution finished.
Execution of [EXECUTE] section finished.
emtc
MC@b3533cb04b3b: Terminating MTC.
MC@b3533cb04b3b: MTC terminated.
MC2> exit
MC@b3533cb04b3b: Shutting down session.
MC@b3533cb04b3b: Shutdown complete.
Comparing expected results '/osmo-ttcn3-hacks/ggsn_tests/expected-results.xml'
against results in 'junit-xml-21.log'
--------------------
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_pcodns
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_icmp6
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access
[1;31mpass->FAIL[0;m GGSN_Tests.TC_pdp6_clients_interact
[1;31mpass->FAIL[0;m GGSN_Tests.TC_echo_req_resp
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6
[1;31mNEW: FAIL[0;m GGSN_Tests.TC_echo_req_resp_gtpu
Summary:
[1;31mpass->FAIL[0;m: 6
[1;31mNEW: FAIL[0;m: 4
[1;34mskip[0;m: 20
+ exit_code=0
+ /osmo-ttcn3-hacks/log_merge.sh GGSN_Tests --rm
Generated GGSN_Tests.TC_echo_req_resp.merged
Generated GGSN_Tests.TC_echo_req_resp_gtpu.merged
Generated GGSN_Tests.TC_pdp6_act_deact.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_ipv4_apn6.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_global_saddr.merged
Generated GGSN_Tests.TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr.merged
Generated GGSN_Tests.TC_pdp6_act_deact_icmp6.merged
Generated GGSN_Tests.TC_pdp6_act_deact_pcodns.merged
Generated GGSN_Tests.TC_pdp6_clients_interact.merged
Removing Input log files !!!
+ exit 0
+ docker_kill_wait jenkins-ttcn3-ggsn-test-kernel-latest-net-next-1130-ggsn
+ docker kill jenkins-ttcn3-ggsn-test-kernel-latest-net-next-1130-ggsn
Error response from daemon: Cannot kill container:
jenkins-ttcn3-ggsn-test-kernel-latest-net-next-1130-ggsn: No such container:
jenkins-ttcn3-ggsn-test-kernel-latest-net-next-1130-ggsn
+ clean_up_common
+ set +e
+ set +x
### Clean up ###
+ trap - EXIT INT TERM 0
+ type clean_up
+ clean_up
+ local i
+ local log
+ [ all = all ]
+ continue
+ [ v4_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/ggsn-tester-v4_only/junit-xml-22.log>
]
+ sed -i s/classname='\([^']\+\)'/classname='\1_v4_only'/g
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/ggsn-tester-v4_only/junit-xml-22.log>
+ [ v6_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
]
+ sed -i s/classname='\([^']\+\)'/classname='\1_v6_only'/g
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
+ [ v4v6_only = all ]
+ [ -e
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/ggsn-tester-v4v6_only/junit-xml-*.log>
]
+ continue
+ network_clean
+ docker network inspect ttcn3-ggsn-test-91
+ grep Name
+ cut -d : -f2
+ awk -F" NR>1{print $2}
+ local containers=
+ [ -n ]
+ network_remove
+ set +x
Removing network ttcn3-ggsn-test-91
+ docker network remove ttcn3-ggsn-test-91
ttcn3-ggsn-test-91
+ rm -rf
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/unix>
+ fix_perms
+ set +x
Fixing permissions
+ docker run --rm -v
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/ws/logs>:/data
-v
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/ws/_cache>:/cache
--name jenkins-ttcn3-ggsn-test-kernel-latest-net-next-1130-cleaner debian:bookworm chmod
-R a+rX /data/ /cache/
+ collect_logs
+ cat
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/ggsn-tester-v4_only/junit-xml-22.log>
<https://jenkins.osmocom.org/jenkins/job/ttcn3-ggsn-test-kernel-latest-net-next/1130/artifact/logs/ggsn-tester-v6_only/junit-xml-21.log>
<?xml version="1.0"?>
<testsuite name='GGSN_Tests' tests='20' failures='3'
errors='0' skipped='0' inconc='0' time='257.00'>
<testcase classname='GGSN_Tests_v4_only' name='TC_pdp4_act_deact'
time='2.069508'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_ipcp' time='2.022054'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_ipcp_pap_broken' time='2.023601'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_pcodns' time='2.021882'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access' time='2.026046'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access_wrong_saddr' time='5.023738'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_gtpu_access_ipv6_apn4' time='5.024150'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_clients_interact_with_txseq' time='5.029389'>
<failure type='fail-verdict'>
GGSN_Tests.ttcn:2229 GGSN_Tests control part
GGSN_Tests.ttcn:1353 TC_pdp4_clients_interact_with_txseq testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_clients_interact_without_txseq' time='5.028481'>
<failure type='fail-verdict'>
GGSN_Tests.ttcn:2230 GGSN_Tests control part
GGSN_Tests.ttcn:1360 TC_pdp4_clients_interact_without_txseq testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_with_single_dns' time='2.025570'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_deact_with_separate_dns' time='2.021479'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_update_teic' time='2.024245'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp4_act_update_teid' time='2.023728'>
<failure type='fail-verdict'>Received wrong local TEID
GGSN_Tests.ttcn:2234 GGSN_Tests control part
GGSN_Tests.ttcn:1513 TC_pdp4_act_update_teid testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp'
time='2.015770'/>
<testcase classname='GGSN_Tests_v4_only' name='TC_echo_req_resp_gtpu'
time='2.015977'/>
<testcase classname='GGSN_Tests_v4_only' name='TC_pdp_act2_recovery'
time='2.023297'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_act_deact_retrans_duplicate' time='3.030593'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_pdp_act_restart_ctr_echo' time='12.025225'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_lots_of_concurrent_pdp_ctx' time='23.295852'/>
<testcase classname='GGSN_Tests_v4_only'
name='TC_addr_pool_exhaustion' time='13.532458'/>
</testsuite>
<?xml version="1.0"?>
<testsuite name='GGSN_Tests' tests='10' failures='10'
errors='0' skipped='0' inconc='0' time='130.00'>
<testcase classname='GGSN_Tests_v6_only' name='TC_pdp6_act_deact'
time='5.071333'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2238 GGSN_Tests control part
GGSN_Tests.ttcn:1006 TC_pdp6_act_deact testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_pcodns' time='5.059496'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2239 GGSN_Tests control part
GGSN_Tests.ttcn:1016 TC_pdp6_act_deact_pcodns testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_icmp6' time='5.072648'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2240 GGSN_Tests control part
GGSN_Tests.ttcn:1040 TC_pdp6_act_deact_icmp6 testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access' time='5.063386'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2241 GGSN_Tests control part
GGSN_Tests.ttcn:1059 TC_pdp6_act_deact_gtpu_access testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr' time='5.062747'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2242 GGSN_Tests control part
GGSN_Tests.ttcn:1090 TC_pdp6_act_deact_gtpu_access_wrong_ll_saddr testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_wrong_global_saddr'
time='5.061475'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2243 GGSN_Tests control part
GGSN_Tests.ttcn:1110 TC_pdp6_act_deact_gtpu_access_wrong_global_saddr testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_act_deact_gtpu_access_ipv4_apn6' time='5.061067'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2244 GGSN_Tests control part
GGSN_Tests.ttcn:1131 TC_pdp6_act_deact_gtpu_access_ipv4_apn6 testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only'
name='TC_pdp6_clients_interact' time='5.059934'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2245 GGSN_Tests control part
GGSN_Tests.ttcn:1151 TC_pdp6_clients_interact testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp'
time='5.081178'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2265 GGSN_Tests control part
GGSN_Tests.ttcn:1364 TC_echo_req_resp testcase
</failure>
</testcase>
<testcase classname='GGSN_Tests_v6_only' name='TC_echo_req_resp_gtpu'
time='5.072408'>
<failure type='fail-verdict'>"VTY Timeout for prompt: enable"
GGSN_Tests.ttcn:2266 GGSN_Tests control part
GGSN_Tests.ttcn:1377 TC_echo_req_resp_gtpu testcase
</failure>
</testcase>
</testsuite>
Build step 'Execute shell' marked build as failure
Recording test results
[Checks API] No suitable checks publisher found.
Show replies by date