SGSN Crash Report

Hello, I just updated my machine with the latest OpenBSC code from git. In the past under heavy data load (EDGE), the BTS would crash. Now, after updating the code, the BTS stays up, but the SGSN crashes. Below are a few details about my setup and debugging output. BTS: NanoBTS 165BU 1900 PC: Atom Z530 1GB ram, Running Debian (Wheezy) Output from gdb: <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=52 <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xc3123cCMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xac6064CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xdc7cc7CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x18af79CMD=UI DATA <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x84caf1CMD=UI DATA <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xf1f6b6CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xd9e63bCMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xbadc11CMD=UI DATA <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=64 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=197 <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xb7e07cCMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x987e00CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xf386aaCMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x38700eCMD=UI DATA <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x62743eCMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x1cba00CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x6e4346CMD=UI DATA <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xb20578CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x49f5d0CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x760e46CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xc839b5CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xacd5a3CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xdaf317CMD=UI DATA <0011> gprs_bssgp.c:747 BSSGP BVCI=3 Rx Flow Control BVC <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x7d7a91CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x1eef1aCMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xd83b65CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0xf6a775CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x855a58CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x18aa6fCMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x167b76CMD=UI DATA <0011> gprs_bssgp.c:376 BSSGP TLLI=0xce3dde6f Rx UPLINK-UNITDATA <0012> gprs_llc.c:502 LLC SAPI=3 C FCS=0x55d812CMD=UI DATA <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 <000f> sgsn_libgtp.c:425 GTP DATA IND from GGSN, length=1500 Program received signal SIGFPE, Arithmetic exception. fc_queue_timer_cfg (fc=fc@entry=0x808def0) at gprs_bssgp.c:596 596 msecs = (fcqe->llc_pdu_len * 1000) / fc->bucket_leak_rate; (gdb) OpenBSC Console Output: Fri Jun 21 16:36:19 2013 <0005> abis_nm.c:315 OC=BASEBAND-TRANSCEIVER(04) INST=(00,00,ff) Failure Event Report Type=quality of service failure Severity=warning level failure Probable cause= 03 05 01 Additional Text=UDP overflow alarm on port 23000 (1 occurences) Fri Jun 21 16:36:20 2013 <0005> abis_nm.c:315 OC=BASEBAND-TRANSCEIVER(04) INST=(00,00,ff) Failure Event Report Type=quality of service failure Severity=warning level failure Probable cause= 03 05 01 Additional Text=UDP overflow alarm on port 23000 (1 occurences) Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:315 OC=GPRS-NSVC(f2) INST=(00,00,ff) STATE CHG: OP_STATE=Disabled AVAIL=Failed(01) Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:315 OC=GPRS-NSE(f0) INST=(00,ff,ff) STATE CHG: OP_STATE=Disabled AVAIL=Dependency(05) Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:1757 OC=GPRS-NSE(f0) INST=(00,ff,ff) Sending OPSTART Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:315 OC=GPRS-CELL(f1) INST=(00,00,ff) STATE CHG: OP_STATE=Disabled AVAIL=Dependency(05) Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:1757 OC=GPRS-CELL(f1) INST=(00,00,ff) Sending OPSTART Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:315 OC=GPRS-NSE(f0) INST=(00,ff,ff) STATE CHG: OP_STATE=Disabled AVAIL=Dependency(05) Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:315 OC=GPRS-CELL(f1) INST=(00,00,ff) STATE CHG: OP_STATE=Disabled AVAIL=Dependency(05) Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:2418 OC=GPRS-NSE(f0) INST=(00,ff,ff) IPACCESS(0xf6): SET ATTR ACK Fri Jun 21 16:38:00 2013 <0005> abis_nm.c:2418 OC=GPRS-CELL(f1) INST=(00,00,ff) IPACCESS(0xf6): SET ATTR ACK Fri Jun 21 16:38:42 2013 <0005> abis_nm.c:315 OC=GPRS-NSVC(f2) INST=(00,00,ff) Failure Event Report Type=communication failure Severity=critical failure Probable cause= 03 03 11 Additional Text= Let me know if you need any further information. Regards, Caleb