Jump to content

weird hang

Mutiegenesis

By Mutiegenesis
in Troubleshooting

 Share

Recommended Posts

Mutiegenesis

Mutiegenesis

Posted
Posted

Got a bizzarre hang a moment ago, with the following dump in the logs.  Thoughts?

 

Of interesting note is the line reading:

 

failed to aquire /home/.../Server/PlayerCommunicator.cpp: 788, accessMutex after 1000000 tries

 

 

 

 

 

 

 

 

Sat Mar 18 03:39:49 2017| starting event alienattack
Sat Mar 18 03:39:56 2017| <> Jump route calculated.
Sat Mar 18 03:40:01 2017| <> *------------------------------------------------------------------------------------*
Sat Mar 18 03:42:43 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6322cf 2>&1
Sat Mar 18 03:42:43 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x63260a 2>&1
Sat Mar 18 03:42:44 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x69a934 2>&1
Sat Mar 18 03:42:44 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x62732e 2>&1
Sat Mar 18 03:42:44 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x627466 2>&1
Sat Mar 18 03:42:44 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6322cf 2>&1
Sat Mar 18 03:42:44 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x71e39b 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x63260a 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x7215d5 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x62753c 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad63dd 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x62775a 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad9394 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6b4d07 2>&1
Sat Mar 18 03:42:45 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad6b69 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6813c0 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad5a59 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x723d4b 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad6e91 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x7252bd 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xacd5e8 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad63dd 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x637ed1 2>&1
Sat Mar 18 03:42:46 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad9394 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x66f258 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad6b69 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x62c772 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad5a59 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6af6b7 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xad6e91 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6b3949 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0xacd5e8 2>&1
Sat Mar 18 03:42:47 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6b4166 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6b1bf8 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6a1e60 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6aefaa 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x69cd11 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x7f7cb4eb1ba0 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6b8cc3 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x7f7cb46d3dc5 2>&1
Sat Mar 18 03:42:48 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6b9c44 2>&1
Sat Mar 18 03:42:49 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x7f7cb44016ed 2>&1
Sat Mar 18 03:42:49 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x62dec2 2>&1
Sat Mar 18 03:42:49 2017| 140172960913152 failed to aquire /home/koonschi/buildbot/slave/steamrt-release/build/SpaceServer/Server/PlayerCommunicator.cpp: 788, accessMutex after 1000000 tries
Sat Mar 18 03:42:49 2017| backtrace() returned 25 addresses
Sat Mar 18 03:42:49 2017| [bt] #1 bin/AvorionServer(_ZN11MutexLockerISt15recursive_mutexLb0EE4lockEv+0xff) [0x6322cf]
Sat Mar 18 03:42:49 2017| [bt] #2 bin/AvorionServer(_ZN11MutexLockerISt15recursive_mutexLb0EEC2ERS0_RKSsS4_+0x6a) [0x63260a]
Sat Mar 18 03:42:49 2017| [bt] #3 bin/AvorionServer(_ZN18PlayerCommunicator11sendMessageERK7Messagei+0xb4) [0x69a934]
Sat Mar 18 03:42:49 2017| [bt] #4 bin/AvorionServer(_ZN6Server9broadcastERK7Messagei+0x13e) [0x62732e]
Sat Mar 18 03:42:49 2017| [bt] #5 bin/AvorionServer(_ZN6Server20broadcastChatMessageERK11ChatMessage+0x46) [0x627466]
Sat Mar 18 03:42:49 2017| [bt] #6 bin/AvorionServer(_ZN12ScriptServer20broadcastChatMessageERKSsiS1_OSt6vectorISsSaISsEE+0x5b) [0x71e39b]
Sat Mar 18 03:42:49 2017| [bt] #7 bin/AvorionServer(_ZN26ScriptServer_script_detail27member_broadcastChatMessageEP9lua_State+0x1e5) [0x7215d5]
Sat Mar 18 03:42:49 2017| [bt] #8 bin/AvorionServer() [0xad63dd]
Sat Mar 18 03:42:49 2017| [bt] #9 bin/AvorionServer() [0xad9394]
Sat Mar 18 03:42:49 2017| [bt] #10 bin/AvorionServer() [0xad6b69]
Sat Mar 18 03:42:49 2017| [bt] #11 bin/AvorionServer() [0xad5a59]
Sat Mar 18 03:42:49 2017| [bt] #12 bin/AvorionServer() [0xad6e91]
Sat Mar 18 03:42:49 2017| [bt] #13 bin/AvorionServer(lua_pcallk+0x58) [0xacd5e8]
Sat Mar 18 03:42:49 2017| [bt] #14 bin/AvorionServer(_ZN6Script6doCallISt6vectorI8LuaValueSaIS2_EEEET_RKSsj+0xf1) [0x637ed1]
Sat Mar 18 03:42:49 2017| [bt] #15 bin/AvorionServer(_ZN15ScriptedCommand7executeEP18PlayerCommunicatorP6ServeriPPKcRSoS7_+0x458) [0x66f258]
Sat Mar 18 03:42:49 2017| [bt] #16 bin/AvorionServer(_ZN6Server14executeCommandEP18PlayerCommunicatorRK11ChatMessage+0x732) [0x62c772]
Sat Mar 18 03:42:49 2017| [bt] #17 bin/AvorionServer(_ZN19InputCommandHandler11handleInputERKN5boost6system10error_codeEm+0x6e7) [0x6af6b7]
Sat Mar 18 03:42:49 2017| [bt] #18 bin/AvorionServer(_ZN5boost4asio6detail19read_until_delim_opINS0_5posix23basic_stream_descriptorINS3_25stream_descriptor_serviceEEESaIcENS_3_bi6bind_tIvNS_4_mfi3mf2Iv19InputCommandHandlerRKNS_6system10error_codeEmEENS8_5list3INS8_5valueIPSC_EEPFNS_3argILi1EEEvEPFNSM_ILi2EEEvEEEEEEclESG_mi+0xb9) [0x6b3949]
Sat Mar 18 03:42:49 2017| [bt] #19 bin/AvorionServer(_ZN5boost4asio6detail18descriptor_read_opINS0_17mutable_buffers_1ENS1_19read_until_delim_opINS0_5posix23basic_stream_descriptorINS5_25stream_descriptor_serviceEEESaIcENS_3_bi6bind_tIvNS_4_mfi3mf2Iv19InputCommandHandlerRKNS_6system10error_codeEmEENSA_5list3INSA_5valueIPSE_EEPFNS_3argILi1EEEvEPFNSO_ILi2EEEvEEEEEEEE11do_completeEPNS1_15task_io_serviceEPNS1_25task_io_service_operationESI_m+0xc6) [0x6b4166]
Sat Mar 18 03:42:49 2017| [bt] #20 bin/AvorionServer(_ZN5boost4asio6detail15task_io_service3runERNS_6system10error_codeE+0x3c8) [0x6b1bf8]
Sat Mar 18 03:42:49 2017| [bt] #21 bin/AvorionServer(_ZN19InputCommandHandler3runEv+0x2a) [0x6aefaa]
Sat Mar 18 03:42:49 2017| [bt] #22 /usr/lib64/libstdc++.so.6(+0xb1ba0) [0x7f7cb4eb1ba0]
Sat Mar 18 03:42:49 2017| [bt] #23 /lib64/libpthread.so.0(+0x7dc5) [0x7f7cb46d3dc5]
Sat Mar 18 03:42:49 2017| [bt] #24 /lib64/libc.so.6(clone+0x6d) [0x7f7cb44016ed]
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| crtstuff.c:?
Sat Mar 18 03:42:49 2017| crtstuff.c:?
Sat Mar 18 03:42:49 2017| crtstuff.c:?
Sat Mar 18 03:42:49 2017| crtstuff.c:?
Sat Mar 18 03:42:49 2017| crtstuff.c:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:?
Sat Mar 18 03:42:49 2017| ??:0
Sat Mar 18 03:42:49 2017| ??:0
Sat Mar 18 03:42:49 2017| ??:0
Sat Mar 18 03:42:49 2017|
Sat Mar 18 03:42:49 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x62e964 2>&1
Sat Mar 18 03:42:49 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x607182 2>&1
Sat Mar 18 03:42:49 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x60efba 2>&1
Sat Mar 18 03:42:50 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x7f7cb432bb35 2>&1
Sat Mar 18 03:42:50 2017| addr2line -i -e /home/ec2-user/Steam/steamapps/common/AvorionServer/bin/AvorionServer 0x6049b9 2>&1
Sat Mar 18 03:42:50 2017| 140173599121984 failed to aquire /home/koonschi/buildbot/slave/steamrt-release/build/SpaceServer/Server/Server.cpp: 548, communicatorsMutex after 1000000 tries
Sat Mar 18 03:42:50 2017| backtrace() returned 26 addresses
Sat Mar 18 03:42:50 2017| [bt] #1 bin/AvorionServer(_ZN11MutexLockerISt15recursive_mutexLb0EE4lockEv+0xff) [0x6322cf]
Sat Mar 18 03:42:50 2017| [bt] #2 bin/AvorionServer(_ZN11MutexLockerISt15recursive_mutexLb0EEC2ERS0_RKSsS4_+0x6a) [0x63260a]
Sat Mar 18 03:42:50 2017| [bt] #3 bin/AvorionServer(_ZNK6Server16getCommunicatorsEv+0xac) [0x62753c]
Sat Mar 18 03:42:50 2017| [bt] #4 bin/AvorionServer(_ZN6Server15getCommunicatorEi+0x1a) [0x62775a]
Sat Mar 18 03:42:50 2017| [bt] #5 bin/AvorionServer(_ZN6Galaxy10getFactionEi+0x17) [0x6b4d07]
Sat Mar 18 03:42:50 2017| [bt] #6 bin/AvorionServer(_ZN13ScriptFactionC2EP6Galaxyi+0x30) [0x6813c0]
Sat Mar 18 03:42:50 2017| [bt] #7 bin/AvorionServer(_ZN12ScriptGalaxy15getLocalFactionEii+0x5b) [0x723d4b]
Sat Mar 18 03:42:50 2017| [bt] #8 bin/AvorionServer(_ZN26ScriptGalaxy_script_detail22member_getLocalFactionEP9lua_State+0x6d) [0x7252bd]
Sat Mar 18 03:42:50 2017| [bt] #9 bin/AvorionServer() [0xad63dd]
Sat Mar 18 03:42:50 2017| [bt] #10 bin/AvorionServer() [0xad9394]

Link to comment
Share on other sites
Mutiegenesis

Mutiegenesis

Posted
  • Author
Posted

Interesting! My server also keeps crashing on mutex errors, but they're a **** to track down :(

 

So I was running under screen at the time, because I wanted to 'stuff' text into the console (think MOTD banner / Plug for Donations kinda thing).  That worked well, but I believe that running in screen was the issue.  Haven't seen anything like it since going back to plain old

 

'nohup ./server.sh &'

 

Working on a solution using named pipes instead of screen.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share
Go to topic listing
×
×
  • Create New...