Wowza Community

Streams getting stuck, having to restart

I have three RTSP streams coming into my Wowza server, which is then doing audio-only transcoding and then broadcasts them. Occasionally, perhaps once a day, a stream will get stuck. By that I mean that when I request the Flash stream the video will start to play for a second or two and then stop. Because the stream is from an IP camera that puts a timestamp in the image, I can see that the video is old and must apparently be cached. Restarting the stream in the StreamManager immediately fixes the issue.

Going back from the last time I restarted a camera, the mentions of the stream in the access log just prior to the restart are as follows:

2012-05-23      08:31:34        CDT     comment server  INFO    200     -       RTPSessionDescriptionDataProviderBasicRTSPWorker.p  rocessResponse: command:OPTIONS response:RTSP/1.0 200 OK status:200 handled:false     -       -       -       96085.83        -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       CupertinoPacketHandler.handlePacket[myapp/_definst_/camera.stream]: Timecode out of order [video]: 7715643858:7715644369  -       -       -       96087.558       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       SanJosePacketHandler.handlePacket[myapp/_definst_/camera.stream]: Timecode out of order [video]: 7715643858:7715644369    -       -       -       96087.558       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       LiveStreamPacketizerSmoothStreaming.handlePacket[myapp/_definst_/camera.stream]: Timecode out of order [video]: 77156438580000:77156443690000     -       -       -       96087.558
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       SanJosePacketHandler.handlePacket[myapp/_definst_/camera.stream]: Timecode out of order [audio]: 7715643487:7715644450    -       -       -       96087.683       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       CupertinoPacketHandler.handlePacket[myapp/_definst_/camera.stream]: Timecode out of order [audio]: 7715643487:7715644450  -       -       -       96087.683       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       SanJosePacketHandler.resetStream[myapp/_definst_/camera.stream][2:11]: Timecodes jumped back in time.     -       -       -       96087.954       -       -       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       LiveStreamPacketizerSmoothStreaming.resetStream[myapp/_definst_/camera.stream][0:11]: Timecodes jumped back in time.      -       -       -       96087.954       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:36        CDT     comment server  WARN    200     -       CupertinoPacketHandler.resetStream[myapp/_definst_/camera.stream][2:11]: Timecodes jumped back in time.   -       -       -       96087.954       -       -       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       SanJosePacketHandler.handlePacket[myapp/_definst_/camera.stream_aac]: Timecode out of order [video]: 7715643858:7715644369        -       -       -       96088.324       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       CupertinoPacketHandler.handlePacket[myapp/_definst_/camera.stream_aac]: Timecode out of order [video]: 7715643858:7715644369      -       -       -       96088.324       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       LiveStreamPacketizerSmoothStreaming.handlePacket[myapp/_definst_/camera.stream_aac]: Timecode out of order [video]: 77156438580000:77156443690000 -       -       -       96088.324
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       CupertinoPacketHandler.resetStream[myapp/_definst_/camera.stream_aac][0:11]: Timecodes jumped back in time.       -       -       -       96088.325       -       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       SanJosePacketHandler.resetStream[myapp/_definst_/camera.stream_aac][0:11]: Timecodes jumped back in time. -       -       -       96088.325       -       -       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       CupertinoPacketHandler.handlePacket[myapp/_definst_/camera.stream_aac]: Timecode out of order [audio]: 7715643583:7715644578      -       -       -       96088.325       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       LiveStreamPacketizerSmoothStreaming.resetStream[myapp/_definst_/camera.stream_aac][0:11]: Timecodes jumped back in time.  -       -       -       96088.325       -       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       SanJosePacketHandler.handlePacket[myapp/_definst_/camera.stream_aac]: Timecode out of order [audio]: 7715643583:7715644578        -       -       -       96088.326       -       -
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -
2012-05-23      08:31:37        CDT     comment server  WARN    200     -       LiveStreamPacketizerSmoothStreaming.handlePacket[myapp/_definst_/camera.stream_aac]: Timecode out of order [audio]: 77156435830000:77156445780000 -       -       -       96088.327
       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -       -

I assume that this is the reason the stream got ‘stuck’. That being said, my memory is hazy whether similar warnings preceded earlier stuck streams.

I see that some other forum posts here refer people to the Troubleshooting live streaming issues page when they have timecodes out of order. However, it’s not clear to me which change I should make, especially since I can’t reproduce the issue and waiting ~24 hours for it to randomly pop up again is a pain. :wink:

Should I enable the server side sort buffer? While I have nothing specifically against buffering, since I’m more interested in moving on from any problems whenever they occur I’m happy to just automatically drop packets and/or reconnect if that’s the best way to keep the streams up for as much as possible. I guess that would make transcoding hard, though…

Thanks.

Hi

Try using the module found here,

https://www.wowza.com/docs/how-to-enable-advanced-monitoring-and-resetting-of-mediacaster-streams

It may fix the problem

Jason

Wow, I don’t know how I totally missed that. Thanks, I’ll try that now.