Wowza Community

Video encoder is stuck, recreating.

This comment does not address the issue of this thread at all. thanks

this is very aggravating. I have been able to work around this issue through COVID19 by using CPU encoding. Now that my use situation is beginning to get ramped back up, I really need this to be fixed. Have you tried a different version of Java… other than the v9 that is provided by wowza?

Ok @Carey Williamson, upon further discussion in the Engine team, we are seeing general failures with the latest Nvidia Drivers (Version 550 and Cuda 11) Rolling back to 440 does seem to help in most cases. Not all versions of the newest Nvidia drivers support cuda10 (which is what we build against right now).

440 support cuda 10.2. 450+ supports cuda 11. It seems like something breaks for us with cuda 11.

This has been tagged as a feature request and we are updating our docs with the following today:

I’m sorry for the inconvenience, please feel free to send a support ticket if you’d like discuss it with the engineers at Wowza.

@Rose Power-Wowza Community Manager

I just installed the latest CUDA 10.2 compatible driver available for Server 2019… 443.18… The problem persists… pic

I was using driver v398.75 with wowza 4.7.6 with no issues before I upgraded to 4.8.0 and Java9.

What is the possibility of an issue with Java?

I replied to my old support ticket to continue troubleshooting.

Thanks

Sorry @Carey Williamson that is what tech support suggested, but let me get a more specific response to this particular issue for you.

Ok. I’m having tech support take another look at this thread. That error “Video encoder is stuck, recreating.” was happening in 4.8.0 for some folks with your scenario, but was resolved after upgrading to 4.8.5, so our tech support team suspect it was a combination of the OS and GPU model with Wowza Streaming Engine 4.8.0.

But, to make sure you get the correct answer, I am confirming with the engineers the only solution is to upgrade to 4.8.5. Be back soon. Appreciate your patience and communication.

I guess I should have mentioned that I did upgrade to 4.8.5 back when it was released. The issue persists.

I have a support ticket that was put on hold through COVID19. It is ticket #347197

the link in this article clearly says that Tesla k series GPUs do not have console access requirements.

more info on my environment… I was running Windows server 2016. Two days ago I did an in-place upgrade to 2019. The issue persists.

I see it. Feel free to reply to that if you’d like to reopen that one as opposed to creating a new one.

Engineers say not a Java issue, we had some other reports of 4.8.0 not working on windows with the kepler cards. Sorry for this and yes I let the engineer assigned to your ticket know you are ready to continue the conversation.

Hi,

I have the same issue with video encoding stuck using Tesla cards. Strange thing is that on some older Windows Servers it’s all running fine. It’s a problem with latest installations. I tried to compare the older and newer servers but cannot find any differences. Also swapped cards between servers but nothing seems to help. Really strange. Anybody find something that can solve this issue?

Thanks, Joost

Can you confirm what version of Engine you’re using @Joost_Sanders? We’ve had a few new releases since then with updates.

Hi,

We use the latest release.

We just released it yesterday- version 4.8.8.01 and it has an update that may solve your issue:

NVIDIA NVENC SDK 9 update

With the upgrade to NVIDIA NVENC SDK 9, Wowza Streaming Engine 4.8.8.01 supports higher quality transcoding workflows when using NVIDIA Turing or newer architecture. The Wowza Streaming Engine Transcoder supports NVIDIA 440.xx drivers, but does not yet support NVIDIA 450.xx drivers.

Not sure if that may be worth a try or not for you @Joost_Sanders. If you do though, please be aware of the potential breaking changes in the 4.8.8.01. You can read them here:
https://www.wowza.com/docs/wowza-streaming-engine-4-8-8-01-release-notes

Hi!. Experiencing the same issue.
Wowza 4.8.8.01 on Windows 10
NVidia drivers 461.40
2x GTX970 (non SLI)
When try to transcode with NVENC, the first 3 streams work Ok, but the 4th one start to raise errors:
WARN server comment - TranscoderWorkerVideoEncoder.run[videoEncoderGetEncodedFrames][720p]: Video encoder is stuck, recreating.
and
EncOpenEncodeSessionEx(&encodeSessionExParams, &hEncoder) returned error 10 at nvenc9\NvEncoder\NvEncoder.cpp:52

Looked through the comment section, will try to downgrade video drivers to 440.xx, will report results when they will be.

Downgraded to NVidia Game Ready 445.87.
The same issue.
3 transcoding streams work ok, the 4th one -
Video encoder is stuck, recreating.
NvEncoder::NvEncoder : m_nvenc.nvEncOpenEncodeSessionEx(&encodeSessionExParams, &hEncoder) returned error 10 at nvenc9\NvEncoder\NvEncoder.cpp:52

shared library: D:/Wowza Streaming Engine 4.8.8.01/lib-native/win64/wms-vencoder-h26x-nvenc9.dll

That’s a problem. We planned to use NVENC for at least 16 streams being transcoded simultaneously.

UPD. Study of a problem indicates that it is possible that we hit limitation of 3 concurrent sessions provided by GTX 970.

Hi Rose,

Coming back on this issue. The K20 en K40 only seem to be working well with:

  • Wowza version 4.7.6
  • Graphics driver 377.35
  • SDK 8

We recently tried a NVidia T4 with all the latest versions:

  • Wowza 4.8.14+9 Build 20210719152831
  • Graphics driver 471.41
  • SDK 11.4

Encoding is working so not stuck anymore, but now decoding does not work! Wowza service just stops like it’s missing something.

Any idea?

Thanks, Joost

Oh no! So what I know about 4.8.14 is that because we have switched over to Beamr,

  1. You must make these changes for decoding:

https://www.wowza.com/docs/configure-beamr-software-encoding-and-decoding#beamr-decoding2

  1. If you have any advanced parameters see this doc HERE.


  1. You MUST have support for CUDA 11 and make the changes required:

https://www.wowza.com/docs/migrate-from-mainconcept-to-beamr

  1. If you are using Windows @Joost_Sanders, then you need to see this in the release notes for 4.8.14


Did you see all the release notes for 4.8.14? There is quite a bit of info on the breaking changes:

https://www.wowza.com/docs/wowza-streaming-engine-4-8-14-release-notes#knownissues

Hi Rose,

But Beamr does not use the Nvidia card or am I missing something?