If you are using MediaCache and are finding that playback is slow for the first request and then fast for future requests of the same part of the video then this does seem to indicate it may be related to your MediaCache settings. There are a number of
MediaCache parameters that you could look at tuning, but if this doesn't help then I'd suggest raising a support ticket via the
following process. Please refer to this thread should you do that.