This is to handle the case there was no more buffer to dequeue,
otherwise flushing state will stick and we will not be able to to queue
buffer afterward.

Signed-off-by: Nicolas Dufresne <nicolas.dufresne@collabora.com>