ASoC: rt5645: Remove the redundant delay time

This patch removes the redundant delay time to speed up from the cold start
of headphone playback.

Signed-off-by: Oder Chiou <oder_chiou@realtek.com>
Link: https://lore.kernel.org/r/20201230080235.12698-1-oder_chiou@realtek.com


Signed-off-by: Mark Brown <broonie@kernel.org>