octeontx2-af: REE timeout error handling

commit 8609857e2ba612db5910e1b29fc7fe50d3dd60a1 from
git@git.assembla.com:cavium/WindRiver.linux.git

REE rule prefixes are programmed using AF AQ instructions.
Once all prefixes are written, SW polls on REE_AF_AQ_DONE
register until DONE indication is given.
In case timeout expires for this poll, future programming
will read the done indication and will not wait until
all prefixes are written. This will further cause prefix
checksum error and will fail future programming.
To solve this, before programming starts, DONE indication
is read and decremented if exists.

Other cases that are handled are when a function exit
without returning Force Clock ON and Graceful disable to
their original state

Change-Id: I3f297f3d687b4d1693b33b32f468b5161ae1a686
Signed-off-by: Smadar Fuks <smadarf@marvell.com>
Reviewed-on: https://sj1git1.cavium.com/c/IP/SW/kernel/linux/+/38635


Tested-by: sa_ip-sw-jenkins <sa_ip-sw-jenkins@marvell.com>
Reviewed-by: Sunil Kovvuri Goutham <Sunil.Goutham@cavium.com>
Signed-off-by: Ruiqiang Hao <Ruiqiang.Hao@windriver.com>