Revert "Merge branch '2023-07-24-introduce-FF-A-suppport'"

This reverts commit d927d1a8, reversing
changes made to c07ad952.

These changes do not pass CI currently.

Signed-off-by: Tom Rini <trini@konsulko.com>