Revert Kernel Warpdrive part:SPIMDEV, which depends on VFIO/VFIO_MDEV.

driver inclusion
category: bugfix
bugzilla: NA
CVE: NA

This reverts commit 6b546eb4c02210d7bc77aa64025cc6c84e5f1b30.

Feature or Bugfix: Bugfix

Signed-off-by: lingmingqiang <lingmingqiang@huawei.com>
Reviewed-by: hucheng.hu <hucheng.hu@huawei.com>
Reviewed-by: Yang Yingliang <yangyingliang@huawei.com>
Signed-off-by: Yang Yingliang <yangyingliang@huawei.com>