iommu/vt-d: Enhance capability check for nested parent domain allocation

mainline inclusion
from mainline-v6.7-rc1
commit a2cdecdf9d234455fdfc8f539bbf5818711bc29d
category: feature
bugzilla: https://gitee.com/openeuler/intel-kernel/issues/I8Y6AM
CVE: NA

Reference: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?a2cdecdf9d234455fdfc8f539bbf5818711bc29d

--------------------------------

This adds the scalable mode check before allocating the nested parent domain
as checking nested capability is not enough. User may turn off scalable mode
which also means no nested support even if the hardware supports it.

Intel-SIG: a2cdecdf9d23 iommu/vt-d: Enhance capability check for nested parent domain allocation
Backport IOMMUFD Dirty Tracking

Fixes: c97d1b20d383 ("iommu/vt-d: Add domain_alloc_user op")
Link: https://lore.kernel.org/r/20231024150011.44642-1-yi.l.liu@intel.com


Signed-off-by: Yi Liu <yi.l.liu@intel.com>
Reviewed-by: Lu Baolu <baolu.lu@linux.intel.com>
Reviewed-by: Kevin Tian <kevin.tian@intel.com>
Signed-off-by: Jason Gunthorpe <jgg@nvidia.com>
[ jz: amend commit log ]
Signed-off-by: Jason Zeng <jason.zeng@intel.com>