Commit 394918eb authored by Jens Axboe's avatar Jens Axboe
Browse files

io_uring: enable use of bio alloc cache 



Mark polled IO as being safe for dipping into the bio allocation
cache, in case the targeted bio_set has it enabled.

This brings an IOPOLL gen2 Optane QD=128 workload from ~3.2M IOPS to
~3.5M IOPS.

Reviewed-by: default avatarChristoph Hellwig <hch@lst.de>
Signed-off-by: default avatarJens Axboe <axboe@kernel.dk>
parent be863b9e

fs/io_uring.c

+1 −1
Original line number Diff line number Diff line
@@ -2737,7 +2737,7 @@ static int io_prep_rw(struct io_kiocb *req, const struct io_uring_sqe *sqe) 
		    !kiocb->ki_filp->f_op->iopoll)

			return -EOPNOTSUPP;



		kiocb->ki_flags |= IOCB_HIPRI;

		kiocb->ki_flags |= IOCB_HIPRI | IOCB_ALLOC_CACHE;

		kiocb->ki_complete = io_complete_rw_iopoll;

		req->iopoll_completed = 0;

	} else {