Revert "usb: gadget: udc: core: Prevent redundant calls to pullup"

commit 5e161721 upstream.

This reverts commit a3afbf5c.

This depends on commit 0db213ea ("usb: gadget: udc: core: Invoke
usb_gadget_connect only when started") that introduces a regression,
revert it till the issue is fixed.

Cc: stable@vger.kernel.org
Reported-by: Stephan Gerhold <stephan@gerhold.net>
Reported-by: Francesco Dolcini <francesco.dolcini@toradex.com>
Link: https://lore.kernel.org/all/ZF4BvgsOyoKxdPFF@francesco-nb.int.toradex.com/


Signed-off-by: Francesco Dolcini <francesco.dolcini@toradex.com>
Link: https://lore.kernel.org/r/20230512131435.205464-2-francesco@dolcini.it


Signed-off-by: Greg Kroah-Hartman <gregkh@linuxfoundation.org>