In case, you do not intend to drive any Data to the DUT, what is the purpose of having a driver.
Instead, you can replace the driver with an object directly extended from component and ensure it responds to the DUT.
As per my knowledge, I doubt if you can have a driver without sequencer.