We've never had a problem getting access for a building inspection, and the last one was during the cooling off period (in Queensland).
Why would the vendor object? As a vendor I would want to do everything to keep the contract moving smoothly, and the sooner inspections are done the better.
Marg