A date value inescapably has a time component. (it is simply a number of seconds since the UTC start of 1970).

You can set this to 0 (the stroke of midnight) or to the default setting under Preferences > Data > Default time for Due Dates

but while you might not be interested in time, time alas, is interested in you - and the system measures dates in seconds rather than days ...

--