Fares, availability and the difference between a planned ride and a lucky one.
Night fares are higher and less negotiable. Fewer vehicles, more demand, and drivers who know you have no alternative.
The mistake is planning how to get there. Plan how to get back before you leave, including the fallback.
Late trips cost more and are less reliable. That asymmetry is deliberate: it makes staying out a decision, not a default.