e.g.

defaults write com.omnigroup.OmniOutlinerPro3 NSRecentDocumentsLimit 20

(From Terminal.app, then re-open oo3)

The list will not immediately be longer, but will start to grow as you open more documents.

--