Hold down the shift key when opening an application to prevent it from opening previously-open windows.
To change the default behavior all apps, go to System Preferences > General and check "Close windows when quitting an application."
To change the default behavior all apps, go to System Preferences > General and check "Close windows when quitting an application."