When you export in PNG, or JPEG there is a selection box for 'Transparent Background'. Check that box and you shouldn't see the white border anymore.