[JKT]

If you had Layer 2 active when you placed the object, it should only be on Layer 2, but to hide the object when viewing other layers, you will need to "hide" Layer 2 - do so by clicking the eyeball icon next to the layer (either in the drawer or in the ruler, when you have Layer 2 selected). A hidden layer is indicated by an eye with a line through it:



FWIW, this is how it works in Photoshop and other image editing apps that use layers.

If it is appearing even when you hide layer 2, you must have inadvertently pasted it on Layer 1 as well.