Right click on a layer in the Layers View to open the layer context Menu and select Delete to delete the selected layer
You can alternatively use the Delete key on a selected layer.