If you want quickly switch off all layers except of specified layers - e.g. all but layers staring with "E-", or all except xrefs - you can use an inverse filter (swung dash, tilde, "~").
You can use your inverse filter for layer filtering in the Layer Manager or directly in the LAYER command.
So you can e.g. add the following command to your menu:
(command "_layer" "_OFF" "~E-*" "")
(switches off all layers but those starting with "E-"; mind the "0" layer)
Or enter this to the layer filter:
(selects all layers but xrefs)