`grunt dist` doesn't leave an app + extension that can be used in developer mode

During smoke testing it would be helpful to be able to use the exact build artifacts that will be sent to the web store, but currently the build artifacts are not actually runnable because the keys have been erased.