Fixed after below: When decompressing the .zip, the application contents didn't retain the execute bits. Add it back with sudo chmod -R 755 /path/to/app. Since the application was downloaded by a web browser (in my case) the quarantine bits are set on the decompressed files. Remove that with sudo xattr -dr com.apple.quarantine /path/to/app.
... View more