It's likely that the PR pages are seen more commonly than the dashboard by most users, so add alerts there in case users wonder what's happening. Fixes #580