Have you tried our Alerting feature that allows you to build alerts based on specific criteria (error message, tags and versions)? Yes, you can fire those off to a Slack channel.
Here is a workflow guide for Alerting if you are not familiar with it.
If you are after something different then please hit reply and let us know.
VP of Product