No, it should show up only when that rule is applied.
Share screenshots of configured rule / or configuration in order to be able to spot the issue.
If this response was helpful to you, consider giving kudos to this post.
If this response solved your problem, click accept as solution to help others solve this issue