Update rulez.yaml

This MR cherry-picks changes to rulez.yaml from !154 (merged).

This is mainly to avoid the dashboard to complain about issues due to the branching and because I don't know if !154 (merged) will land soon in main.

cc @ritesh @wlozano