The 31-year-old took off his shirt and ran towards a section of Pirates fans before throwing the shirt to the stands as a sign of anger and frustration for consistently booing him during the match.
He then left the pitch without the referee's permission after a heated confrontation with coach Micho Sredojevic, who was visible angry at the player's actions.
Gabuza returned to the sideline five minutes into the second half with his knee heavily strapped, but he was correctly booked twice for taking off his shirt and leaving the pitch without permission.
The South Africa international has since apologised for his behaviour.
Watch Gabuza's apology here: