James, 23, was not part of the Chelsea squad that lost to Villa at the weekend. The England international has been out of action since sustaining a hamstring injury following his team's opening Premier League match of the season against Liverpool.
However, he attended the match and took it on himself to remonstrate with the official after the game, ending up with a possible suspension as a result.