Serbian also writes off Blues' title hopes
Torres will face Manchester United for the first time since joining Chelsea from Liverpool for a British record £50 million on deadline day of the January transfer window.
Vidic has previously struggled against Torres when the Spaniard was at Liverpool, however, the Serbian insists that he does not worry about taking on the World Cup winner.
Vidic told reporters: "Sometimes you read people saying that certain players have a hard job to play against someone else.
"Obviously, this is the opinion some people have [about Vidic and Torres] because they always mention it.
"I don't have a problem with that. I can only change it on the pitch, not by saying what I think in the media. It actually just makes me more focused to do my job."
The Serbian international also went on to talk about Chelsea's title chances, with Vidic taking a similar stance to Chelsea captain John Terry who said that if the Blues fail to win against United, then they will be out of the race.
Vidic said: "They are so many points behind, it would be very difficult for them to come back.
"But anything can happen. If you look at the league and how many points we have lost and the games Chelsea lost in a row, you never know."
The former Spartak Moscow defender is one of the favourites to win the PFA Player of the Year award, but he managed to stay humble about his form this season.
He continued: "It is not for me to decide whether I have ever played better.I just try to limit my mistakes.
"As long as I am thinking like that I will keep myself on a good level. In all honesty, I am never happy with my game. I want to improve all the time."
Vidic's fine form this season has seen him rise up the Castrol Rankings to a position of 47, up 14 places since last August.