The 50-year-old saw his team fall to a 1-0 home defeat to Spurs in their first game back in the Premier League for eight years, as Roberto Soldado fired home a penalty after 50 minutes.
Former Valencia man Soldado marked his league debut with the cool effort after Dean Moxey handled a ball swung in by Aaron Lennon, but it was another decision that irked Holloway.
The Palace manager felt his forward Stephen Dobbie was unfairly challenged by Nacer Chadli in the build-up to the penalty, and remonstrated with the referees when a free-kick was not given.
"I've got to learn what a foul is because I thought Nacer Chadli deliberately body checked Stephen Dobbie, smashed him down and ran off with the ball," he said.
"If the referee didn't see that, the assistant should have. You have to ask if he's good enough if he didn't see that. I don't see how he can miss it.
"It's going to be a long hard season for me with these people (referees). I had this with Blackpool.
"Certain clubs get fouls and others don't. Tottenham will feel that if they play Man United.
"Do I think I would have got that at Tottenham? No I don't. I just want a bit of fairness."