The Saints held a 1-0 lead through Gaston Ramirez's 59th minute strike before Hooiveld was penalised for a tackle on Mohamed Diame.
|SAINTS TO SEE OFF SWANS?|
|21/10||Southampton are 21/10 with Bet365 to beat Swansea at the Liberty Stadium|
"I do think that the free kick against us should not have been given leading up to their goal," he told the club's official website.
"I think it was a great tackle to be fair, it was on the ball and not with a stretched leg, so I was a bit disappointed about that, as it then went in."
Southampton are seven points above the relegation zone, and sit comfortably in 11th place in their first season back in the top flight.
Hooiveld, who joined the Saints when they were in the Championship, admits his side were happy to take a point in the end.
"It's always annoying when you lose a lead and I think we did very well to be fair," he added.
"We played our game but lots of things weren't helping like the pitch in the weather. We tried to play and I thought we played well at some points and we got the respect that we deserve in the end because they were happy with one point I think."