The French goalkeeper accidentally collided with the Spanish forward following his decision to leave his goal to punch clear a long ball into the area.
Despite the Spaniard being stricken on the ground, referee Mike Dean failed to stop play, which drew ire from Swans boss Michael Laudrup after the game.
"I was terrified when I saw him on the ground. I had to go for it and impose myself,” Lloris told reporters “I made the decision to punch and unfortunately there was a big collision.
"It's OK, he got up and it was more a fear than injury. I asked him several times, he said there's no problem."
After an uncertain start to the season, that saw Brad Friedel preferred over him, the France captain has started in Tottenham's last eight games as he looks to tie down the No.1 spot at white Hart Lane.