The game was poised at 1-1 after Andrea Conti's opener in the first-half for the home side was cancelled out just after the restart through Leonardo Spinazzola's own goal.
Eight minutes later, Juve were screaming for a penalty as centre-back Toloi jumped up to challenge for a cross, clearly using his hand to deflect the ball away.
The referee pointed to the spot, but changed his mind shortly afterwards, giving it the other way. It initially appeared he gave it for a push on Toloi, but the decision could prove more controversial as it may have been given for an offside, which occurred after the handball.
The Bianconeri soon got their goal, however, as Dani Alves headed a cross flying into the net in the 83rd minute, but a late equalizer from Atalanta saw the match finish level at 2-2.