The 35-year-old believes his Juventus team-mate has the potential to win Fifa's prestigious award in the future, while his vote for the 2013 honour went to Andrea Pirlo
Buffon named his team-mate Andrea Pirlo as his No.1 selection this year, and Real Madrid's Cristiano Ronaldo and Barcelona's Lionel Messi as his second and third choices, respectively.
However, the Italy international feels midfielder Pogba has the potential to win the prize and has questioned Manchester United's judgement in allowing the 20-year-old to join the Turin club.
"I voted for Pirlo, Cristiano Ronaldo and Messi," Buffon told Italia 1. "Pirlo because he is the best in his role, Ronaldo because he was the best in 2013, Messi because he is the best of all time.
"In the future I could vote for Pogba. He is one of those players that leaves you open-mouthed.
"Myself and my team-mates, even in the third or fourth training session with him when he was still a stranger, wondered if they can see well in Manchester."
Buffon, who has had spells with Parma as well as Juventus, has won every honour in the Italian domestic game and was part of the Italy side that claimed their fourth World Cup title in 2006.
But the Champions League trophy has continued to elude the 35-year-old, who came closest in 2003's penalty-shootout loss to Milan in the final.
And, with Juve eliminated in the group stage of this season's competition, Buffon doubts whether his team will win the tournament during his time at the club.
"Compared to big clubs in Europe, there's still a little something lacking," he explained.
"When we met Bayern Munich last year, I realised that there was something still to be filled.
"Conte is sure we will win the Champions League. I had this thought 20 years ago, but it has certainly began to waver a bit."