The U.S. federation says the search for Sermanni's replacement will begin immediately, as Jill Ellis takes over on an interim basis
U.S. Soccer director of development Jill Ellis will serve as interim head coach. She previously served in the same role after Pia Sundhage left to coach Sweden in 2012.
"We want to thank Tom for his service over the past year and half, but we felt that we needed to go in a different direction at this time," U.S. Soccer president Sunil Gulati said in a release. "We will begin looking for a new coach immediately to guide our women's national team toward qualifying for the 2015 FIFA Women's World Cup."
The move came just hours after the U.S. defeated China in a friendly, and just one year before the Women's World Cup begins in Canada.
"I'm disappointed that things didn't work out, but I'd like to thank U.S. Soccer for the opportunity to have coached this team and also the staff and players for all their hard work," Sermanni said in the release.