The keeper had a recent spell with Bristol City, but returned to The Potters at the end of his deal at Ashton Gate.
His opportunities have been limited at the Britannia Stadium, prompting the 20-year-old to go to Tiverton.
Foster will hope to gain some valuable first-team experience with Tiverton before attempting to fight for a place at Stoke.