Ross Fisher and Robert Karlsson both had disappointing days in the fourth round of the PGA Tour Qualifying Tournament at La Quinta in California.