Napoli star striker Edinson Cavani has been left annoyed by the constant speculation about his future and admits it has become a distraction.