Scotland skipper Kelly Brown insists he never feared losing the captaincy to scrum-half Greig Laidlaw.