The Republic of Ireland international has spent the first half of this season on loan with the English Second Division club after being told he had no future at Easter Road in the summer.
He has since earned plenty of first-team action with The Hatters this autumn and Colgan now believes he is ready to make a comeback with the Edinburgh outfit.
The Irishman revealed that he had no desire to leave Hibs, despite the SPL club's lack of finances at present.
''I never wanted to leave Hibernian to be honest," Colgan told the Daily Record.
''I thought I was the number one goalkeeper at Easter Road, I still do, but it's up to (manager) Bobby Williamson to decide whether I'll play.''