Australia's home affairs minister says Djokovic is 'free to leave at any time'