The Lions slumped to a 0-7 record after losing to Essendon by 36 points on Saturday night.
Voss said Brown was due to be given clearance on either Monday or Tuesday to take on North Melbourne at the Gabba next Saturday night.
He has spent the past eight weeks on the sidelines recovering from multiple facial fractures suffered in a round-one collision with Fremantle's Luke McPharlin.
"In one way we've fought through that and haven't talked about it but in another way it's disappointing we have to rely on him to come back and give us that direction when we've certainly got the capability there," Voss said.
"He not only gives us his ability, but he gives us his voice and presence and ability to organise.
"It just would have been nice to achieve that without him there but, rightly or wrongly, we haven't been able to do that."
This latest loss came as the Bombers had a glut of possession inside its forward 50 (75-36).
Voss said considering the amount of ball being pumped into their defensive end, his defenders did a terrific job.
"I thought they (defence) were enormous," he said.
"We had our fair share of ball and getting it inside 50 we were quite efficient but their ability to turn the ball over in midfield was probably the telling factor in the game.
"Just the pure weight of numbers in the end gets you. When you've got defenders that are under pressure all the time it's hard to defend.
"They've got some good talls and good ground level players that are going to do some damage if you get the ball inside 50 that many times."
Voss said the Lions still had to tidy up small areas of their game, including giving away goals from free kicks.
"That hurts you enormously. We were beaten in contested footy and at times they carved through us too easy, but the fact you give away seven goals - it could have been one or two less - from free kicks, is a hell of a lot.
"They're the parts of the game we need to tidy up."
