Voss oversaw the Brisbane Lions slump to their fifth loss in seven rounds on Saturday with a 26-point defeat by West Coast, despite a much-improved performance.
The Courier Mail on Saturday reported Voss, whose contract expires at the end of this season, has been told his job is safe until the Lions' meeting with Gold Coast in round 15, but would have no assurances thereafter.
Lions CEO Malcolm Holmes refuted those claims later in the day, saying, "the club's senior coaching position will not be reviewed until the end of the season. As such we will not be providing a running commentary on the matter.”
Voss said his only focus in a brutal next six weeks was concentrating on his team, starting with next Saturday's fixture against Essendon at Etihad Stadium.
"People can talk about those things and cast whatever they want, but I'm not here to save my job, I'm here to do my job. It's that simple for me," he said.
"That's a world (speculation) you guys live in. I don't live in that world. We live in the performance space.
"That means you'll cast forward, that's not my job. My job it to try and get this team ready, look at what we had and didn't achieve this week, get the most out of the players and go about doing it next week.
"That's what we'll continue to do."
Voss said the Lions started to show glimpses of their best against the Eagles, trailing by just one point inside the final 10 minutes.
He said the character and performance of the group was closer to what he expected on a weekly basis.
Following Essendon, the Lions face Carlton, Collingwood, Fremantle, Hawthorn and Geelong.
"We're playing some good opposition sides, but that's not daunting, it's a nice challenge to have and we have to work our way through that," Voss said.
Simon Black played his first match of the year after off-season knee surgery and started as the sub, coming on late in the third quarter.
Voss said the triple premiership player had been ill for three days and was "touch and go" after missing Friday's training.
Michael Whiting covers Brisbane Lions for AFL.com.au. Follow him on Twitter: @AFL_mikewhiting