They are intent on ousting Johnson following his handling of Michael Voss' sacking and attempted hiring of Paul Roos.
But underneath it all, Williams says he can see the conflict hampering the Lions' future.
He says it is "clearly having an (negative) impact" and needs resolution.
Johnson has dug his heels in and said on Wednesday he would have his fate decided at December's Annual General Meeting.
But Williams says it's silly to let things fester that long.
In that time the Lions are trying to appoint a coach and will be going through trade and draft periods and finalising their list for 2014.
Williams hinted – with more of a push than a nudge - that Johnson and his aligned directors Cameron Milner and Linda Nash should step down and clear a path for his ticket to assume power.
As a back-up, a Lions supporter group, The Lion's Roar, has established a webpage to garner the necessary five per cent of voting members required to call for an Extraordinary General Meeting within the next two months.
As of Friday morning, almost 1000 members had contributed an expression of interest to call for an EGM and speed the process up.
But as the Lions search for a coach to replace Voss, Williams says even that timeframe is too broad.
"The longer this drags on, the worse this gets," Williams said.
"You can imagine in a couple of weeks time if we identify a target like Paul Roos or someone else … and he says 'that's great, but your board's in disarray, that needs to be fixed before I do anything'.
"It's untidy. It really needs to be resolved.
"Clearly we can't wait for a meeting in seven or eight weeks time to be held or even the AGM at the end of the year, that's too late, that's silly.
"I just hope it doesn't drag on because that just doesn't help anybody."
Williams said he and Power had been disappointed by Johnson's lack of consultation with chasing Roos in the aftermath of Voss' messy sacking.
Even more so, he said there was a disengagement with members and key stakeholders that was now being highlighted.
Williams said he took no satisfaction in causing disruption, but felt it necessary to reinvigorate the Lions in the wider community.
He said there was pressure to land a quality coach, and had not given up on Roos.
"We made a decision not to renew Vossy because we didn't think he could take us to the next stage, so by extension the person we appoint we think he can," Williams said.
"I'm hoping there is (a chance to get Roos). I just can't say at this stage. Wherever there is a chance, we'll do whatever we can. It's entirely up to Paul Roos.
"He's absolutely our priority. We think he'd do enormous things, not just for the Lions, but footy in Queensland, and probably bring out a lot of the old Fitzroy supporters as well in Melbourne.
"There's a huge upside in that, but at the end of the day he needs to want to come back to footy as a coach.
"And with Leigh on the board, it'd put a rocket under the organisation and just boost our profile up here."
Johnson has decided to keep out of the spotlight in the past 48 hours after a tumultuous 10 days following Voss' sacking last Tuesday.
While the Lions fumble around, the clock remains ticking.
The boardroom brawl must be resolved, and Williams believes there's only one clear way to minimise disruption.
"Everyone on the board are there doing what they think is the best thing for the club. I would have thought there's an overwhelming indication what needs to be done, but that's up to Angus and the others to see that."