Ballantyne was injured late in Sunday's derby win over West Coast.
He joins Fremantle skipper and key forward Matthew Pavlich on the sidelines, after Pavlich on Tuesday accepted a three-match ban for a high bump on West Coast's Mitch Brown.
Clancee Pearce (concussion), Paul Duffield (calf) and Nick Suban (calf) are also in doubt for Sunday's MCG clash with Richmond and will have to pass fitness tests.
Fremantle, who is in fifth spot and outside the top four only on percentage, face Adelaide in Perth six days after facing the Tigers.