With the spotlight on spectator conduct after Sydney champion Adam Goodes was racially taunted by a young Collingwood fan at the MCG on Friday night, Milne also wants the League to outlaw other forms of abuse.
The 33-year-old is regularly subjected to unsavoury remarks from opposition supporters, most recently from a female Collingwood fan hanging over the fence as he lined up for goal on the boundary at Etihad Stadium in round six.
"[It's] a bit of a touchy subject. Nothing really changes with me," he told Channel Nine's Sunday Footy Show.
"What happened on Friday night [with Goodes] was very sad for the game. It's all about the racism at the moment, but I [also] cop a few words that aren't good for anyone. I've got a couple of kids and they go to the footy, and family and parents have to cop the abuse. So the sooner we can stamp it out, the better."
The round-six incident simply reinforced Milne's views. Although he admitted he hadn't heard what the woman said, he revealed the fallout had hurt both him and his family.
Milne also wasn't happy with the Magpie fan's subsequent appearance on The Footy Show when, he said, she tried to "make a big thing of it, and a bit of a joke about it".
"We've got to try and stamp it out because you can't be yelling out them kind of things when there's kids around in cheersquads and stuff like that," he said. "It's not good for the game, and it's not good for kids growing up … There's things you can say and things you can't.
"It always happens. I just go with the flow and continue on with my footy, and always have … you don't lower your level to that kind of people. All Saints supporters really stick up for me and the whole team."
As for his playing future with the rebuilding Saints, Milne said he was determined to play on into a 13th AFL season.
"I haven't really looked at it at the moment … Of course, you want to play on. I'll sit down with Scotty [Watters] at the end of the year and work out what's best for the club," he said. "But I'm feeling pretty good [and] hopefully I'll start getting a kick soon."
He ruled out extending his career at another club, insisting: "I'm a St Kilda person through and through, and [being] a one-club player really sits tight with me."
Ben Collins is a reporter for AFL Media. Follow him on Twitter: @AFL_BenCollins
