You should make 2 queues. 1 queue for voip, the other for low priority.
make sure all your voip goes into the voip queue. make sure all else
goes to low priority queue

see  also http://m0n0.ch/wall/list/?action=show_msg&actionargs%5B%5D=49&actionargs%5B%5D=99