To do something that is not usual or that you think is wrong.
It really goes against the grain to waste so much food.