That's what I mean by fiddly
Battles are resolved in order of the closest pairs of dice. First is the red player die against the green non-player, they are closest together. Red wins that encounter, the green die is removed.
But then what? Is Red really closer to the red non-player die? Or does yellow have a shot first?