I guess it depends on how important looks vs $$ are to you. For me, the trunk doesn't look bad at all, but I agree with NorthernRider, it might look even better with a trunk that matches the saddlebags. Gloss black trunks can be pretty pricey, and trying to paint the existing textured trunk to a smooth gloss black might be durn near impossible. How would it look with a textured gloss black? Better, worse?
Interesting this came up as I have a friend with a 2007 BMW R1200RT with blue panniers. He purchased a trunk (smaller than yours) and is flat black (textured surface). Now that he has had it a year, he wants to try to match the panniers. We are going to try and paint it the same color, but live with the textured surface instead of trying to get a smooth surface. Will be interesting to see once we get it done.
In any event, good luck, and that is one fine looking machine you have there!
2008 Yamaha V Star 1300 Black Cherry