Yes, because it was a buffet serving dinner, not lunch. Other wise it would have been a lunch buffet. But, I can say we had a lunch buffet party yesterday at the weding.
You were right. But it doesn't matter. I have heard it reversed without changing the meaning. Dinner Buffet or Buffet dinner, all the same to me!