Metal or Plastic backing?

I just realize something funny for how Apple may want to change their phones to a cheaper plastic backing' while the Samsung is rumored to make a metal backing for their possibly next flagship Galaxy Note 3.
Will Metal backing make a good move for Samsung? I mean, metal backing does come in slightly higher price. Does that really matter to phones other than the premium image?