This is true. I never get straight answers to this question because people point to those who call themselves Christians that practice the worldly aspects of the season. You have people (not many) that do not give gifts, decorate, erect trees, or any of that stuff. However, they like to sing the hymns about Christ's birth, read the story of Jesus, and go sing for the old and sick. They have recognized the day, but do not engage in any of the things that people are condemning. Do I tell this person to stop because Christmas has pagan roots?
"One man esteemeth one day above another: another esteemeth every day alike. Let every man be fully persuaded in his own mind." -Romans 14:5