Simple answer: yes, in my opinion. And often it's justified.
My .02ยข: I actually think it depends on a lot of factors. I "manage" a big band, a concert jazz band (I'm their creative producer) in addition to playing (we have an excellent drummer, so I'm the "relief" drummer, if you will - although I wouldn't want to try many of these charts without intensive woodshedding). Anymore, I think much of the volume thing is driven by the bass player, especially in a larger ensemble (using fender bass rather than double bass, which is the standard for most modern big bands anymore). The common refrain is "we can't hear the bass player", which causes the bassist to turn up, which then elevates the band up, especially the brass.. it's a vicious cycle, because often you lose the piano, who also turns up, and then it's awful, with piano standing out like a sore thumb. Some nights, the sound man adds to the problem by mic'ing the drummer to within an inch of his life, like a big funk band (omg) and then the saxes get lost, and the trumpets are blowing their brains out and...what a mess. So dynamics, while it's a great concept, can quickly get lost. It becomes painful, as everyone fights to be heard.
I do think the drummer has more control over this then most would think. In a rock setting, though, it seems as if, when you try to play dynamics, the guitarist looks at you like you're crazy, because it's out of his comfort zone - he needs that quarter note pulse. When you back off, no one else backs off with you and you wind up with three different "times". So everyone has to be on the same page. And there are so many different versions of "rock" for a drummer that a bass drum that sounds like a cannon might not work with a surf rock band, or a pop band, or even a country band, when it comes to the other players. It can be bewildering. Your sound needs to blend with the band and what they are trying to say.
In a big band, or even in a smaller jazz band with horns, dynamics becomes something that everyone has to treat gently, or you lose it. Often the drummer can initiate this faster than anyone - playing more softly, but with intensity (Mel Lewis, Davey Tough, Jeff Hamilton, even Steve Gadd) and keeping it there until everyone gets used to it often works wonders. With the big band, now I use minimal mic'ing, and the bass player works to get his sound to the trumpets but just so. Still trying to get the drummer where I want it; a change in drum set and snare helped immensely.
And a properly tuned jazz set (not a rock tune, and there is a difference, obviously) won't have the inherent volume issues that your typical rock-tuned set will, in a jazz context at least. Not that they can't happen, but it's harder, especially if the drummer is aware.
Lastly, I will agree with and reiterate caddywumpus' point: a drummer, who really is the quarterback of the band, needs to gently educate - as a musician, not as a drummer. That means working with everyone else, not just meekly accepting the idea that they are the cause of it. And that can be really hard sometimes.