It's most likely because the TOM is made for a flatter radius.
From my understanding most jazzmasters are 7.5" radius and there's some that are 9.5"(I may be wrong about the last part.), and TOM bridges are 12" radius.
I would say to either A) Get a mustang bridge, 😎 Try to file down the notches in the TOM so you'll have a radius of 7.5" or 9.5", or C) try to raise the action some, and see if that helps.
Before you do anything wait for someone else to chime in because as I said I could be wrong.