Why won't magnesium nitrate react with sulfuric acid?

If it did react, it would go through a double replacement reaction producing magnesium sulfate and nitric acid. The problem is that magnesium sulfate is soluble just like both of the reactants, thus no reaction is observable.