If you rollover then convert into ROTH; then the cost basis is all accounts (new rollover $$ plus existing IRA); If you convert the existing IRA then rollover 401k, then the cost basis for the rollover part is much better.
When you have mixed IRA (deductable and non-deductable IRA contribtuion in the same IRA account); the difference is huge.