The Pro-Rata Rule: Why Your IRA Balance Can Wreck a Backdoor Roth

The backdoor Roth is supposed to be a clean workaround for high earners who can't contribute to a Roth IRA directly. But there's a rule buried in IRC Section 408(d)(2) that catches people off guard every single tax season, and it can turn what looked like a tax-free move into an unexpected bill.

What the Pro-Rata Rule Actually Is

The IRS does not let you pick and choose which IRA dollars get converted. When you do a Roth conversion or take a distribution from any Traditional IRA, the agency treats every Traditional, SEP, and SIMPLE IRA you own as one combined pool. It doesn't matter that you opened a separate IRA specifically for nondeductible contributions. It doesn't matter that the accounts are at different custodians. Everything gets aggregated.

The taxable portion of your conversion is calculated as a fraction: pre-tax dollars divided by total IRA dollars. If you have $90,000 of pre-tax money in a rollover IRA and you make a $7,000 nondeductible contribution and then convert that $7,000, your total IRA balance is $97,000. Only about 7.2% of that pool is after-tax. So 7.2% of your $7,000 conversion ($504) is tax-free. The other $6,496 is ordinary income. You just paid taxes on $6,496 to move $7,000 into a Roth. That's not the deal most people think they're getting.

The Rules, the Math, and the Watchouts

The aggregation calculation happens on December 31 of the year you do the conversion. That date matters because it determines which IRA balances count. The IRS uses Form 8606 to track your basis (your nondeductible contributions) and calculate how much of any distribution or conversion is taxable.

A few points worth understanding before you act:

• Roth IRAs are excluded from the aggregation calculation entirely. Only Traditional, SEP, and SIMPLE IRAs count.
• Your 401(k) or other employer plan balances are also excluded from the pro-rata calculation. That exclusion is the key to the main fix.
• The rule applies each year independently. If you've been making nondeductible contributions for years and never tracked them on Form 8606, you may have a basis you're not claiming, which means you've already been over-paying taxes on distributions.

The biggest watchout is the rollover IRA. Many high earners accumulate one from a previous employer's 401(k). It often holds $200,000, $500,000, or more in pre-tax dollars. That balance alone can make backdoor Roth contributions nearly worthless from a tax standpoint for years.

Also worth noting: making the nondeductible contribution and then waiting months to convert doesn't help you avoid pro-rata. Some people believe a long delay between the contribution step and the conversion step creates some kind of separation. It doesn't. The IRS looks at December 31 balances, not the sequence of transactions within the year.

When This Applies vs. When It Doesn't

Here's a practical comparison.

Suppose you're a physician in your late 30s. Your income is $450,000. You can't contribute directly to a Roth IRA (the 2024 phase-out ends at $161,000 for single filers, $240,000 for married filing jointly). You make a $7,000 nondeductible Traditional IRA contribution planning to convert it. But you have a $280,000 rollover IRA from a hospital employer plan you left five years ago. Your total IRA pool is $287,000. Your after-tax basis is $7,000, or about 2.4% of the pool. Your $7,000 conversion produces roughly $168 in tax-free money and $6,832 in taxable income. The backdoor Roth barely moves the needle.

Now run the same scenario with no pre-tax IRA balance. You contribute $7,000 nondeductible, convert $7,000, and 100% of the conversion is tax-free (assuming no growth between contribution and conversion). That's the clean backdoor Roth most people envision.

The fix for the first scenario is rolling your pre-tax IRA balance into a current employer's 401(k) before December 31. Many 401(k) plans accept incoming rollovers. If yours does, moving that $280,000 rollover IRA into the plan removes it from the pro-rata calculation entirely. You then make your nondeductible IRA contribution and convert it with a zero (or near-zero) pre-tax IRA balance remaining. The conversion is clean.

This requires planning. The rollover has to settle by year-end, and not every 401(k) plan accepts rollovers. Check with your plan administrator in the third quarter if you intend to use this strategy for the current tax year.

How This Connects to Roth Conversion Strategy Broadly

The pro-rata rule is one piece of a larger framework. If you're a high earner trying to build tax-free retirement assets, the mechanics of the backdoor Roth are just the entry point. Questions about how much to convert, which years make sense given your bracket, and how a Roth conversion interacts with IRMAA surcharges or ACA premiums require a wider lens. The parent page, Roth Conversion: A Practical Guide for High Earners and Pre-Retirees, covers that fuller picture, including how to think about bracket arbitrage and the 5-year rule watchouts that determine whether conversions actually pay off over time.

Frequently Asked Questions

Does the pro-rata rule apply to Roth conversions and regular distributions the same way?

Yes. Any time you take money out of a Traditional IRA, whether as a distribution or as a conversion to Roth, the pro-rata calculation applies. The IRS aggregates all your Traditional, SEP, and SIMPLE IRA balances to determine the taxable fraction.

Can I just open a new IRA at a different bank to avoid the rule?

No. Custodian doesn't matter. The IRS aggregates all Traditional, SEP, and SIMPLE IRAs you own regardless of where they're held. Multiple accounts at multiple institutions all count as one pool.

What if I have both deductible and nondeductible contributions in the same IRA?

The basis from your nondeductible contributions is tracked on Form 8606. When you convert or distribute, the pro-rata formula uses your total basis across all IRAs divided by the total balance. Mixing contribution types in one account doesn't change the math.

What happens if I never filed Form 8606 for my nondeductible contributions?

You may have a basis you haven't claimed, which means you've been treating money as taxable that wasn't. You can file late or amended 8606 forms to establish your basis. Work with a CPA on this before assuming your contributions are lost.

Can my spouse's IRAs affect my pro-rata calculation?

No. The aggregation rule applies per individual. Your spouse's IRA balances are separate from yours for this purpose.

Is there a limit to how much I can roll into a 401(k) to clear out my IRA balance?

There's no IRS cap on rollover amounts, but your employer plan must accept the rollover and may have its own rules about timing and eligible assets. Confirm with your plan administrator before counting on this strategy.

What to Do Next

1. Pull your most recent IRA statements and add up every Traditional, SEP, and SIMPLE IRA balance you hold at any institution.
2. Check whether your current employer's 401(k) plan accepts incoming rollovers, and ask about the process and deadlines.
3. Review your Form 8606 history to confirm your nondeductible basis is accurately tracked; if you've skipped filing it in prior years, flag this for your CPA.
4. Model the after-tax cost of your planned backdoor Roth contribution against your actual pro-rata fraction before proceeding, so there are no surprises on your tax return.

The information provided is for educational purposes only and does not constitute investment, legal, or tax advice. Tax law changes frequently — verify current rules before acting. Consult with qualified professionals for guidance specific to your situation.