Where to Hold Bonds: The Account Order That Saves Tax

Where to Hold Bonds: The Account Order That Saves Tax

Where to hold bonds is one of those questions that sounds minor and turns out to be worth real money: if you have a traditional IRA, a Roth IRA and a regular brokerage account, putting your bond funds in the right one can add a bit of after-tax return every year without changing your overall mix at all. Vanguard’s research puts the typical gain at roughly 5 to 30 basis points a year, which is 0.05% to 0.30%.

That might not sound dramatic, but it doesn’t change your overall risk and it repeats every year. In this post I’ll show the account order Vanguard tested, why bond interest is the thing that makes location matter, a worked example with exact numbers, the exceptions, and a short checklist for moving things around without creating a tax mess.

The Quick Rule

Vanguard’s study tested the conventional wisdom and found it held up for most investors. The conventional order for bonds is:

  1. Traditional IRA or 401(k) first.
  2. Roth IRA second.
  3. Taxable brokerage account last.

The paper calls this “TRX,” meaning Traditional, Roth, taxable. It concluded that “the conventional TRX rebalancing strategy is still wealth-maximizing” for most investors. The stocks go in the opposite direction: taxable accounts hold the stock funds, where unrealized gains can be taxed at long-term rates.

If you only have one account, there’s nothing to optimize and you can stop reading. If you have two or more, keep going.

Why Bond Interest Is the Problem

The reason is how bond income is taxed. According to IRS Topic 403, most interest is taxable income in the year it becomes available to you. It isn’t taxed at the long-term capital gains rates that apply to gains on assets held more than a year.

There are two notable exceptions in the IRS guidance:

  • Treasury interest is subject to federal income tax but exempt from state and local income taxes.
  • Municipal bond interest from some bonds issued by a state, the District of Columbia or a territory to finance government operations is reportable but not taxable at the federal level, per IRS Topic 403.

Stocks are different. Long-term capital gains tax rates are 0%, 15% or 20% depending on taxable income and filing status, according to IRS Topic 409, and a gain isn’t taxed until you sell. By my own reasoning from those two rules, bond interest in a taxable account gets taxed every year at ordinary rates, while stock gains wait until you sell and then get the capital gains rates. That’s the basic reason the conventional order puts bonds in the places where interest isn’t taxed each year.

In a tax-advantaged account such as a 401(k) or IRA, Schwab says selling within the account won’t result in current taxes, and taxes are due only when you make withdrawals.

What Vanguard Found

The Vanguard paper modeled a 20-year horizon with glide-path allocations and rebalancing, using 10,000 return paths from its capital markets model. Key findings:

  • Asset location added roughly 5 to 30 basis points of annualized after-tax return compared with holding the same mix in every account.
  • In the baseline case (a conservative glide path with 37% and 24% tax rates), the gain was 19 basis points with no step-up in basis and 34 basis points with a full step-up.
  • The benefit was larger for investors in higher tax brackets, those who bequeath more of their taxable account, and those with more bond-heavy allocations.

Step-up in basis means that if heirs inherit investments, their cost basis resets to the market value at death, which can erase taxes on past gains. That’s why the benefit is bigger when more of the taxable account is passed on.

The paper also noted important caveats: projections are hypothetical, not guarantees, and results depend on the assumptions. Foreign holdings and foreign tax credits were left out.

The Exception Worth Knowing

The paper’s conclusion included a twist. For investors who hold actively managed equity and who spend a significant portion of their assets during their lifetime, it may be better to shift stocks toward the Roth account and put some bonds in the taxable account. In other words, the Roth’s tax-free growth is valuable enough that the highest-returning asset might belong there.

For most people with index funds, the conventional order is the one that held up. If you hold actively managed stock funds, or expect to spend down a large share of your portfolio, this is the exception Vanguard describes.

A Worked Example: Mina’s $400,000

Here’s an invented example so you can see the dollars. Mina has three accounts:

AccountBalance
Traditional IRA$200,000
Roth IRA$100,000
Taxable$100,000

Total: $400,000. She wants 60% stocks and 40% bonds across everything. That’s $240,000 in stocks and $160,000 in bonds.

Option 1: same mix in every account. Each account holds 60/40, so the taxable account holds $40,000 in bonds.

Option 2: bonds placed by the conventional order.

  • Traditional IRA ($200,000): all $160,000 of bonds plus $40,000 of stocks
  • Roth IRA ($100,000): $100,000 of stocks
  • Taxable ($100,000): $100,000 of stocks

Check that it adds up: stocks $40,000 + $100,000 + $100,000 = $240,000. Bonds $160,000. Same 60/40 overall.

Now compare the yearly tax on bond interest. Assume bonds yield 4% and Mina’s tax rate on interest is 24%. Both are assumptions for illustration.

  • Interest in taxable account under Option 1: $40,000 × 4% = $1,600
  • Tax on that interest at 24%: $384 per year
  • Under Option 2: $0 current tax, since there are no bonds in the taxable account

If we apply Vanguard’s range of 5 to 30 basis points to $400,000, that works out to about $200 to $1,200 a year. That’s a rough translation of the paper’s percentages, not a result from the paper itself. Your own gain depends on your tax bracket, yields and how long you hold.

Notice what didn’t change: Mina’s overall allocation is still 60/40. She didn’t take on any extra risk. She just moved where each piece sits.

Think of Your Accounts as One Portfolio

The core habit this requires is looking at all accounts together. The Vanguard model treats the accounts as one pool and decides which holdings go where.

Here’s a way to do it:

  1. Add up each account’s balance.
  2. Decide the overall stock/bond split.
  3. Calculate the dollar amount of bonds you need in total.
  4. Fill your traditional account or 401(k) with bonds first.
  5. If bonds are left over, fill the Roth next.
  6. Put whatever is left in taxable, and keep stocks there.
  7. Use the rest of the traditional and Roth for stocks.

If your traditional account is too small to hold all your bonds, you’ll end up with some in the Roth or taxable account. That’s fine. The order just tells you which to fill first.

The Munis and Treasuries Question

Because taxable accounts are the last place you’d put bonds, you might wonder what to do when you must hold some there. Two options to know about:

  • Treasuries. Per the IRS, interest on Treasury bonds, notes and bills is exempt from state and local income taxes. If you live in a state with an income tax, that could matter for holdings in a taxable account.
  • Municipal bonds. The IRS says interest on bonds issued by a state or territory to fund government operations is exempt from federal income tax. In my view, whether it makes sense depends on your tax bracket and the yield you’d give up.

Moving Things Without Creating a Tax Bill

Switching holdings between accounts takes care. Here’s how to avoid surprises.

  • Inside an IRA or 401(k), selling doesn’t create current taxes. Schwab says selling within these accounts won’t result in current taxes.
  • In a taxable account, selling is a taxable event. If you hold stock funds there and want to sell for any reason, gains are taxed, and the long-term rate applies after more than a year, per the IRS.
  • Use new contributions first. Instead of selling to rearrange, direct new money to the right account and fund. My post on rebalancing without selling shows how.
  • Don’t swap in the taxable account unless needed. If your taxable account already holds bond funds, you can stop adding to them and let new money go elsewhere.

A Short Checklist

  1. List every account with its type and balance.
  2. Write down your overall stock/bond target.
  3. Calculate the total dollars you need in bonds.
  4. Place bonds in the order traditional, Roth, taxable.
  5. Place stocks in the remaining space, with index funds in taxable accounts.
  6. Make changes using new contributions where you can.
  7. Review once a year.

Four Common Setups and What the Order Says

Here is how the conventional order plays out for people with different account mixes. These are plain applications of the order above, not personal advice.

Mostly a 401(k), plus a small brokerage account. Where to hold bonds is simple: in the 401(k). Keep the brokerage account for stock index funds, and send any new brokerage money there.

A traditional IRA and a Roth IRA, nothing taxable. Bonds go to the traditional IRA first. If you have more bonds than room, the rest goes to the Roth. Both accounts are shielded from yearly tax, so the order matters less than in a setup that includes a taxable account.

A Roth IRA and a taxable account, no traditional account. With no traditional account, the order puts bonds in the Roth before the taxable account. The exception Vanguard describes, moving stocks into the Roth for investors with actively managed funds and heavy spending, is the exception to know about.

A large taxable account and a small retirement account. The retirement account may be too small to hold all your bonds. Fill it with bonds first, and then keep the remaining bonds in the taxable account in a form that suits your bracket, such as a Treasury or municipal fund.

Mistakes That Waste the Benefit

  • Holding the same mix in every account out of habit. It’s tidy, but it puts bond interest in the taxable account.
  • Forgetting accounts at old employers. A forgotten traditional 401(k) can be a place for bonds.
  • Selling in a taxable account just to rearrange. The IRS treats a sale as a taxable event, so use new contributions instead where you can.
  • Letting the tax tail wag the dog. The order is a way to squeeze out a small extra return, not a reason to change your overall stock and bond split.
  • Ignoring the exception. If you hold actively managed stock funds or plan to spend heavily, Vanguard says the Roth may be a better home for stocks.

When you ask yourself where to hold bonds, keep the answer short: retirement accounts first, in the order above, and taxable accounts last.

Let AI Build Your Placement Map

Paste this into an AI assistant and fill in your numbers.

Help me decide where to hold bonds across my accounts, using ONLY the numbers I give you.

My accounts and balances: [traditional IRA/401(k): $__, Roth IRA: $__, taxable: $__]
My target overall allocation: [e.g., 60% stocks / 40% bonds]
What I currently hold in each account: [list with dollar amounts]
My federal marginal tax rate (if I know it): [percent]
Do I hold actively managed funds or index funds? [type]
Do I expect to spend a large part of this portfolio in my lifetime? [yes/no/unsure]

Rules:
- Ask me for anything missing before you calculate.
- Treat all my accounts as one portfolio and show the total dollars needed in bonds.
- Show the conventional order (traditional, then Roth, then taxable) as a table with dollar amounts in each account, and show every calculation step by step.
- Estimate the yearly tax on bond interest in a taxable account using an assumed yield that I can change, and label it clearly as an assumption.
- Note the exception Vanguard identified for investors with actively managed stock funds or heavy spending, and tell me to check with a tax professional.
- Do not predict returns or recommend specific funds.
- End with a list of questions for my tax professional.

My Take: Location Is a Small Win You Can Actually Use

I think this is one of the more satisfying money moves because it doesn’t ask you to take more risk. You’re not picking better investments or timing anything. You’re just putting the same investments in different places.

The benefit isn’t huge, and Vanguard is honest about that with its 5 to 30 basis point range. But it’s repeatable, it applies every year, and it’s easiest to set up when you’re already adding new money. If your accounts are small, don’t stress about it. If they’re large or growing, it’s worth an hour.

Questions People Ask About Bonds and Accounts

Do I need to do this if I only have a 401(k)? No. With a single account there’s nothing to place. The question only comes up when you have two or more types of accounts.

Is bond interest really taxed every year? According to the IRS, most interest is taxable in the year you earn it. Treasury interest is exempt from state and local tax, and municipal bond interest is exempt from federal tax, as the IRS describes.

Should stocks or bonds go in my Roth IRA? In Vanguard’s conventional order, bonds go in a traditional account first, then Roth, so the Roth tends to hold stocks. The paper notes an exception for investors with actively managed equity who plan to spend heavily.

What if I’m younger and hold very few bonds? Then the benefit is smaller. Vanguard found the gain was larger for more bond-heavy allocations.

Does this change my overall risk? No, as long as your total mix across accounts stays the same. The point is to rearrange where things sit, not how much of each you hold.

Make One List of Every Account

The answer to where to hold bonds starts with a single list of all your accounts.

Open each of your accounts and write the balance and the bond holdings on one sheet of paper. If any bond funds are in your taxable account and you have room in a traditional IRA or 401(k), plan to send your next contributions into the retirement account’s bond fund, and let the taxable account hold stocks.

This post is general information, not financial, tax or legal advice, and it does not recommend buying or selling any security. Tax rules and your own situation matter a great deal, so confirm details with the IRS or a qualified tax professional.

Sources: