Skip to main content
Bug Triage

Stop Triaging by Gut: A Narrow Question for Bug Triage

A contrarian take on bug triage: stop treating every bug as urgent. Learn why severity and priority must be separate and how to set a triage cadence that scales.

Should you triage every new bug immediately?

No. The conventional wisdom says you should triage every incoming bug the moment it lands. That's wrong, and it's why your triage meeting feels like a treadmill. If you drop everything to assess each new bug as it arrives, you'll spend your day context-switching, and you'll still miss the ones that matter. Instead, batch your triage. Set a fixed cadence — say, twice a day or once every morning — and let the queue build between sessions. This sounds counterintuitive, but it forces you to look at the whole picture before you assign severity and priority. You'll make better calls because you're comparing bugs against each other, not just reacting to the loudest reporter.

The fact base backs this up indirectly: a simple, effective workflow is Open → In Progress → In Review → Done → Closed, with an optional Triage step (Atlassian). That optional step is where you decide if a bug is real, how bad it is, and who should fix it. If you're doing that for every bug the second it arrives, you're not triaging — you're firefighting. Batch it.

What's the difference between severity and priority, and why does it matter?

Severity measures how much a bug affects system functionality or user experience. Priority measures how urgent it is to fix. They are not the same thing (Atlassian). A crash on a rarely used admin page might be high severity but low priority. A typo on the homepage might be low severity but high priority because it's customer-facing. If you conflate them, you'll either fix cosmetic issues while your checkout flow burns, or you'll ignore a data-loss bug because it only affects one user.

Here's the blunt advice: never let a reporter set priority. They can tell you severity — what broke, how badly — but priority is your call, based on business impact, workarounds, and timing. Train your team to ask: “What's the severity?” and then separately, “What's the priority?” Write both down. If you don't, you'll end up with a backlog full of “critical” bugs that are actually minor annoyances.

For security vulnerabilities, severity gets quantified with CVSS, which scores impact across Base, Threat, Environmental, and Supplemental metric groups (FIRST). The qualitative ratings map numeric scores to None (0.0), Low (0.1–3.9), Medium (4.0–6.9), High (7.0–8.9), and Critical (9.0–10.0). That's a useful model even for non-security bugs: a numeric scale forces you to justify your rating. But don't blindly copy CVSS for functional bugs — it's designed for vulnerabilities, not UI glitches. Use it as inspiration, not gospel.

How do you handle the flood of “not a bug” and duplicate reports?

You don't. You close them fast and move on. Common alternative states in a bug lifecycle include Rejected, Duplicate, Deferred, Reopened, Not a Bug, and Non-Reproducible (Atlassian). Your triage process should have a clear path for each. If a report is a duplicate, link it to the original and close it. If it's not reproducible, ask for more info once, then close it if you don't hear back. Don't let these linger in a “needs triage” state forever — that's how backlogs rot.

But here's the nuance: a high rate of “not a bug” reports is a signal. It might mean your documentation is unclear, your UI is confusing, or your testers need training. Track your defect rejection ratio: rejected defects divided by total reported, times 100 (Atlassian). If it's above, say, 20%, you have a communication problem, not a bug problem. Fix the source.

Also, watch for defects that are really feature requests. Those should go to your product backlog, not your bug tracker. Mixing them pollutes your metrics and makes triage harder.

What's the right cadence for triage, and who should be in the room?

Twice a week is often enough for most teams. Daily is overkill unless you're shipping continuously and have a dedicated QA team. The key is consistency: pick a time, stick to it, and keep the meeting short. Who attends? A triage lead (usually a QA lead or engineering manager), a product owner, and a representative from development. The lead runs the meeting, the product owner sets priority, and the dev rep gives feasibility input. No more than four people. If you invite everyone, you'll get debate, not decisions.

During triage, you should:

  • Confirm severity and assign priority.
  • Assign an owner or move to the backlog.
  • Close duplicates and non-reproducible bugs.
  • Flag security issues for immediate escalation.

That's it. Don't try to fix bugs in triage. Don't estimate effort beyond a rough t-shirt size. The goal is to route, not to solve.

If you're using a dedicated bug tracker like Bugzilla, you can customize fields to capture severity, priority, and environment details. Bugzilla was originally written in Tcl by Terry Weissman in 1998 for mozilla.org, and it's still used by Mozilla and hundreds or thousands of organizations (Bugzilla). But the tool doesn't matter as much as the process. You can triage effectively with Jira, GitHub Issues, or even a spreadsheet — as long as you have a cadence and clear roles.

How do you know if your triage is working?

Measure defect leakage ratio: production defects divided by total found, times 100 (Atlassian). If that number is climbing, your triage is letting too many bugs slip through. But don't obsess over it. A 2002 study prepared for NIST found that even though about 50 percent of software development budgets go to testing, software flaws still cost the U.S. economy $59.5 billion annually (NIST). You can't test everything. Triage is about risk management, not perfection.

Another metric: time-to-triage. How long does a bug sit in “New” before someone looks at it? If it's more than 48 hours, your cadence is too slow. Aim for same-day triage during business days. If you can't manage that, you're understaffed or over-reporting.

Finally, don't fall for the myth that fixing bugs earlier always saves money. A large study of 171 software projects from 2006–2014 found no evidence that issues resolved in a later phase cost consistently or substantially more effort than issues resolved soon after introduction (arXiv). The delayed issue effect is not a universal truth. So don't panic if a bug sits for a week. What matters is that you triage it, prioritize it, and fix it when it makes sense for your business.

Sources

  • Atlassian (bug life cycle) - https://www.atlassian.com/software/jira/guides/bug-tracking/bug-life-cycle
  • Atlassian (issue priority vs severity) - https://www.atlassian.com/software/jira/guides/issues/priorities
  • FIRST (CVSS v4.0 specification) - https://www.first.org/cvss/v4.0/specification-document
  • NIST (2010 combination testing news release) - https://www.nist.gov/news-events/news/2010/11/updated-nist-software-uses-combination-testing-catch-bugs-fast-and-easy
  • arXiv (Menzies et al. 2016, delayed issue effect) - https://arxiv.org/abs/1609.04886

Share this article:

Comments (0)

No comments yet. Be the first to comment!