top of page

As The Tax World Turns: IRS Layoffs—A Crisis in the Making?

  • Jose Ortiz, CPA, CTC
  • Mar 18
  • 5 min read

The IRS Shrinks, But Scrutiny Grows: Why High Earners and Business Owners Are the New Targets
The IRS Shrinks, But Scrutiny Grows: Why High Earners and Business Owners Are the New Targets

Welcome back to As The Tax World Turns, where we break down the biggest tax stories of the month and explain what they really mean for you. If you caught our debut column—The IRS Funding Rollercoaster—you already know the IRS’s funding has been unstable for years, leading to swings in enforcement, customer service, and overall efficiency.


Now, the inevitable has happened. The IRS has announced mass layoffs, cutting thousands of employees, including staff from taxpayer services, enforcement, and the Taxpayer Advocate Service.


Some are celebrating, assuming fewer IRS employees means fewer audits and less enforcement. But this reaction is shortsighted. Those who understand how the system actually works know these layoffs won’t eliminate IRS scrutiny—they’ll make the agency more aggressive, more automated, and more frustrating to deal with.


If you thought dealing with the IRS was a nightmare before - grab a beer my friend, and just wait.



What’s Happening at the IRS?


Recent reports confirm that the IRS is laying off between 6,000 to 7,000 employees, many of whom were hired as part of the agency’s recent expansion efforts. These cuts disproportionately affect:


  • The Taxpayer Advocate Service, which helps resolve disputes

  • Customer service representatives, who handle taxpayer inquiries

  • Audit and enforcement divisions, responsible for tax compliance


Instead of a more efficient IRS, what we’re getting is an underfunded, understaffed agency that still needs to enforce tax laws but now has fewer trained professionals to do the job properly. That’s not a win—it’s a warning sign.


Why These Layoffs Will Hurt Taxpayers


1. Expect Even Longer IRS Response Times


The IRS was already overwhelmed. Now, with fewer agents available, expect severe delays.


  • Need to correct an IRS error? Be prepared to wait months.

  • Need a tax refund reissued? Don’t count on it anytime soon.

  • Facing an IRS notice that makes no sense? You might not get a resolution before next tax season.

The people celebrating these layoffs today will be the same ones complaining when they’re stuck in limbo, unable to get through to a real person at the IRS.


2. More Automated Audits—And More Mistakes


A smaller IRS workforce does not mean fewer audits. It means more reliance on automation and artificial intelligence to flag tax returns. The problem? These systems lack the ability to distinguish between a legitimate tax strategy and an actual violation.


For business owners, investors, and high earners, this means:


  • Deductions being disallowed automatically with little explanation

  • Increased audits triggered by flawed algorithms

  • More time and money spent defending tax positions that were 100% legal


Those who think these layoffs mean they’re safe from IRS scrutiny are in for a rude awakening when a computer flags their return and no one is available to resolve the issue efficiently.


3. The IRS Will Go After Easier Targets—High Earners and Business Owners


Billionaires have armies of lawyers and accountants who can drag the IRS through endless legal battles. With fewer enforcement agents and less financial power to fight drawn-out cases, the IRS is less prepared than ever to take on the ultra-wealthy.

So, what’s the alternative? Go after the next best thing—high earners and business owners.


  • The IRS knows that an entrepreneur making $500,000 a year doesn’t have a billion-dollar legal team to fight back.

  • They know that a real estate investor with a few properties will likely settle rather than go through a lengthy audit battle.

  • They know that small and mid-sized businesses don’t have the time or resources to spend years litigating a tax dispute.


This isn’t speculation. The IRS has publicly stated that it plans to increase audits on taxpayers earning over $400,000, while easing enforcement on lower-income filers. Anyone who thinks these layoffs mean less IRS scrutiny simply doesn’t understand how enforcement works.


The Taxpayer Bill of Rights—Know Your Protections


The Taxpayer Bill of Rights (TBOR) was created to ensure fair treatment for taxpayers. With fewer IRS employees available to handle disputes, knowing these rights is more critical than ever:


  • The Right to Be Informed – The IRS must explain tax laws and procedures clearly.

  • The Right to Quality Service – You are entitled to professional, timely assistance.

  • The Right to Challenge the IRS and Be Heard – You can object to IRS findings and provide supporting documentation.

  • The Right to Appeal an IRS Decision – You have the right to an independent review of disputes.

  • The Right to Finality – The IRS must provide clear deadlines for actions and disputes.

  • The Right to Representation – You can hire a tax professional to handle interactions with the IRS.


These rights don’t mean much if you don’t have someone advocating for you. With fewer IRS employees available, the burden of proving your case will fall even more heavily on taxpayers.


What You Should Be Doing Right Now


1. Bulletproof Your Tax Strategy


Hoping the IRS will overlook something is not a strategy—it’s a mistake. Now is the time to make sure your tax return is airtight, well-documented, and prepared with a long-term strategy in mind.


2. Expect Delays and Plan Accordingly


  • File early to minimize refund delays.

  • Keep meticulous records in case an automated audit flags your return.

  • Be prepared for IRS mistakes and have a plan to resolve them.


3. Work With Experts, Not a Robotic Tax Preparer


If your tax situation is even remotely complex, relying on automated tax software or an average CPA is a risk. You need someone who can:


  • Proactively structure your tax return to minimize audit risk

  • Prepare airtight documentation for every deduction

  • Defend your tax return when the IRS comes knocking


A robotic tax preparer will follow formulas. The IRS’s new automated system will follow formulas. If those formulas conflict, who do you think the IRS will believe? If you can’t advocate for yourself, or you don’t have an expert who can, you’ll be stuck fighting a losing battle.


Final Thoughts: The IRS Is Shrinking, But Scrutiny Is Growing


The IRS layoffs are not a sign that tax enforcement is going away. If anything, they signal a shift toward less human oversight, more automation, and a more aggressive stance against high earners and business owners.


Billionaires will continue to hide behind legal teams, offshore structures, and tax loopholes that require years of litigation to challenge. Meanwhile, entrepreneurs, real estate investors, and high-income professionals will be the ones dragged through audits, compliance checks, and scrutiny because the IRS sees them as easy wins.


Those celebrating today might not be so thrilled when they’re hit with an IRS notice they don’t understand, can’t resolve, and don’t have the expertise to fight.

For those who actually understand the tax system, the message is clear: Now is the time to get serious about tax planning. Because as As The Tax World Turns, those who are prepared will always come out ahead.


Let’s Determine If Tax Planning Is a Win for You


Tax planning isn’t just about minimizing your tax bill—it’s about maximizing your wealth, protecting your assets, and strategically using your money to build long-term financial success.


But is it the right move for you? Let’s find out.


Instead of a generic tax consultation, we offer something different: a Value Conversation. This is a collaborative discussion where we work together to determine whether tax planning is truly worth it for you.


We’ll identify your biggest financial goals and pain points

We’ll quantify the potential savings and long-term benefits

We’ll determine whether tax planning is a strategic win for your situation


This isn’t a sales pitch—it’s an opportunity to evaluate the numbers, explore the possibilities, and make an informed decision together.


If you’re ready to see whether strategic tax planning is a financial advantage for you, let’s start the conversation.



And stay tuned for next month’s As The Tax World Turns, where we’ll continue exposing what the average CPA won’t tell you.

 
 
 

Comments


Transparent Logo
  • Instagram
  • Facebook
  • LinkedIn

© 2024 The Scale Collective  |  All Rights Reserved |  Privacy Policy

bottom of page