Back to Blog
Industry InsightsJuly 10, 20266 min read

What AI Shouldn't Do in Home Care (From a Company That Builds It)

Ibrahim E.

CareCade Foundation

What AI Shouldn't Do in Home Care (From a Company That Builds It)

Draft, Never Decide

Simplify Your Home Care Operations

CareCade helps DDA and HCBS providers manage scheduling, EVV, and billing in one platform.

AI in home care should draft, never decide. It belongs in documentation, scheduling suggestions, and anomaly detection. It does not belong in clinical judgment, eligibility determinations, unsupervised family communication, or hiring decisions. The 2026 "agentic AI" wave — software that acts autonomously instead of waiting for approval — makes that line more important, not less.

That's our position, and we have skin in the game on both sides of it. CareCade ships AI-drafted DSHS reports, AI session-note assistance, and AI-assisted scheduling. We're not AI skeptics. We're AI users who read our own industry's marketing and wince.

The Hype Is Real. So Is the Ceiling.

Industry analysts predict 40% of enterprise applications will embed AI agents by the end of 2026, up from under 5% a year ago. Home care vendors — us included — are racing to ship AI features, and some of the results genuinely deliver.

The strongest evidence sits in documentation. When Mass General Brigham studied ambient AI scribes, physician burnout fell from 52.6% to 30.7% over 84 days. Documentation time dropped 20–30% across early studies. We see the same pattern with AI-drafted visit notes: caregivers spend their attention on the client instead of the keyboard.

But notice what that success has in common: the AI drafts, a human approves, and the human's name goes on the record. Every impressive AI result in care settings follows that shape. The failures come when someone removes the human from the loop.

Four Places AI Doesn't Belong

1. Clinical judgment

An AI can flag that a client's activity pattern changed this week. It cannot decide whether that's a medication issue, a mood change, or a bad data day — and it especially cannot decide what to do about it. Anomaly detection is a tip line, not a diagnosis. The caregiver who has been in that living room every Tuesday holds context no model has.

2. Eligibility and authorization decisions

The "agentic" pitch says AI will handle eligibility checks and authorizations end to end. Understand what that means in practice: software deciding whether a person receives care, at machine speed, with error rates nobody publishes. When Medicaid work requirements arrive in December, some states will automate exemption processing. Arkansas already showed us what happens when process failures meet vulnerable people — and that was just paperwork, not autonomy.

3. Unsupervised family communication

Families use portals and updates to trust care they can't witness. An AI that writes those updates without review will eventually say something untrue at the worst possible moment — a "great visit today!" message on a day the visit was missed. Trust compounds slowly and evaporates instantly. No efficiency gain covers that loss.

4. Hiring and scheduling decisions

AI matching is genuinely useful for surfacing candidates and suggesting schedules. But auto-rejecting applicants or auto-assigning caregivers without review bakes the model's blind spots into people's livelihoods. A scheduler can override a bad suggestion in three seconds. An applicant filtered out by a model never gets seen at all.

Caregiver reviewing an AI-drafted note before approving it

The Test We Use Internally

Before any AI feature ships in CareCade, it has to pass three questions:

  1. Can a human review the output before it takes effect? If not, we don't ship it.
  2. Is the failure mode boring? A wrong scheduling suggestion wastes a click. A wrong action strands a client. We ship suggestions.
  3. Does the person closest to the client stay in charge? AI that empowers the caregiver survives review. AI that replaces the caregiver's judgment doesn't.

That's why our AI-drafted DSHS reports require caregiver review before submission, why scheduling AI proposes rather than assigns, and why nothing in our platform sends a family-facing message no human approved.

Is this slower than full autonomy? Slightly. Is it why agencies can put their license behind the output? Entirely.

Questions to Ask Any Vendor (Including Us)

If a home care software vendor pitches you AI features this year, ask:

  • "What happens when it's wrong?" If the answer involves a client, a claim, or a family finding out, keep asking.
  • "Who reviews the output, and where's that logged?" Review without an audit trail is theater. (Auditors agree — see our audit-proofing guide.)
  • "Can I turn it off per-workflow?" Autonomy should be opt-in by task, not all-or-nothing.
  • "Is my client data training your model?" In a HIPAA environment, the answer needs to be specific, not reassuring.

Where This Goes

We think the industry lands where aviation did: heavy automation, human command. Autopilot flies most of every flight, and nobody boards a plane without pilots. Home care AI will draft most of every record, surface most schedule options, flag most anomalies — and a human will stay in command of every decision that touches a person.

Vendors selling full autonomy in 2026 aren't ahead of that curve. They're selling the part of the plane without the pilots.

FAQ

What is agentic AI in home care?

Agentic AI refers to systems that don't just assist but act — executing tasks like scheduling, authorizations, or documentation autonomously. Analysts predict 40% of enterprise applications will embed AI agents by the end of 2026.

Where does AI work well in home care?

Documentation drafting, scheduling suggestions, and anomaly detection — always with human review. Studies of ambient AI documentation show 20–30% documentation-time reductions and significant burnout decreases (52.6% to 30.7% at Mass General Brigham).

Where should AI not be used in home care?

Clinical judgment, eligibility and authorization decisions, unsupervised family communication, and automated hiring or scheduling decisions. In each case, the failure mode lands on a vulnerable person rather than a reviewable draft.

Does CareCade use AI?

Yes — for DSHS report drafting, session-note assistance, and scheduling suggestions. Every AI output requires human review before it takes effect, and family-facing communication is never sent without human approval.


See how human-in-the-loop AI works in practice: AI-powered DSHS reports and the CareCade platform.

Ready to transform your care management?

Join agencies across Washington who are bringing transparency to developmental disabilities care.

Send Feedback

How's your experience?