Responsible AI
CareCore answers carer calls and family messages, and turns them into rota changes, tasks, incidents and escalations. This policy states plainly what that assistant is permitted to do, where it is blocked, how it is supervised, and what rights you have when it is involved in something about you.
Principles
Each is enforced in the system's behaviour, not only stated here.
The assistant may act only inside a fixed set of operational actions. Everything else is a handover, never a guess.
Every AI-handled call or message stores the detected intent, confidence, the policy extract relied upon and the records created.
Clinical, safeguarding and out-of-scope matters are routed to a named coordinator through the on-call chain with time-to-human recorded.
Callers and family members are told they are speaking to an assistant and can ask for a person at any point in the conversation.
Only the transcript snippet, message text and retrieved policy extract are sent to a model. Never a full client record. No training on your data.
Every AI-created task, incident or escalation can be reopened, amended or withdrawn by a coordinator, with the change audited.
Permitted actions
This is the complete operational scope. Anything not on this list is a human handover.
Prohibited actions
These are hard boundaries. The assistant defers to a person rather than attempting them.
Confidence gating
Certainty determines behaviour. Low certainty produces a handover, not a plausible-sounding answer.
| Situation | Behaviour |
|---|---|
| High confidence, in scope | The assistant answers or acts, records the action and confirms with a reference number. |
| Medium confidence | The assistant asks a clarifying question rather than acting. If still unclear, it logs a task for a coordinator instead of guessing. |
| Low confidence or out of scope | No action is taken on the caller's behalf. The thread is marked as needing a human, a coordinator is paged, and the caller is told a person will come back to them. |
| Any urgency signal | Falls, injuries, missed visits, safeguarding language and distress bypass confidence entirely — an incident and escalation are raised immediately and a human is paged. |
| Write failure | If a record cannot be written, the assistant does not claim success. It forces a human handover and pages the coordinator. |
Human oversight
Meaningful oversight means a person can see the reasoning and reverse the outcome.
Managers see every AI-created record in the same queues as human-created ones, tagged with source: ai.
Call and thread detail pages show the reasoning trail: intent, confidence, retrieved policy and resulting records.
Coordinators can override, reassign, amend or withdraw any AI decision; the override is written to the audit log.
A registered manager is accountable for AI-assisted operations at each agency, as part of their CQC responsibilities.
Persistent misrouting can be corrected by editing the knowledge base — the behaviour changes without a code release.
Models
Models are used for inference only. Care content is not used to train or fine-tune any model, and material changes to triage behaviour are logged.
| Use | Capability | Notes |
|---|---|---|
| Speech-to-text (calls) | Deepgram Nova-3 with care-specific vocabulary boosting | Diarised, UK English |
| Voice responses | Managed text-to-speech with tone steering | Cached audio, private storage |
| Call & message triage | Managed frontier LLM via the AI gateway | Inference only, no training |
| Knowledge retrieval | Retrieval over the agency's own knowledge base | Extracts stored with each answer |
Accuracy & fairness
AI performance in care has to be measured, not assumed.
Your rights
Plain-language rights for service users, families and carers.
Questions about AI use: privacy@carecore.app. Your care agency remains the data controller and the decision maker for your care.