A clinical researcher studying natural voice signals in a calm research suite.
CNS Research

Multimodal longitudinal cognitive data for CNS R&D.

Real-world, longitudinal cognitive, vocal and behavioral datasets from daily senior voice conversations. Structured for biomarker discovery, digital trial endpoints, pharmacovigilance and real-world evidence.
Alzheimer's · MCI · Dementia · Geriatric depression · Parkinson's · Neurodegenerative
50K+
Sessions recorded
12+
Months longitudinal
31
Variables per session
Daily
Collection frequency
100%
De-identified
Subject anon_8f3a2c · 36-Week Trajectory
1000750500250W1W4W8W12W16W20W24W28W32W36BaselineAlertComposite scoreMood intensityClinical alert
Digital biomarkers

NLP-derived cognitive markers (TTR, MLU, coherence, idea density) validated against MoCA / MMSE — higher sensitivity to early change.

Continuous endpoints

Daily data points vs. quarterly clinical visits. Track drug efficacy with weekly resolution instead of waiting 3–6 months for the next assessment.

Real-world evidence

Naturalistic data from home environments — not artificial lab settings. Ecological validity for FDA / EMA real-world evidence submissions.

What we capture

Continuous voice-derived signal across the three CNS pillars.

Mood

Affective state inferred from vocal features, lexical markers and self-report — daily, baselined per subject.

Cognition

Composite Cognitive Index across recall, fluency, orientation, engagement — trended in 7-, 30- and 90-day windows.

Adherence

Two-way confirmed medication adherence, with missed-dose timestamps and downstream symptom correlations.

The naturalistic data advantage

Why naturalistic data changes everything.

Existing digital cognitive tools rely on structured tests. Amigo captures data from natural daily conversations — no test anxiety, no practice effects, no patient burden.

DimensionAmigoStructured test tools
Collection methodFree-form daily conversationPrompted cognitive tasks (clock drawing, picture description, card games)
FrequencyDaily — every conversation is a data pointWeekly to quarterly — scheduled sessions
Patient burdenZero — the conversation is the product (companionship)Requires active engagement in a test protocol
Practice effectsNone — no repeated test structure to learnScores improve with repeated exposure
Test anxietyNone — data collection embedded in an enjoyable daily routinePerformance anxiety can skew results
Ecological validityHigh — real speech in home environmentLow to moderate — artificial test conditions
Data modalitiesLinguistic + acoustic + behavioral + emotionalTypically 1–2 dimensions per tool
AdherenceHigh — seniors want to talkDrop-off over time — test fatigue
Longitudinal depthHundreds of sessions per subject over monthsTens of sessions at best
Cost per data pointMarginal — no clinical staff, no device provisioningHigher — supervised administration or dedicated devices

“Structured test tools” refers to digital cognitive assessment platforms based on prompted tests (clock drawing, picture description, reaction-time tasks) — a category that requires active patient engagement.

Data generation pipeline

From natural voice to research-ready structured datasets.

Every step is engineered and operated in-house, with explicit versioning at each stage and a full audit trail of how each data point was produced.

Voice Conversation
Daily · Natural · Unstructured
Amigo Speech Engine
In-house · Real-time STT
Amigo Cognitive Pipeline
31 variables · multimodal
Structured Snapshot
JSON · Versioned · Audited
De-identification & Export
GDPR · HIPAA · BAA
Data catalog

31 structured variables per session.

Across cognitive, vocal, behavioral, emotional and clinical dimensions. Schema versioned, data-dictionary delivered with every export.

FieldTypeExampleCategory
subject_idstringanon_8f3a2cID
session_datedate2026-02-28ID
call_duration_secondsint540Session
word_countint312Cognitive
type_token_ratiofloat0.68Cognitive
mean_utterance_lengthfloat8.4Cognitive
words_per_minutefloat98Cognitive
repetition_ratefloat0.05Cognitive
coherence_scoreint (1-10)8Cognitive-AI
idea_density_scoreint (1-10)7Cognitive-AI
word_finding_scoreint (1-10)9Cognitive-AI
composite_scoreint (0-1000)742Cognitive
participation_ratiofloat0.45Behavioral
turn_countint24Behavioral
engagement_qualityenumgoodBehavioral
mood_primaryenum (5)positiveMood
mood_intensityint (0-10)7Mood
alert_triggeredboolfalseAlert
alert_natureenumnullAlert
alert_severityenumnullAlert
f0_mean_hzfloat185.3Voice
f0_std_hzfloat28.7Voice
jitter_percentfloat1.12Voice
shimmer_percentfloat3.45Voice
hnr_dbfloat18.2Voice
speech_ratefloat3.8Voice
pause_ratefloat0.22Voice
mean_pause_duration_msint680Voice
composite_z_scorefloat+0.3Baseline
baseline_sessionsint12Baseline
trendenumstableBaseline

Cohort breakdown

Distribution of clinical profiles across the dataset

35%
40%
15%
10%
Mild Cognitive Impairment
Healthy Aging
Early-Stage Dementia
Geriatric Depression

Metric distribution

Sample histogram of AI-assessed coherence scores

1-22-33-44-55-66-77-88-99-10
Coherence score distribution

Voice frequency evolution

F0 mean (Hz) over 24 weeks — one subject

W1W6W10W14W18W22192180168
F0 mean (Hz)
↓ declining trend
Inside each session

What every conversation produces.

Each call generates a multi-dimensional structured snapshot. Versioned, time-stamped, and lineage-traceable.

NLP cognitive markers

Quantitative linguistic metrics from speech patterns via Amigo's deterministic NLP pipeline.

Type-Token RatioMean Utterance LengthWords/MinRepetition RateWord Count

AI cognitive scores

Higher-order language function scored by the Amigo Cognitive Engine, calibrated against clinical scales.

Coherence (1-10)Idea Density (1-10)Word Finding (1-10)Composite (0-1000)

Voice & acoustic biomarkers

Prosodic and spectral features extracted from raw audio. Validated markers for depression, Parkinson's and cognitive decline.

F0 Mean / StdJitterShimmerHNRSpeech RatePause RatePause Duration

Behavioral metrics

Engagement, participation and interaction dynamics — revealing behavioral patterns over time.

Participation RatioTurn CountEngagement QualitySpeech Duration

Mood & affect

5-class mood classification with continuous intensity scoring and session-level emotional context.

Mood Primary (5-class)Intensity (0-10)Emotional ContextAtmosphere

Clinical alerts

Structured detection of depression markers, cognitive confusion, physical complaints and safety signals.

Alert BooleanNature (4-class)Severity (4-level)Clinical Detail

Longitudinal baselines

Intra-individual z-score baselines enabling personal trajectory tracking and change detection.

Z-Score DeltasBaseline PeriodTrend DirectionSessions Count
Export schema

One conversation. One structured record.

Each record represents one session. Available in JSON, CSV or Parquet — with a versioned data dictionary and audit lineage attached.

1
Subject level
Anonymous ID, age band, gender, collection site
2
Session level
All 31 variables — cognitive, vocal, behavioral, mood, alerts
3
Voice level
F0, jitter, shimmer, HNR, pause patterns — acoustic biomarkers per session
4
Baseline level
Personal baselines, z-scores, composite evolution, trend flags
session_record.json
{
  "subject_id": "anon_8f3a2c",
  "age_band": "75-79",
  "session_date": "2026-02-28",
  "call_duration_seconds": 540,
  "cognitive": {
    "word_count": 312,
    "type_token_ratio": 0.68,
    "mean_utterance_length": 8.4,
    "repetition_rate": 0.05,
    "words_per_minute": 98,
    "coherence_score": 8,
    "idea_density_score": 7,
    "word_finding_score": 9,
    "composite_score": 742
  },
  "voice": {
    "f0_mean_hz": 185.3,
    "f0_std_hz": 28.7,
    "jitter_percent": 1.12,
    "shimmer_percent": 3.45,
    "hnr_db": 18.2,
    "speech_rate": 3.8,
    "pause_rate": 0.22,
    "mean_pause_duration_ms": 680
  },
  "behavioral": {
    "participation_ratio": 0.45,
    "turn_count": 24,
    "engagement_quality": "good",
    "user_speech_duration_s": 245
  },
  "mood": {
    "primary": "positive",
    "intensity": 7
  },
  "alert": {
    "triggered": false,
    "nature": null,
    "severity": null
  },
  "baseline_delta": {
    "composite_z_score": +0.3,
    "sessions_in_baseline": 12,
    "trend": "stable"
  }
}
Clinical validation

Grounded in peer-reviewed research.

Preliminary internal correlations with established clinical scales. External multi-site validation in progress.

Metric ↔ clinical scale correlations

Preliminary · internal validation cohort (N = 120)

Amigo metricScalerDirection
Composite ScoreMoCA0.72↑↑
Type-Token RatioMMSE0.65↑↑
Idea DensityMoCA0.68↑↑
Word Finding ScoreBNT0.71↑↑
Repetition RateMMSE-0.58↑↓
Pause RateMoCA-0.54↑↓
F0 Std (Hz)GDS-0.49↑↓
Mood IntensityGDS-0.61↑↓
JitterUPDRS-III0.52↑↑
Speech RateMoCA0.47↑↑
MoCA — Montreal Cognitive AssessmentMMSE — Mini-Mental State ExaminationGDS — Geriatric Depression ScaleBNT — Boston Naming TestUPDRS-III — Unified Parkinson's Disease Rating Scale

Validation methodology

  1. 1

    Paired assessment: Subjects completed standard clinical scales (MoCA, MMSE, GDS, BNT) within 48h of Amigo conversation sessions.

  2. 2

    Pearson correlation: Each metric was correlated with the clinically closest scale at subject level, controlling for age and education.

  3. 3

    Longitudinal sensitivity: Change scores over 6 months vs. clinical re-assessment — Amigo composite detected decline 4–8 weeks earlier than quarterly MoCA.

Grounded in published research

  • Type-Token Ratio decline as MCI marker Bucks et al., 2000; Forbes-McKay & Venneri, 2005

  • Idea density predicting AD onset Snowdon et al. (Nun Study), 1996

  • Pause patterns and speech rate in cognitive decline Hoffmann et al., 2010; Roark et al., 2011

  • F0 and jitter as depression biomarkers Cummins et al., 2015; Low et al., 2011

  • Vocal shimmer / HNR in Parkinson's disease Tsanas et al., 2012; Rusz et al., 2011

  • Spontaneous speech analysis for dementia screening Fraser et al., 2016; Luz et al., 2020

Current status
Internal validation complete · external validation in progress

Seeking academic and pharma partners for multi-site validation studies.

R&D applications

Where the data is being used.

Across neurodegenerative disease, geriatric psychiatry, clinical drug development and real-world evidence.

Alzheimer's & dementia early detection

Train models on subtle linguistic markers (declining TTR, increased repetition, reduced idea density) that precede clinical diagnosis by months or years. Longitudinal baselines enable intra-subject change detection.

Biomarker discoveryPredictive modelingPre-clinical detection

Clinical trial digital endpoints

Continuous cognitive snapshots as digital endpoints for Phase II–III trials. Weekly resolution vs. quarterly MMSE — higher sensitivity to change, lower patient burden, remote monitoring.

Digital endpointsDrug efficacyPhase II–IIIRemote monitoring

Geriatric depression & social isolation

Longitudinal mood trajectories, engagement decline patterns and alert frequency data for studying depression onset, social isolation and intervention effectiveness.

Mood trajectoriesSocial isolationIntervention studies

Real-world evidence for regulatory

Naturalistic, continuous data from real home settings. Ideal for FDA / EMA post-market surveillance, label expansion and real-world evidence packages.

RWEPost-market surveillanceFDA / EMALabel expansion

Voice & acoustic biomarker research

Track F0 decline, jitter / shimmer evolution and pause pattern changes over months. Validated vocal markers for depression screening, Parkinson's monitoring, early cognitive change.

Vocal biomarkersF0 / Jitter / ShimmerDepression screeningParkinson's

Speech & linguistic biomarker validation

Cross-validate computational linguistic and acoustic features against established clinical cognitive scales. Paired metric + score data enables robust multi-modal biomarker validation.

NLP validationLinguistic biomarkersScale calibration
Cohort fit

Built for the populations CNS trials reach hardest.

Voice-first acquisition removes most of the friction that limits digital endpoint capture in older or cognitively vulnerable populations.

Geriatric depression

Daily mood signal between site visits with weak-signal alerting.

MCI & early-stage Alzheimer's

Longitudinal cognitive markers without repeated formal testing.

Parkinson's & motor disorders

Speech-based features and adherence reporting across home setting.

Schizophrenia & bipolar

Daily affect and engagement signals between clinical contacts.

Pain & long-COVID

Patient-reported symptom and impact tracking via natural conversation.

Caregiver / dyad studies

Parallel signal capture from family informants where appropriate.

Trial integration

Built to slot into the research stack you already operate.

Voice-only acquisition

No wearables, no apps, no participant burden. The cohort answers a phone — that's it.

API-first data flow

Per-participant time-series export to your data lake. Compatible with REDCap and standard CDISC mappings on request.

Audit-grade record

Every call, transcript, score, alert and access event is timestamped, immutable and exportable.

Regulatory posture

HIPAA-aligned controls, role-based access, encryption in transit and at rest, BAA available, 21 CFR Part 11 roadmap on request.

Data quality & compliance

Designed for the assumptions sponsors and IRBs already hold.

Encryption in transit and at rest, key rotation enforced
Role-based access, audit logs, BAA available
Per-participant export, configurable retention windows
Data residency options (US, EU) per sponsor requirement
IRB-friendly consent and disclosure documentation provided
Versioned schema, NLP pipeline version, processing audit trail
Licensing

Flexible data access tailored to your program.

Snapshot

Static dataset

One-time historical export. Ideal for exploratory analysis, model training and feasibility studies.

  • Full historical cohort
  • CSV / Parquet / JSON
  • Data dictionary included
Recommended
Continuous

Live data feed

Ongoing API access with daily increments. For clinical monitoring and adaptive trial designs.

  • Real-time API access
  • Daily incremental updates
  • Webhook notifications
  • SLA-backed uptime
Custom

Research partnership

Co-designed protocol with custom metrics, targeted cohort criteria, and joint publication rights.

  • Custom NLP pipelines
  • Targeted cohort selection
  • Joint publication
  • Dedicated data engineer
For research teams

Get a sample dataset with 1,000 anonymized sessions.

No commitment. Evaluate the data before any licensing discussion. We'll come back with a fit assessment for your protocol within five business days.