Xray
daily rollups 1h 6h 24h 48h 3d 5d 7d 14d 30d ‹
Last 14 days▾
Ends now. Anything up to this cluster's 30-day retention.
Start and end times
Cancel
Interpreted in UTC (change it at the right of this bar). Earliest available: 2026-10-19 19:40:37.
› →|
updated 1d ago
Sample data. This database was generated by scripts/seed_dev_db.py — every service, deploy, person and figure on this page is synthetic. Names are sample.*@seed.invalid and image tags are prefixed SEED-. Nothing here happened.
← findings

Neo4j shared Neo4j, database automation: 37 Cypher queries failed in the last 15 min

critical Neo4j queries failing master open impact 81 opened 26d ago · last observed 1d ago · observed 366× · #5693 · c73a196c2ae79ddda90d

What happened ai

In the last 15 minutes, 37 Cypher queries failed in the shared Neo4j database (automation) for project tilda-trial-dev. Environment: shared. Database: automation. Failed queries: 37. Time window: 15 minutes.

A Neo4j database failing Cypher executions (its own db_query_execution_failure_total): syntax or constraint errors, deadlocks, timeouts, auth -- each one a request that did not get its data.

First look — investigated before anyone looked

Cause not clear from logs and recent changes; shared Neo4j database 'automation' (project tilda-trial-dev) had 37 failed Cypher queries in the last 15 min, 366 occurrences since 2026-10-23 19:21 UTC.
Checked: 12 autosync config deploys in the 24 h before onset (closest: execsvc 57 min and studiosvc 55 min before). None has an image tag, commit or error line tying it to Neo4j.
None of the 6 error shapes in the bundle comes from neo4j or names a Cypher query. execsvc 'no result from branch evaluation' first appeared 2026-11-13, weeks after onset.
No earlier episodes and no other findings opened at the same time.
Next step: open the Neo4j error logs for this window, read the Cypher error text, and find which client service sends the failing queries to 'automation'.

low confidence

claude-opus-5-5 · 1d ago · $0.04 — every link above is evidence it read; nothing else was claimed.

The facts

envshared
databaseautomation
failed37
window_min15
projecttilda-trial-dev
discriminatorautomation
window2026-11-17 10:25:41 UTC → 2026-11-17 10:40:41 UTC

The story — No deploy or hand change is recorded in the hour before this opened.

History

  • 2026-11-15 01:08:50 UTCescalated x-ray · severity=critical was=warning title=Neo4j shared Neo4j, database automation: 30 Cypher queries failed in the last 15 min level=high was_level=medium finding={'id': 5693, 'fingerprint': 'c73a196c2ae79ddda90d', 'kind': 'neo4j.errors', 'severity': 'critical', 'cluster': 'master', 'subject': 'neo4j shared/automation', 'title': 'Neo4j shared Neo4j, database automation: 30 Cypher queries failed in the last 15 min', 'facts': {'env': 'shared', 'database': 'automation', 'failed': 30, 'window_min': 15, 'window': [1794704030, 1794704930], 'project': 'tilda-trial-dev', 'discriminator': 'automation'}, 'evidence': [{'label': 'Neo4j tab (failures / min by database)', 'href': '/neo4j?cluster=master&from=1794683330&to=1794704930'}, {'label': 'Neo4j error logs', 'href': '/logs?cluster=master&from=1794704030&to=1794704930&service=neo4j&severity=ERROR'}], 'provenance': {'source': 'live', 'note': 'Managed Prometheus: neo4j db_query_execution_failure_total'}, 'impact': 76.0, 'status': 'open', 'first_seen': 1792783281, 'last_seen': 1794704930, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 338, 'narrative': 'Neo4j queries failing: Neo4j shared Neo4j, database automation: 27 Cypher queries failed in the last 15 min. Facts: env shared, database automation, failed 27, window_min 15, project tilda-trial-dev.', 'narrative_kind': 'template', 'discriminator': 'automation', 'level': 'high', 'told_level': None, 'episode_at': 1792783281, 'chat_thread': None, 'kind_label': 'Neo4j queries failing', 'group': 'Neo4j', 'age_s': 1921655, 'stale_s': 6}
  • 2026-11-15 02:26:17 UTCescalated x-ray · severity=critical was=warning title=Neo4j shared Neo4j, database automation: 36 Cypher queries failed in the last 15 min level=high was_level=medium finding={'id': 5693, 'fingerprint': 'c73a196c2ae79ddda90d', 'kind': 'neo4j.errors', 'severity': 'critical', 'cluster': 'master', 'subject': 'neo4j shared/automation', 'title': 'Neo4j shared Neo4j, database automation: 36 Cypher queries failed in the last 15 min', 'facts': {'env': 'shared', 'database': 'automation', 'failed': 36, 'window_min': 15, 'window': [1794708677, 1794709577], 'project': 'tilda-trial-dev', 'discriminator': 'automation'}, 'evidence': [{'label': 'Neo4j tab (failures / min by database)', 'href': '/neo4j?cluster=master&from=1794687977&to=1794709577'}, {'label': 'Neo4j error logs', 'href': '/logs?cluster=master&from=1794708677&to=1794709577&service=neo4j&severity=ERROR'}], 'provenance': {'source': 'live', 'note': 'Managed Prometheus: neo4j db_query_execution_failure_total'}, 'impact': 76.0, 'status': 'open', 'first_seen': 1792783281, 'last_seen': 1794709577, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 340, 'narrative': 'Neo4j queries failing: Neo4j shared Neo4j, database automation: 6 Cypher queries failed in the last 15 min. Facts: env shared, database automation, failed 6, window_min 15, project tilda-trial-dev.', 'narrative_kind': 'template', 'discriminator': 'automation', 'level': 'high', 'told_level': None, 'episode_at': 1792783281, 'chat_thread': None, 'kind_label': 'Neo4j queries failing', 'group': 'Neo4j', 'age_s': 1926302, 'stale_s': 6}
  • 2026-11-16 10:19:38 UTCescalated x-ray · severity=critical was=warning title=Neo4j shared Neo4j, database automation: 30 Cypher queries failed in the last 15 min level=high was_level=medium finding={'id': 5693, 'fingerprint': 'c73a196c2ae79ddda90d', 'kind': 'neo4j.errors', 'severity': 'critical', 'cluster': 'master', 'subject': 'neo4j shared/automation', 'title': 'Neo4j shared Neo4j, database automation: 30 Cypher queries failed in the last 15 min', 'facts': {'env': 'shared', 'database': 'automation', 'failed': 30, 'window_min': 15, 'window': [1794823478, 1794824378], 'project': 'tilda-trial-dev', 'discriminator': 'automation'}, 'evidence': [{'label': 'Neo4j tab (failures / min by database)', 'href': '/neo4j?cluster=master&from=1794802778&to=1794824378'}, {'label': 'Neo4j error logs', 'href': '/logs?cluster=master&from=1794823478&to=1794824378&service=neo4j&severity=ERROR'}], 'provenance': {'source': 'live', 'note': 'Managed Prometheus: neo4j db_query_execution_failure_total'}, 'impact': 76.0, 'status': 'open', 'first_seen': 1792783281, 'last_seen': 1794824378, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 352, 'narrative': 'Neo4j queries failing: Neo4j shared Neo4j, database automation: 10 Cypher queries failed in the last 15 min. Facts: env shared, database automation, failed 10, window_min 15, project tilda-trial-dev.', 'narrative_kind': 'template', 'discriminator': 'automation', 'level': 'high', 'told_level': None, 'episode_at': 1792783281, 'chat_thread': None, 'kind_label': 'Neo4j queries failing', 'group': 'Neo4j', 'age_s': 2041107, 'stale_s': 10}
  • 2026-11-17 10:40:41 UTCescalated x-ray · severity=critical was=warning title=Neo4j shared Neo4j, database automation: 37 Cypher queries failed in the last 15 min level=high was_level=medium finding={'id': 5693, 'fingerprint': 'c73a196c2ae79ddda90d', 'kind': 'neo4j.errors', 'severity': 'critical', 'cluster': 'master', 'subject': 'neo4j shared/automation', 'title': 'Neo4j shared Neo4j, database automation: 37 Cypher queries failed in the last 15 min', 'facts': {'env': 'shared', 'database': 'automation', 'failed': 37, 'window_min': 15, 'window': [1794911141, 1794912041], 'project': 'tilda-trial-dev', 'discriminator': 'automation'}, 'evidence': [{'label': 'Neo4j tab (failures / min by database)', 'href': '/neo4j?cluster=master&from=1794890441&to=1794912041'}, {'label': 'Neo4j error logs', 'href': '/logs?cluster=master&from=1794911141&to=1794912041&service=neo4j&severity=ERROR'}], 'provenance': {'source': 'live', 'note': 'Managed Prometheus: neo4j db_query_execution_failure_total'}, 'impact': 76.0, 'status': 'open', 'first_seen': 1792783281, 'last_seen': 1794912041, 'resolved_at': None, 'acked_by': None, 'acked_at': None, 'snoozed_until': None, 'occurrences': 366, 'narrative': 'Neo4j queries failing: Neo4j shared Neo4j, database automation: 9 Cypher queries failed in the last 15 min. Facts: env shared, database automation, failed 9, window_min 15, project tilda-trial-dev.', 'narrative_kind': 'template', 'discriminator': 'automation', 'level': 'high', 'told_level': None, 'episode_at': 1792783281, 'chat_thread': None, 'kind_label': 'Neo4j queries failing', 'group': 'Neo4j', 'age_s': 2128770, 'stale_s': 10}

Check it yourself

Every link carries the finding's own time window, so it shows tomorrow what it shows now.

Actions

Sign in (IAP) to acknowledge, snooze or resolve.

Where the numbers come from

sourcelive
noteManaged Prometheus: neo4j db_query_execution_failure_total
detectorneo4j_errors