# Errors in temporal history and matching service logs

**URL:** <https://community.temporal.io/t/errors-in-temporal-history-and-matching-service-logs/5198>\
**Category:** Community Support\
**Tags:** cassandra, deployment\
**Created:** [July 4, 2022, 9:17am UTC](https://community.temporal.io/t/errors-in-temporal-history-and-matching-service-logs/5198 "2022-07-04T09:17:29Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ruchir](https://sea2.discourse-cdn.com/flex016/user_avatar/community.temporal.io/ruchir/32/6141_2.png) [@Ruchir](https://community.temporal.io/u/Ruchir)\
**Post date:** [July 4, 2022, 9:17am UTC](https://community.temporal.io/t/errors-in-temporal-history-and-matching-service-logs/5198/1 "2022-07-04T09:17:29Z")

</div>

Hi,

My temporal server is deployed on GKE cluster. We are using Cassandra for it’s db layer which is also deployed on another GKE cluster. We are continously observing following errors in temporal history service logs but our workflows are being executed successfully:

```auto
"cluster-name":"active", "component":"timer-queue-processor", "error":"Failed to update shard. previous_range_id: 9, columns: (range_id=11)", "level":"error", "logging-call-at":"timerQueueAckMgr.go:402", "msg":"Error updating timer ack level for shard", "service":"history", "shard-id":555,

```

```auto
"component":"visibility-queue-processor", "error":"Failed to update shard. previous_range_id: 14, columns: (range_id=16)", "level":"error", "logging-call-at":"queueAckMgr.go:225", "msg":"Error updating ack level for shard", "operation-result":"OperationFailed", "service":"history", "shard-id":441

```

```auto
"cluster-name":"active", "component":"transfer-queue-processor", "error":"Failed to update shard. previous_range_id: 11, columns: (range_id=15)", "level":"error", "logging-call-at":"queueAckMgr.go:225", "msg":"Error updating ack level for shard", "operation-result":"OperationFailed", "service":"history", "shard-id":378,

```

We have kept our numHistoryShards value to 4096. We tried to install temporal with fresh schema, but still seeing these errors in our logs.

We also observed one error in matching service:

```auto
"component":"matching-engine", "error":"Failed to update task queue. name: /_sys/DebitCardIntegrationActivityTaskQueue/1, type: Activity, rangeID: 4, columns: (range_id=5)", "level":"error", "logging-call-at":"taskReader.go:187", "msg":"Persistent store operation failure", "service":"matching"

```

What could be the issue? Please help.

---

<div class="post-metadata">

**Author:** ![tihomir](https://sea2.discourse-cdn.com/flex016/user_avatar/community.temporal.io/tihomir/32/6580_2.png) [@tihomir](https://community.temporal.io/u/tihomir)\
**Post date:** [July 4, 2022, 2:59pm UTC](https://community.temporal.io/t/errors-in-temporal-history-and-matching-service-logs/5198/2 "2022-07-04T14:59:28Z")

</div>

What’s the server version you are using?

Are these errors transient, meaning do they happen only during pod restarts and then go away? If so they can be ignored.

If not then things you could check

- possible network issues on your side (for example btw cluster and cassandra)
- check if you are using a different membership port for different services (history/matching/frontend/worker)
- Cassandra logs/errors if this happens during high load. You can “protect” Cassandra via dynamic config values below to not push it over the limit:

`frontend.persistenceMaxQPS` - frontend persistence max qps, default 2000  
`history.persistenceMaxQPS` - history persistence max qps, default 9000  
`matching.persistenceMaxQPS` - matching persistence max qps, default 3000

- Check `asyncmatch_latency` server metric, it measures async matched tasks from the time they are created to delivered. The larger this latency the longer tasks are sitting in the queue waiting for your workers to pick them up.

---

<div class="post-metadata">

**Author:** ![Ruchir](https://sea2.discourse-cdn.com/flex016/user_avatar/community.temporal.io/ruchir/32/6141_2.png) [@Ruchir](https://community.temporal.io/u/Ruchir)\
**Post date:** [July 7, 2022, 12:04pm UTC](https://community.temporal.io/t/errors-in-temporal-history-and-matching-service-logs/5198/3 "2022-07-07T12:04:00Z")

</div>

We are using 1.14.0 version of temporal.

Thanks @tihomir , will check on other points.