If you getting this error - Reallocating unassigned shards might solve the following situations:
- An "Error Accessing Store" dialog is displayed after signing in to the system:
Or in case you have seen in the Store screen a message that alert about a Red cluster status with unassigned shards,
...
- In the Store page, the status of the cluster is RED with unassigned shards:
The store is divided into nodes (some used to keep data, others can handle communication and there is one Master that coordinates the work).To know each node's role you can learn from the Node Type marked in redcommunications or manage the cluster). The type of each node can be found in the Nodes table under "Type" column, marked in red in the following screenshot:
Shards need to be allocated/assigned to data nodes so they can in order to be able to be populated with data. If shards are unassigned to a data node then no data can flow to the system and this the problem we want to solve.
This situation is usually happens when there is an caused by unexpected recovery of the cluster and at the time of recovery , where automatic assignment of shards was not applicable at the time of recovery for unknown reason.
What can you do ?
There is a script at To fix the issue, you may execute the following script: /app/scripts/realloc_shards.sh <Node Name>
- The
...
- <Node Name> parameter should be the name of the data node
...
- (
...
- a node of type "D" in the nodes table)
The script scans all shards and reallocate reallocates unassigned shards to the available data node provided.
In the example above we , the script should be run commandas follows:
| Code Block |
|---|
/app/scripts/realloc_shards.sh MonTieMonTier-es-raw-trans-Node-2 |
This operation may take a while depends , depending on your installation and the amount of data. Refreshing the screen in "head" application (available from Store dashboard page) will show updated up-to-date state of the assigned and unassigned shards.
| Warning |
|---|
In cell environments, unassigned shards can only reallocate to a Store node from the same cell member or cell manager. |
Below is an example of successfull a successful execution:
| Code Block |
|---|
Reallocation node: MonTier-es-raw-trans-Node-2 Testing index 0;wdp-wsm_i2 About to reallocate. index=wdp-wsm_i2, shard=0, node=MonTier-es-raw-trans-Node-2 Reallocation http response status is: 200, output={"acknowledged":true,"state":{"version": Testing index 1;wdp-syslog-sys-errorauth_i14i1 About to reallocate. index=wdp-syslog-sys-errorauth_i14i1, shard=1, node=MonTier-es-raw-trans-Node-2 Reallocation http returnresponse codestatus is : 0200, output={"acknowledged":true,"state":{"version":882,"state Testing index 12;wdpsystem-sysloghealth_i260i1 About to reallocate. index=wdpsystem-sysloghealth_i260i1, shard=12, node=MonTier-es-raw-trans-Node-2 Reallocation http returnresponse codestatus is : 0200, output={"acknowledged":true,"state":{"version":884,"state Testing index 10;wdpsystem-service-resourceshealth_i5i1 About to reallocate. index=wdpsystem-service-resourceshealth_i5i1, shard=10, node=MonTier-es-raw-trans-Node-2 Reallocation http returnresponse codestatus is : 0200, output={"acknowledged":true,"state":{"version":886,"state: ... |
Below is an example of a unsuccessful execution:
| Code Block |
|---|
Reallocation node: MonTier-es-raw-trans-Node-5 Testing index 1;internal-operations0;wdp-syslog-sys-auth_i6 About to reallocate. index=internal-operationswdp-syslog-sys-auth_i6, shard=10, node=MonTier-es-raw-trans-Node-25 Reallocation http returnresponse codestatus is: 400, output={"error":{"root_cause":[{"type":"remote_ Testing index 0;wdp-syslog-sys-auth_i3 About to reallocate. index=wdp-syslog-sys-auth_i3, shard=0, node=MonTier-es-raw-trans-Node-5 Reallocation http response status is: 400, output={"acknowledgederror":true,"state{"root_cause":[{"versiontype":888,"stateremote_ Testing index 1;logical-tran-compactfull_i16i1 About to reallocate. index=logical-tran-compact_i16-full_i1, shard=1, node=MonTier-es-raw-trans-Node-5 Reallocation http response status is: 400, output={"error":{"root_cause":[{"type":"remote_ Testing index 1;wdp-config-service_i1 About to reallocate. index=wdp-config-service_i1, shard=1, node=MonTier-es-raw-trans-Node-25 Reallocation http response status is: 400, output={"error":{"root_cause":[{"type":"remote_ ... |