elasticsearch7.0压测问题记录
所属分类 elasticsearch
浏览量 2498
随机生成模拟指标 ,100个指标列,写入es
从1000个指标列中随机选择100个指标
metric000 metric999
es7.0
字段数超出 批量写入 部分记录报错
java.lang.IllegalArgumentException: Limit of total fields [1000] in index [tsdb-2019-04-24] has been exceeded
修改 字段数限制为 1100
index.mapping.total_fields.limit
PUT /tsdb-2019-04-24/_settings
{
"settings": {
"index.mapping.total_fields.limit": 1100
}
}
该配置动态生效
磁盘空间快耗尽时 停止写入
[2019-04-24T15:37:05,798][WARN ][o.e.c.r.a.DiskThresholdMonitor] [node001] high disk watermark [90%] exceeded on [h3XqK5mTRli-ClTbJT9UbA][node001][/home/dyyx/soft/elasticsearch-7.0.0/data/nodes/0] free: 40.1gb[7.1%], shards will be relocated away from this node
[2019-04-24T15:37:05,799][INFO ][o.e.c.r.a.DiskThresholdMonitor] [node001] rerouting shards: [high disk watermark exceeded on one or more nodes]
[2019-04-24T15:37:07,295][WARN ][o.e.x.m.e.l.LocalExporter] [node001] unexpected error while indexing monitoring document
org.elasticsearch.xpack.monitoring.exporter.ExportException: ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.lambda$throwExportException$2(LocalBulk.java:128) ~[?:?]
high disk watermark [90%] exceeded on [h3XqK5mTRli-ClTbJT9UbA][node001]
free: 40.1gb[7.1%], shards will be relocated away from this node
所有索引都会被设置为只读 写入时会报错
org.elasticsearch.xpack.monitoring.exporter.ExportException: ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
查看
/_settings
read_only_allow_delete 为 true
删除历史索引数据
DELETE /tsdb-XXX
解除索引只读限制
PUT _settings
{
"index":{
"blocks":{
"read_only_allow_delete":"false"
}
}
}
查看磁盘可用空间 df -h
显示当前目录 各个文件大小
du -d 1 -h
996M ./soft
162M ./grafana-6.1.3
8.7M ./tomcat8
73M ./benchmark7020
7.5M ./process-exporter-0.4.0.linux-amd64
66G ./kafka1.1.0
2.6G ./elasticsearch-7.0.0
79M ./metric7050
734M ./kibana-7.0.0-linux-x86_64
71G .
-d 1 表示深度为1 ,只显示当前目录的一级子目录
https://gitee.com/dyyx/hellocode/tree/master/project/metrics-mock-server
上一篇
下一篇
自定义类加载器例子
java类加载器要点整理
kibana安装配置及使用
elasticsearch工具
kafka监控工具kafka-eagle编译安装使用
rust特点及安装