首页   快速返回

elasticsearch7.0压测问题记录     所属分类 elasticsearch
随机生成模拟指标 ,100个指标列,写入es
从1000个指标列中随机选择100个指标
metric000  metric999


字段数超出 批量写入 部分记录报错

java.lang.IllegalArgumentException: Limit of total fields [1000] in index [tsdb-2019-04-24] has been exceeded


修改 字段数限制为 1100

index.mapping.total_fields.limit


PUT /tsdb-2019-04-24/_settings
{
  "settings": {
       "index.mapping.total_fields.limit": 1100
   }
}

该配置动态生效


磁盘空间快耗尽时 停止写入
 
  
[2019-04-24T15:37:05,798][WARN ][o.e.c.r.a.DiskThresholdMonitor] [node001] high disk watermark [90%] exceeded on [h3XqK5mTRli-ClTbJT9UbA][node001][/home/dyyx/soft/elasticsearch-7.0.0/data/nodes/0] free: 40.1gb[7.1%], shards will be relocated away from this node
[2019-04-24T15:37:05,799][INFO ][o.e.c.r.a.DiskThresholdMonitor] [node001] rerouting shards: [high disk watermark exceeded on one or more nodes]
[2019-04-24T15:37:07,295][WARN ][o.e.x.m.e.l.LocalExporter] [node001] unexpected error while indexing monitoring document
org.elasticsearch.xpack.monitoring.exporter.ExportException: ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]
	at org.elasticsearch.xpack.monitoring.exporter.local.LocalBulk.lambda$throwExportException$2(LocalBulk.java:128) ~[?:?]
	

high disk watermark [90%] exceeded on [h3XqK5mTRli-ClTbJT9UbA][node001]
free: 40.1gb[7.1%], shards will be relocated away from this node

	
	
所有索引都会被设置为只读 写入时会报错
org.elasticsearch.xpack.monitoring.exporter.ExportException: ClusterBlockException[blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]

查看
/_settings

read_only_allow_delete 为 true 


删除历史索引数据

DELETE  /tsdb-XXX




解除索引只读限制

PUT _settings
  
{
    "index":{
        "blocks":{
            "read_only_allow_delete":"false"
        }
    }
}


查看磁盘可用空间   df -h

显示当前目录 各个文件大小

 du -d 1 -h

996M	./soft
162M	./grafana-6.1.3
8.7M	./tomcat8
73M	./benchmark7020
7.5M	./process-exporter-0.4.0.linux-amd64
66G	./kafka1.1.0
2.6G	./elasticsearch-7.0.0
79M	./metric7050
734M	./kibana-7.0.0-linux-x86_64
71G	.

-d 1 表示深度为1  ,只显示当前目录的一级子目录

上一篇     下一篇
自定义类加载器例子

java类加载器要点整理

kibana安装配置及使用

elasticsearch工具

kafka监控工具kafka-eagle编译安装使用

rust特点及安装