关于kibana查询elasticsearch的index提示Courier Fetch: 4 of 6 shards failed.处理方法
2017-11-29 11:12
609 查看
公司使用Elastic Stack收集、处理nginx日志。
使用kibana查询nginx日志时,发现无法通过host:nginx003.ecs.east1-e来查询对应服务器的nginx日志。页面提示Courier Fetch: 4 of 6 shards failed
查看kibana日志没有发现特殊的错误;
查看elasticsearch日志发现有如下日志:
[2017-11-29T11:01:28,570][DEBUG][o.e.a.s.TransportSearchAction] [storm3] [23646] Failed to execute fetch phase
org.elasticsearch.transport.RemoteTransportException: [es5][*.*.*.*9200][indices:data/read/search[phase/fetch/id]]
Caused by: java.lang.IllegalArgumentException: Fielddata is disabled on text fields by default. Set fielddata=true on [parameters.createTimeStart] in order to load fielddata in memory by uninverting the inverted index. Note that this can however use significant
memory. Alternatively use a keyword field instead.
at org.elasticsearch.index.mapper.TextFieldMapper$TextFieldType.fielddataBuilder(TextFieldMapper.java:336) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.index.fielddata.IndexFieldDataService.getForField(IndexFieldDataService.java:111) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.search.fetch.subphase.DocValueFieldsFetchSubPhase.hitExecute(DocValueFieldsFetchSubPhase.java:64) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.search.fetch.FetchPhase.execute(FetchPhase.java:165) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.search.SearchService.executeFetchPhase(SearchService.java:426) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.action.search.SearchTransportService$12.messageReceived(SearchTransportService.java:407) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.action.search.SearchTransportService$12.messageReceived(SearchTransportService.java:404) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:69) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1539) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-5.6.3.jar:5.6.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_73]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_73]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_73]
根据错误提示,是parameters.createTimeStart这个字段要设置下fielddata=true
在kibana的Dev tools设置下索引的字段:
PUT nginx*/_mapping/logs/
{
"properties": {
"parameters.createTimeStart": {
"type": "text",
"fielddata": true
}
}
}
同时需要在_template里面添加上面的字段,这样每天就会自动设置到索引里面了。
再在kibana里面查询,如果还有问题,再参照同样的方式设置即可!
使用kibana查询nginx日志时,发现无法通过host:nginx003.ecs.east1-e来查询对应服务器的nginx日志。页面提示Courier Fetch: 4 of 6 shards failed
查看kibana日志没有发现特殊的错误;
查看elasticsearch日志发现有如下日志:
[2017-11-29T11:01:28,570][DEBUG][o.e.a.s.TransportSearchAction] [storm3] [23646] Failed to execute fetch phase
org.elasticsearch.transport.RemoteTransportException: [es5][*.*.*.*9200][indices:data/read/search[phase/fetch/id]]
Caused by: java.lang.IllegalArgumentException: Fielddata is disabled on text fields by default. Set fielddata=true on [parameters.createTimeStart] in order to load fielddata in memory by uninverting the inverted index. Note that this can however use significant
memory. Alternatively use a keyword field instead.
at org.elasticsearch.index.mapper.TextFieldMapper$TextFieldType.fielddataBuilder(TextFieldMapper.java:336) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.index.fielddata.IndexFieldDataService.getForField(IndexFieldDataService.java:111) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.search.fetch.subphase.DocValueFieldsFetchSubPhase.hitExecute(DocValueFieldsFetchSubPhase.java:64) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.search.fetch.FetchPhase.execute(FetchPhase.java:165) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.search.SearchService.executeFetchPhase(SearchService.java:426) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.action.search.SearchTransportService$12.messageReceived(SearchTransportService.java:407) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.action.search.SearchTransportService$12.messageReceived(SearchTransportService.java:404) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:69) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1539) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:638) ~[elasticsearch-5.6.3.jar:5.6.3]
at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-5.6.3.jar:5.6.3]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[?:1.8.0_73]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) ~[?:1.8.0_73]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_73]
根据错误提示,是parameters.createTimeStart这个字段要设置下fielddata=true
在kibana的Dev tools设置下索引的字段:
PUT nginx*/_mapping/logs/
{
"properties": {
"parameters.createTimeStart": {
"type": "text",
"fielddata": true
}
}
}
同时需要在_template里面添加上面的字段,这样每天就会自动设置到索引里面了。
再在kibana里面查询,如果还有问题,再参照同样的方式设置即可!
相关文章推荐
- Mabatis错误提示Parameter index out of range的处理方法
- 关于tomcat关闭时错误信息Failed shutdown of Apache Portable Runtime的解决方法
- 关于ORA-01187: cannot read from file because it failed verification tests 的处理方法
- SQL查询超时的设置方法(关于timeout的处理)
- 关于删除文件时提示“找不到路径,无法删除”的处理方法
- 关于mysql处理百万级以上的数据时如何提高其查询速度的方法
- 关于oracle死锁的查询及处理方法!
- php解析xml提示Invalid byte 1 of 1-byte UTF-8 sequence错误的处理方法
- 关于mysql处理百万级以上的数据时如何提高其查询速度的方法
- 关于mysql处理百万级以上的数据时如何提高其查询速度的方法
- values of type NSInteger should not be used as format arguments; 关于Xcode中烦人的32位与64位警告处理方法.
- 关于存储过程中一个参数表示多个查询条件使用方法的简单处理
- 关于mysql处理百万级以上的数据时如何提高其查询速度的方法
- 关于MongoDB在64位服务器上依然报 mmap failed with out of memory 错误的解决方法(附Mysql性能对比测试)
- 用Delphi中的TADOQuery查询Oracle10G中的数据表时,Open时提示"数据类型不被支持"的处理方法
- 【我的问题】关于cursor查询的用法的注意事项(Index -1 requested, with a size of 1)
- 关于c# 引发了"system.indexOutofRangeException"类型异常,该怎么处理
- php解析xml提示Invalid byte 1 of 1-byte UTF-8 sequence错误的处理方法
- 关于Windows 下查询端口占用情况已经处理方法