本篇博文记录着ElastaticSearch在使用工程中所踩过的坑

Q1: FORBIDDEN/12/index read-only / allow delete (api)
问题出现在AbstractElasticsearchOutputFormat中，具体的问题描述如下：

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
2019-12-06 10:46:52 ERROR AbstractElasticsearchOutputFormat:264 - Failed Elasticsearch item request: ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]]
ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]]
    at org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:509)
    at org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:420)
    at org.elasticsearch.action.bulk.BulkItemResponse.fromXContent(BulkItemResponse.java:139)
    at org.elasticsearch.action.bulk.BulkResponse.fromXContent(BulkResponse.java:199)
    at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2053)
    at org.elasticsearch.client.RestHighLevelClient.lambda$performRequestAsyncAndParseEntity$15(RestHighLevelClient.java:1824)
    at org.elasticsearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1924)
    at org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:849)
    at org.elasticsearch.client.RestClient$1.completed(RestClient.java:549)
    at org.elasticsearch.client.RestClient$1.completed(RestClient.java:537)
    at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:119)
    at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:177)
    at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:436)
    at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:326)
    at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265)
    at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81)
    at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39)
    at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114)
    at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162)
    at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337)
    at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315)
    at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276)
    at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
    at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588)
    at java.lang.Thread.run(Thread.java:748)
2019-12-06 10:46:52 ERROR DataSinkTask:253 - Error in user code: An error occurred in ElasticsearchSink.:  DataSink (com.ci123.cidata.platform.flink.outline.module.output.elasticsearch.ElasticsearchOutputFormat@76ffc17c) (3/3)
java.lang.RuntimeException: An error occurred in ElasticsearchSink.
    at com.ci123.cidata.platform.flink.outline.module.output.elasticsearch.AbstractElasticsearchOutputFormat.checkErrorAndRethrow(AbstractElasticsearchOutputFormat.java:243)
    at com.ci123.cidata.platform.flink.outline.module.output.elasticsearch.AbstractElasticsearchOutputFormat.close(AbstractElasticsearchOutputFormat.java:204)
    at org.apache.flink.runtime.operators.DataSinkTask.invoke(DataSinkTask.java:227)
    at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
    at java.lang.Thread.run(Thread.java:748)
Caused by: ElasticsearchException[Elasticsearch exception [type=cluster_block_exception, reason=blocked by: [FORBIDDEN/12/index read-only / allow delete (api)];]]
    at org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:509)
    at org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:420)
    at org.elasticsearch.action.bulk.BulkItemResponse.fromXContent(BulkItemResponse.java:139)
    at org.elasticsearch.action.bulk.BulkResponse.fromXContent(BulkResponse.java:199)
    at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2053)
    at org.elasticsearch.client.RestHighLevelClient.lambda$performRequestAsyncAndParseEntity$15(RestHighLevelClient.java:1824)
    at org.elasticsearch.client.RestHighLevelClient$1.onSuccess(RestHighLevelClient.java:1924)
    at org.elasticsearch.client.RestClient$FailureTrackingResponseListener.onSuccess(RestClient.java:849)
    at org.elasticsearch.client.RestClient$1.completed(RestClient.java:549)
    at org.elasticsearch.client.RestClient$1.completed(RestClient.java:537)
    at org.apache.http.concurrent.BasicFuture.completed(BasicFuture.java:119)
    at org.apache.http.impl.nio.client.DefaultClientExchangeHandlerImpl.responseCompleted(DefaultClientExchangeHandlerImpl.java:177)
    at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.processResponse(HttpAsyncRequestExecutor.java:436)
    at org.apache.http.nio.protocol.HttpAsyncRequestExecutor.inputReady(HttpAsyncRequestExecutor.java:326)
    at org.apache.http.impl.nio.DefaultNHttpClientConnection.consumeInput(DefaultNHttpClientConnection.java:265)
    at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:81)
    at org.apache.http.impl.nio.client.InternalIODispatch.onInputReady(InternalIODispatch.java:39)
    at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:114)
    at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:162)
    at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:337)
    at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315)
    at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:276)
    at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
    at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:588)
    ... 1 more

官网给的解决方案是这样的：

1
2
3
4
PUT /twitter/_settings
{
  "index.blocks.read_only_allow_delete": null
}

Note 这里的twitter 是我们的index，当然了，不想单个的使用 index的话，我们也可以使用 _all 来代替。