Elasticsearch: Error : curl(56) Recv failure: Connection reset by peer

Created on 27 Jun 2015  ·  3Comments  ·  Source: elastic/elasticsearch

I am trying to load my ES db using bulk API, but I am getting this error
"curl: (56) Recv failure: Connection reset by peer"

The structure of json documents in my json file is correct
But my file size is 750MB

Please suggest me some solution

Thanks

Most helpful comment

But elasticsearch is made for handling big size data some GBs of data , even wiki and github are also using it .

I think reducing the input size is not a good solution , but I somehow managed to insert the data using python ..

Even then if someone can suggest me best possible solution then kindly comment

All 3 comments

Please use discuss.elastic.co

Try to reduce your bulk size. I think I don't insert more than 10k docs per bulk (small docs). So, some mb at most per bulk.

But elasticsearch is made for handling big size data some GBs of data , even wiki and github are also using it .

I think reducing the input size is not a good solution , but I somehow managed to insert the data using python ..

Even then if someone can suggest me best possible solution then kindly comment

Yes. I can confirm that elasticsearch can handle billions of documents, trillions of documents.
It does not mean that you can pass all those docs within one single bulk request.

Have a look BTW at http.max_content_length. By default it's limited to 100mb (on purpose).

https://www.elastic.co/guide/en/elasticsearch/reference/current/modules-http.html

Was this page helpful?
0 / 5 - 0 ratings