Questions tagged [elasticsearch]

Elasticsearch is an Open Source (Apache 2), Distributed, RESTful, Search Engine based on Lucene.

0
votes
0answers
6 views

Kibana Unable to revive connection : http://elasticsearch_url:9200/elasticsearch/

I want to use kibana to connect a remote elasticsearch address, the elasticsearch address is like 'http://elasticsearch_url/elasticsearch/'. Then I edit the kibana.yaml, and write this: elasticsearch....
0
votes
0answers
5 views

How to count the number of keyword matched across the docs in ES

Hi I have elastic search docs hosted in AWS managed services, I want to get the number of keywords present in the resultset. i.e lets say my docs have a textual data in a key and I am searching for ...
0
votes
1answer
19 views

Best way to set up ElasticSearch for searching in each customer's data only

We have a SAAS product where companies create accounts and populate their own private data. We are thinking about using ElasticSearch to allow the customer to search all their own data in our system. ...
0
votes
1answer
15 views

How to query for * value in Elastic Nested Query?

I have documents with nested entries like this: "listOfElements": { "entries": [{ "key1": "value1", "key2": "value2" }, { "key1": "value3", ...
0
votes
0answers
12 views

How to enforce ES to return document for they key that is not in the query

I'm writing an API for aggregate some data in Elasticsearch, one of them is counting the documents. I'm using the terms filter and the terms aggreagtions with a lot of ID to get them. The problem is, ...
1
vote
1answer
20 views

Exclude phrase from search in ElasticSearch

I'm using ElasticSearch (elasticsearch-dsl) and searching for keywords, but would like to ignore some phrases from search. E.g. searching for "best" and ignore phrase "best regards": it should find ...
0
votes
0answers
19 views

Running Kibana 6.x.x from source

I'm trying to run Kibana by directly downloading it and running from the source. I downloaded v6.2.4 from their official site, updated the kibana.yml file to point to the right ES cluster and ran ./...
0
votes
0answers
22 views

Understanding Azure SQL Server External Tables

We are trying to create a cross-database query using Azure's preview Elastic Query. So we will be creating an External Table to make these queries happen. Unfortunately, I have some apprehension ...
0
votes
1answer
13 views

Elasticsearch - This search doesn't return the correct results after upgrading from 6.7 to 7.0

{ "query":{ "constant_score":{ "filter":{ "bool":{ "should":{ "terms":{ "field_a":[ "value1", "value2" ...
0
votes
1answer
13 views

multiple kafka topic input to logstash with different filter and codec

I'm setting up an elk with kafka and want to send log through 2 kafka topic ( topic1 for windowslog and topic2 for wazuh log) to logstash with different codec and filter. I tryed with bellow input ...
0
votes
1answer
27 views

ElasticSearch fails with OutOfMemoryError

I have green ES cluster with 3 nodes. All worked well, but recent times there are some fails. [2019-04-22T11:05:37,099][WARN ][o.e.t.OutboundHandler ] [node_1] send message failed [channel: ...
0
votes
0answers
17 views

Dynamic index naming with class name

I'm creating a framework for spring-data-elasticsearch as a practice project. My question is about the @Document tag that will create the index based on the name provided in indexName parameter of ...
0
votes
1answer
12 views

Find list of Distinct string Values stored in a field in ElasticSearch

I have stored my data in elasticsearch which is as given below. It returns only distinct words in the given field and not the entire distinct phrase. { "_index" : "test01", "_type" : "...
0
votes
2answers
18 views

Sum of max per group in Elasticsearch

I want to search sum of max per group in Elasticsearch data. For example: Data is: id | gId | cost ----|-----|------ 1 | 1 | 20 2 | 1 | 15 3 | 2 | 30 4 | 1 | 30 * 5 | 2 | 40 ...
0
votes
1answer
19 views

Problem running logstash in aws ec2 linux ami

I am setting up "elasticsearch" in AWS, i am trying to use AWS linux AMI. When i run the bin/logstash -f "/path to config file" i get error saying: "logstash.yml" not found try using "--path....
0
votes
1answer
30 views

why does logstash stops processing logs

Logstash stops processing logs after some hours. When logs stops processing logstash service consumes high amount of CPU performance (about 25 cores of 32 total). When logstash service works normal it ...
0
votes
1answer
16 views

Need to sort a field with numeric and alpha numeric values in elasticsearch

I am trying to create mapping for a field which will need to be used only for exact matches and sorting. I don't want to set primary data type as text as I need to do only exact match. { "...
0
votes
0answers
11 views

writing kibana plugins error to get the data from elasticsearch

has anybody written kibana plugins for elasticsearch? i am stuck on getting data via nodejs client from elasticsearch. My task is to create new visualization in kibana. const adminCluster = server....
0
votes
0answers
17 views

How get top compound words from text in elasticsearch?

I need to get top terms from elasticsearch, currently we are using significant terms functionality provided by elasticsearch but in our case we need multiple words which come frequently and ...
0
votes
0answers
13 views

How to connect BIRT Datasource with Elastic Search?

I am trying to connect a BIRT data source with Elastic Search in eclipse via Elastic Search JDBC client (x-pack-sql-jdbc-7.0.0.jar). Version of my Elastic search server is 7.0 I am able to get the ...
0
votes
0answers
16 views

Parsing Logs Using Elastic Search

I am trying to parse the Cisco ASA logs I am getting but i want specific logs to be parsed, saved and showed on Kibana. I've written a code but its still showing a lot of logs that I do not want. I am ...
0
votes
1answer
20 views

Compare data between Elastic Search and RDS

We are moving our data from RDS to elastic search and the data volume is around 80GB with around 90 million records. We have been using bulk api of elastic search for indexing the data but we want to ...
0
votes
0answers
24 views

How to set ElasticSearch Apm Server indexing template as YYYY.mm?

I just created Apm server it looks awesome but Indexing like that"Apm-6.6.2-2019.04.19" doesn't make sense because I will have at the end of the month 30 logs. I want to use change "apm-%{[beat....
1
vote
0answers
29 views

how to sync data from mongodb to elastic search with python

I am currentlt using Monstache connector for sync MongoDB elastic search. is there any other recommended connector for sync. Architecture: Angular7 Elastic Search Mongo DB Python Pycharm. is there ...
0
votes
0answers
24 views

How to search across multiple indices which have different kinds of documents using Nest ElasticSearch 6.x?

I've got two indices which each have their own kind(different shapes) of document, but I have a requirement where search results should include both of these types of documents. From what I've read ...
0
votes
1answer
19 views

Not getting where data with filter (elastic search 6.4)

elasticsearch version: 6.4 Here is my current data: I want to search for products which has Xbox in name. I am using the match keyword but that is not working. Below is my elastic search query: { ...
0
votes
0answers
18 views

Get child object in FOSElasticaBundle symfony

I want to get child object from my product. Is it fos_elastica.yaml file fos_elastica: clients: default: { host: elasticsearch, port: 9200 } indexes: photos: ...
0
votes
1answer
20 views

Results between two dates in elasticsearch

I'm looking to get data between two dates in elasticsearch. I have tried to put "gte": "20-04-2019" and "lte": "21-04-2019" as shown below, but I still get other anterior dates in the final result: ...
0
votes
0answers
17 views

Elasticsearch: Geo_spacial search in a list of nested objects

I'm using Elasticsearch 6.3 and spring-data-elasticsearch, I have the index restaurant having the mapping below : { "mapping": { "restaurant": { "properties": { "id": { ...
0
votes
0answers
10 views

Can I use matchPhrasePrefixQuery and fuzziness at the same time?

I am using Elasticsearch 6.5 and when I use matchPhrasePrefixQuery it works fine. For Example I have documents like- 1.spiderman is climbing 2.spiderman 3.spider When I type "s" I got all this ...
0
votes
0answers
17 views

using geopoint on elasticsearch from logstsh

I want to use geoip in elk stack from docker. according to this documentation I added config https://www.elastic.co/blog/geoip-in-the-elastic-stack this is my logstash.conf input { beats { ...
0
votes
0answers
21 views

elastic search gives error from doc example

I am trying to learn elasticsearch module in python,(pip3 install elasticsearch) I tried to follow their doc on Python Elasticsearch, here is the code from their site: from datetime import datetime ...
0
votes
0answers
21 views

How to perform many Elasticsearch index operations in a single API call with Scala?

I am injecting data to an index in Elasticsearch. Injecting with POST operations one by one takes a lot of time. I used the Bulk API in Java before, to perform many index operations in a single API ...
0
votes
0answers
16 views

Lucene autocomplete functionality that ignores terms order

I'm trying to implement an AutoComplete feature with lucene based on a filtered set of documents. The difference to all the common auto commlete examples in the web is that only a single term should ...
0
votes
1answer
21 views

Service is injected but results in null pointer exception when its property is used. What can be the probable reason?

I have created a java service/file in src directory of my grails project and I have defined in within the beans in resources.groovy. beans = { elasticsearchConfigManager(...
0
votes
0answers
21 views

Can someone explain routing in elastic-search with an example?

I just started working with elastic-search and I need to use the routing in ES but I don't understand how to use it? I read the routing from elastic-search official references but didn't quite ...
0
votes
0answers
15 views

Neo4j fulltext search with highlights

When using Neo4j full-text search which is based on the Lucene engine. Is there a way to retrieve highlights in the same way as ElasticSearch highlight. Basically, I want to know on which part of the ...
1
vote
1answer
41 views

How to search result must not sum of two values?

How to write a correct query in elasticsearch for: phoneNumber != phoneCode + phone
0
votes
1answer
18 views

logstash: Unknown setting ‘“index”’ for elasticsearch

I'm new to the elastic search concept to make connection with mySQL. I followed multiple tutorials to install but I'm getting these errors: Unknown setting '"index"'and '"host'" for elasticsearch ...
0
votes
0answers
12 views

Elasticsearch query single field with two different analyzers

Instead of using a index multi-field approach, what are the tradeoffs with analyzing a match query twice with different analyzers? For example, a search for "skies" by applying a default english ...
0
votes
1answer
22 views

Elastic search: How to highlight the fragment after the search term?

I am working on a search project which requires the highlight fragment after the search word. My query is { "query": { "multi_match" : { "query" : "prawn", "fields":...
0
votes
0answers
6 views

Using Daily Elastic Indexes can't perform search over more than 3 month back (for preventing Dedup data)

I am using in my system elastic search, and daily indexes my data. The problem i am reading from sources which sometimes gives me dedup information. i try to make a dedup mechanism which check ...
0
votes
1answer
21 views

Recursive not working in kv filter in logstash

I want to know about the use of recursive function in kv filter. I am using a csv file. I uploaded the file to ES using logstash. After reading the guide from this link https://www.elastic.co/guide/...
0
votes
1answer
32 views

Elastic Search Filter on the result of terms aggregation

Apply Match phrase prefix query on the result of terms aggregation in Elastic Search. I have terms query and the result looks something like below "buckets": [ { "key": "KEY", "count": 20 }, { "key":...
0
votes
1answer
16 views

Count the number of document which contains either or both terms, and the term's values must be within a range

I want to count the number of document that has either or both term A and term B if term A or/and term B exist, the value is between a range. I manage to write count for single term count as below ...
1
vote
1answer
36 views

Object mapping for [requestPayload] tried to parse field [requestPayload] as object, but found a concrete value

I am storing a JSON String as Object in elasticsearch but getting Exception below where requestPayload is as our JSON string body: object mapping for [requestPayload] tried to parse field [...
0
votes
2answers
28 views

How to search on Elasticsearch for words with or without apostrophe ? and deal with spelling mistakes?

I'm trying to move my Full Text Search logic from MySQL to Elasticsearch. In MySQL to find all rows containing the word "woman" I would just write SELECT b.code FROM BIBLE b WHERE ((b.DISPLAY_NAME ...
0
votes
1answer
21 views

ElasticSearch: Highlighting with Stemming

I have read this question and attempted to understand the documentation here, but this is complicated. The problem (I think): [update 1] I am using Scala for my code and interface with ES High ...
0
votes
1answer
28 views

Elasticsearch query speed up with repeated used terms query filter

I will need to find out the co-occurrence times between one single tag and another fixed set of tags as whole. I have 10000 different single tags, and there are 10k tags inside fixed set of tags. I ...
0
votes
0answers
13 views

How to build a pipeline from mongodb to elastic-search? [duplicate]

I'm hosting MongoDB as well as elastic search locally so I need to real-time data transfer from MongoDB to elastic-search. I tried composer transporter https://github.com/compose/transporter but it's ...