Skip to content

[TASK] Prevent word truncation with enabled resultsHighlighting #4114

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
loeffe1 wants to merge 2 commits into
base: main
Choose a base branch
from
Open

[TASK] Prevent word truncation with enabled resultsHighlighting #4114

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
79f3255
[TASK] Add BreakIteratorBoundaryScanner as default
Jul 24, 2024
445ab2a
[BUGFIX] Fix property names
Jul 24, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions Resources/Private/Solr/configsets/ext_solr_13_0_0/conf/solrconfig.xml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -131,6 +131,10 @@


<requestHandler name="/select" class="solr.SearchHandler">
<str name="hl.usePhraseHighlighter">false</str>
<str name="hl.useFastVectorHighlighter">true</str>
<str name="hl.boundaryScanner">breakIterator</str>

<lst name="defaults">
<str name="defType">edismax</str>
<str name="echoParams">explicit</str>
Expand Down Expand Up @@ -458,6 +462,24 @@
<str name="hl.tag.post"><![CDATA[</b>]]></str>
</lst>
</fragmentsBuilder>

<boundaryScanner name="default" default="false" class="solr.highlight.SimpleBoundaryScanner">
<lst name="defaults">
<str name="hl.bs.maxScan">10</str>
<str name="hl.bs.chars">.,!? &#9;&#10;&#13;</str>
</lst>
</boundaryScanner>

<boundaryScanner name="breakIterator" default="true" class="solr.highlight.BreakIteratorBoundaryScanner">
<lst name="defaults">
<!-- type should be one of CHARACTER, WORD(default), LINE and SENTENCE -->
<str name="hl.bs.type">SENTENCE</str>
<!-- language and country are used when constructing Locale object. -->
<!-- And the Locale object will be used when getting instance of BreakIterator -->
<str name="hl.bs.language">${hl.bs.language}</str>
<str name="hl.bs.country">${hl.bs.country}</str>
</lst>
</boundaryScanner>
</highlighting>
</searchComponent>

Expand Down
2 changes: 2 additions & 0 deletions Resources/Private/Solr/cores/english/core.properties
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,3 +2,5 @@ configSet=ext_solr_13_0_0
schema=english/schema.xml
name=core_en
dataDir=../../data/english
hl.bs.language=en
hl.bs.country=US
2 changes: 2 additions & 0 deletions Resources/Private/Solr/cores/german/core.properties
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,3 +2,5 @@ configSet=ext_solr_13_0_0
schema=german/schema.xml
name=core_de
dataDir=../../data/german
hl.bs.language=de
hl.bs.country=DE
Loading