[Bug 20244] New: Elasticsearch - Indexing improvements

classic Classic list List threaded Threaded
42 messages Options
12
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] New: Elasticsearch - Indexing improvements

bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

            Bug ID: 20244
           Summary: Elasticsearch - Indexing improvements
 Change sponsored?: ---
           Product: Koha
           Version: master
          Hardware: All
                OS: All
            Status: NEW
          Severity: enhancement
          Priority: P5 - low
         Component: Searching - Elasticsearch
          Assignee: [hidden email]
          Reporter: [hidden email]

Elasticsearch is currently splitting all fields and doing other non-optimal
stuff. Will provide a patch to improve the indexing.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #1 from Ere Maijala <[hidden email]> ---
Created attachment 71919
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=71919&action=edit
Improve ES indexing: don't split everything, handle linked fields and index
ISBN versions.

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]
         Depends on|                            |20073


Referenced Bugs:

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20073
[Bug 20073] Move Elasticsearch settings to configuration files
--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |Needs Signoff

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Nicolas Legrand <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]
             Status|Needs Signoff               |In Discussion

--- Comment #2 from Nicolas Legrand <[hidden email]> ---
Could you please provide a test plan?

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Nick Clemens <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #3 from Nick Clemens <[hidden email]> ---
Ere, see bug 19581, can you rebase using that and provide a test plan/tests?

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Nick Clemens <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           See Also|                            |https://bugs.koha-community
                   |                            |.org/bugzilla3/show_bug.cgi
                   |                            |?id=19581

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #4 from Ere Maijala <[hidden email]> ---
Oh, cool. I'll rebase as soon as I can.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Katrin Fischer <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|In Discussion               |ASSIGNED
                 CC|                            |[hidden email]

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Assignee|[hidden email]-commun |[hidden email]
                   |ity.org                     |

--- Comment #5 from Ere Maijala <[hidden email]> ---
Created attachment 73372
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=73372&action=edit
Greek Sample MARC21

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|ASSIGNED                    |Needs Signoff

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Attachment #71919|0                           |1
        is obsolete|                            |

--- Comment #6 from Ere Maijala <[hidden email]> ---
Created attachment 73373
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=73373&action=edit
Bug 20244: Improve ES indexing: don't split everything, handle linked fields
and index ISBN versions.

https://bugs.koha-community.org/show_bug.cgi?id=20244

Test plan:

1. Make sure you have recent Catmandu::Identifiers module installed.
2. Add records with alternate scripts (e.g. the attached sample record).
3. Make sure the records can be found also with the alternate script.
4. Add a record with an ISBN-10 or ISBN-13 that can be converted to ISBN-10
(e.g. 1-56619-909-3).
5. Verify that the record can be found by searching for "1-56619-909-3",
"1566199093", "978-1-56619-909-4" and "9781566199094".

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Attachment #73373|Bug-20244-Improve-ES-indexi |Bug-20244-Improve-ES-indexi
           filename|ng-dont-split-everythin.pat |ng-linked-and-isbn.patch
                   |ch                          |
  Attachment #73373|Bug 20244: Improve ES       |Bug 20244: Improve ES
        description|indexing: don't split       |indexing: handle linked
                   |everything, handle linked   |fields and index ISBN
                   |fields and index ISBN       |versions.
                   |versions.                   |

--- Comment #7 from Ere Maijala <[hidden email]> ---
Comment on attachment 73373
  --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=73373
Bug 20244: Improve ES indexing: handle linked fields and index ISBN versions.

I added a new patch with a test plan. This version does not contain any changes
to the splitting. That can be handled in bug 19581. Nick, does this work for
you?

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                URL|                            |https://wiki.koha-community
                   |                            |.org/wiki/MARC_Holdings_Rec
                   |                            |ords_RFC
         Whiteboard|                            |Initial development done

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Whiteboard|Initial development done    |
                URL|https://wiki.koha-community |
                   |.org/wiki/MARC_Holdings_Rec |
                   |ords_RFC                    |

--- Comment #8 from Ere Maijala <[hidden email]> ---
Oops, edited wrong bug.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Attachment #73373|0                           |1
        is obsolete|                            |

--- Comment #9 from Ere Maijala <[hidden email]> ---
Created attachment 74321
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=74321&action=edit
Bug 20244: Improve ES indexing: join subfields with at least a space, handle
linked fields, index ISBN versions and create single-valued sort fields.

https://bugs.koha-community.org/show_bug.cgi?id=20244

Test plan (ISBN):

1. Make sure you have recent Catmandu::Identifiers module installed.
2. Add records with alternate scripts (e.g. the attached sample record).
3. Make sure the records can be found also with the alternate script.
4. Add a record with an ISBN-10 or ISBN-13 that can be converted to ISBN-10
(e.g. 1-56619-909-3).
5. Verify that the record can be found by searching for "1-56619-909-3",
"1566199093", "978-1-56619-909-4" and "9781566199094".

Test plan (joining fields):

1. Add a record that has a 650 field with multiple subfields and no punctuation
between fields (e.g. record 19 from
https://github.com/joubu/koha-misc4dev/tree/master/data/sql/marc21/1611/after_17196).
2. Verify that you can find the record by entering all terms from the 650
field.

Test plan (sorting):

1. Add three records with "Novels" as 240a field and "A", "B" and "C" as 245a
field.
2. Search for "Novels", sort by title and make sure the results are in correct
order.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #10 from Ere Maijala <[hidden email]> ---
Okay, here goes. The join option is needed in case there are fields without
punctuation. Otherwise Catmandu will join the fields together without any
space. Sorting has been fixed so that for each field only a single-value is
created by joining the values (there's no meaningful way to sort by multivalued
string fields in ES).

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Depends on|20073                       |


Referenced Bugs:

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20073
[Bug 20073] Move Elasticsearch settings to configuration files
--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Depends on|                            |20073


Referenced Bugs:

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20073
[Bug 20073] Move Elasticsearch settings to configuration files
--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Depends on|                            |19893


Referenced Bugs:

https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=19893
[Bug 19893] Alternative optimized indexing for Elasticsearch
--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
  Attachment #74321|0                           |1
        is obsolete|                            |

--- Comment #11 from Ere Maijala <[hidden email]> ---
Comment on attachment 74321
  --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=74321
Bug 20244: Improve ES indexing: join subfields with at least a space, handle
linked fields, index ISBN versions and create single-valued sort fields.

Marking obsolete since it seems to make sense to rather wait for bug 19893 and
work based on that.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244
Bug 20244 depends on bug 20073, which changed state.

Bug 20073 Summary: Move Elasticsearch settings to configuration files
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20073

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|Pushed to Master            |RESOLVED
         Resolution|---                         |FIXED

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|Needs Signoff               |ASSIGNED

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|ASSIGNED                    |Needs Signoff

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #12 from Ere Maijala <[hidden email]> ---
Created attachment 76646
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=76646&action=edit
Bug 20244: Improve Elasticsearch ISBN indexing

https://bugs.koha-community.org/show_bug.cgi?id=20244

Test plan:

1. Add a record with an ISBN-10 or ISBN-13 that can be converted to ISBN-10
(e.g. 1-56619-909-3).
2. Verify that the record can be found by searching for "1-56619-909-3",
"1566199093", "978-1-56619-909-4" and "9781566199094".

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #13 from Ere Maijala <[hidden email]> ---
Created attachment 76647
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=76647&action=edit
Bug 20244: Add alt script indexing and fix sort field indexing

https://bugs.koha-community.org/show_bug.cgi?id=20244

Test plan:

1. Add a record with alternate script fields in 880 (sample attached in the
bug).
2. Make sure the the record can be found e.g. with the alternate script title.
3. Add a record with multiple authors.
4. Check that in the index there is only a single author__sort field.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #14 from Ere Maijala <[hidden email]> ---
Created attachment 76648
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=76648&action=edit
Bug 20244: Do not add records to zebraqueue when Elasticsearch is active

https://bugs.koha-community.org/show_bug.cgi?id=20244

Otherwise the table will just keep growing.

Test plan:

1. Add or edit some biblio records.
2. Verify in the database that they were not added to the zebraqueue table.
3. Verify that the changes are still reflected in the Elasticsearch index.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #15 from Ere Maijala <[hidden email]> ---
Created attachment 76649
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=76649&action=edit
Bug 20244: Improve indexing so that multiple subfields are joined together

https://bugs.koha-community.org/show_bug.cgi?id=20244

Also adds 245b to the title field. Joining the subfields in a single field
affects
relevancy, exact phrase search etc. It is especially important for authorities
where
working phrase search is required for finding matches.

Test plan:

1. Add a personal name authority record with 100 $aTester $b1999 $eaut
2. Add a personal name authority record with 100 $aTester $baut $c1999
2. Make sure you can find the first and only the first record by doing a
"Search main heading" search for Personal name with "starts with" option (N.B.
the exact match option may still have issues).

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

--- Comment #16 from Ere Maijala <[hidden email]> ---
Note that bug 19365 provides further fixes to authority searches.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 20244] Elasticsearch - Indexing improvements

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20244

Ere Maijala <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           See Also|                            |https://bugs.koha-community
                   |                            |.org/bugzilla3/show_bug.cgi
                   |                            |?id=19365

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
12