[Bug 17842] New: Broken diacritics on records exported as MARC from cart on reimport

classic Classic list List threaded Threaded
63 messages Options
123
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] New: Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

            Bug ID: 17842
           Summary: Broken diacritics on records exported as MARC from
                    cart on reimport
 Change sponsored?: ---
           Product: Koha
           Version: unspecified
          Hardware: All
                OS: All
            Status: NEW
          Severity: critical
          Priority: P5 - low
         Component: OPAC
          Assignee: [hidden email]
          Reporter: [hidden email]
        QA Contact: [hidden email]

I have experienced this problem for a while now in different versions, but I am
not quite sure what's going wrong:

- Add a records with diacritics, such as German umlauts äüö to your cart
- Download the record from the cart in MARC
- Import the record into Koha using the staged MARC import
- Verify that the MARC preview doesn't work in the staged MARC import table
- Verify that the umlauts didn't import correctly

When using the 'import record' feature in Rancor, the diacritics also appear
broken, fields containing diacritics get cut off and other oddities happen.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Jonathan Druart <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           See Also|                            |https://bugs.koha-community
                   |                            |.org/bugzilla3/show_bug.cgi
                   |                            |?id=17754

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #1 from Jonathan Druart <[hidden email]> ---
This seems to work for me, I have exported a record with 245$a "äüö ❤ ✓" from
the cart and then reimported it (do not look for matching records, add incoming
record, add items).
The title appears ok during the whole import process.

Do you mean you do not get this problem when exporting using the export records
tool?

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #2 from Katrin Fischer <[hidden email]> ---
Hm, no. I get this when I export using the MARC option from the download menu.
The attachement to the email (send cart) is fine.
Which encoding did you pick for importing?

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Jonathan Druart <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]-c
                   |                            |ommunity.org

--- Comment #3 from Jonathan Druart <[hidden email]> ---
From /cgi-bin/koha/basket/basket.pl?bib_list=1/ I used Download > iso2709
Then import with the default character encoding option: UTF-8

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #4 from Katrin Fischer <[hidden email]> ---
I tested this on master before filing, but will test again and try to attach
the exported files.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #5 from Jonathan Druart <[hidden email]> ---
Any news here?

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #6 from Katrin Fischer <[hidden email]> ---
Sorry not yet!

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Jonathan Druart <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Severity|critical                    |major

--- Comment #7 from Jonathan Druart <[hidden email]> ---
Lowering the severity as it's not confirmed.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Katrin Fischer <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |WORKSFORME

--- Comment #8 from Katrin Fischer <[hidden email]> ---
I can no longer reproduce this issue on master (tested in kohadevbox).

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart on reimport

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Katrin Fischer <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|WORKSFORME                  |---
             Status|CLOSED                      |REOPENED

--- Comment #9 from Katrin Fischer <[hidden email]> ---
I am still seeing this issue, tested in 18.11:

To test:
- Create a record using umlauts öüä
- Put the record in your cart in OPAC
- Use the Download button and MARC as format
- Try to reimport the record or use MarcEdit to create a mrk
- Verify the Umlauts don't appear correctly

Example:
Deutsche Übersetzung turns into:
Deutsche {DC}bersetzung

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Katrin Fischer <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
            Summary|Broken diacritics on        |Broken diacritics on
                   |records exported as MARC    |records exported as MARC
                   |from cart on reimport       |from cart

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #10 from Jonathan Druart <[hidden email]> ---
Still ok for me on 18.11.x following comments 1 and 3.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #11 from Jonathan Druart <[hidden email]> ---
% marcdump ~/Downloads/cart.iso2709|grep 245
/home/jonathan/Downloads/cart.iso2709
245 10 _aäüö ❤ ✓

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #12 from Katrin Fischer <[hidden email]> ---
I have no idea what's going on there... but it doesn't work for me. :(

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #13 from Jonathan Druart <[hidden email]> ---
Could you attach the record here and tell us the different options you chose on
importing it?

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #14 from Jonathan Druart <[hidden email]> ---
Also on which screen the display starts to be incorrect.

--
You are receiving this mail because:
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Martin Renvoize <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
   Target Milestone|Oldversions                 |---

Owen Leonard <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Assignee|[hidden email]         |[hidden email]-commun
                   |                            |ity.org

--- Comment #15 from Owen Leonard <[hidden email]> ---
I cannot recreate this problem in master.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Jonathan Druart <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|REOPENED                    |RESOLVED
         Resolution|---                         |WORKSFORME

--- Comment #16 from Jonathan Druart <[hidden email]> ---
Closing again, please reopen (and attach the file) if still valid.

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

Katrin Fischer <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|RESOLVED                    |UNCONFIRMED
     Ever confirmed|1                           |0
         Resolution|WORKSFORME                  |---

--- Comment #17 from Katrin Fischer <[hidden email]> ---
I'd really like to get behind this issue. I just retested on our Koha 18.11.16
and we still have the issue. :(

Our test installation is publicly accessible, but I don't want to post the link
here. Joubu, maybe I could talk you through it?

For matching I just seleted the file and changed none of the other settings
(encoding defaults to UTF-8).

We do have one local change on that file as we did chose not to export items:

my $record = GetMarcBiblio({
biblionumber => $biblio,
- embed_items  => 1,
+ embed_items  => 0,

But that should not make a difference in encoding?

Attaching sample records.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #18 from Katrin Fischer <[hidden email]> ---
Created attachment 105333
  -->
https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=105333&action=edit
Sample records downloaded from cart

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

David Cook <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |[hidden email]

--- Comment #19 from David Cook <[hidden email]> ---
Given my bad experience the other day trying to import records converted from
GB2312 to UTF8 into Koha, I'm extra interested by this. Maybe it's a related
topic.

At a glance, those sample records look fine both in Latin1 and UTF8.

MarcEdit can convert the ISO MARC into its MRK format, but I'm failing to
convert it from ISO MARC to MARCXML.

When I try to read your sample records as UTF-8 using MARC::File::USMARC, I see
the following error:

UTF-8 "\xFC" does not map to Unicode

Using "xxd cart.iso2709", I see that the "fc" byte is the ü in über and für.
Ah, and FC is ü in Latin-1 encoding whereas in UTF-8 it's C3 BC.

So it sounds like Koha is exporting as Latin-1 but trying to import as UTF-8
and that's where it's falling over?

Needs more investigating, but that's the problem with your sample records I'd
say.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

David Cook <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           See Also|                            |https://bugs.koha-community
                   |                            |.org/bugzilla3/show_bug.cgi
                   |                            |?id=25600

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #20 from David Cook <[hidden email]> ---
Oh, Katrin, try importing it using /cgi-bin/koha/tools/stage-marc-import.pl
with a Character encoding of "ISO 8859-1". I bet it'll work.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #21 from Katrin Fischer <[hidden email]> ---
Hi David, it looks like you are correct. Using ISO 8859-1 encoding when staging
the MARC imports correctly. So... why do we not export in UTF-8 for the cart? I
think we do in other places as for example the MARC attached to the cart email
works correctly.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #22 from David Cook <[hidden email]> ---
(In reply to Katrin Fischer from comment #21)
> Hi David, it looks like you are correct. Using ISO 8859-1 encoding when
> staging the MARC imports correctly. So... why do we not export in UTF-8 for
> the cart? I think we do in other places as for example the MARC attached to
> the cart email works correctly.

That's a very good question. Which Koha version are you using? This is the
"Download" option in the cart? (OPAC or Staff Client?)

I'll take a quick look...

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #23 from David Cook <[hidden email]> ---
Ok it just looks like a bug to me.

opac/opac-downloadcart.pl doesn't instruct Perl how to output the bytes, and I
think Perl defaults to N8CS/Latin-1.

With opac/opac-sendbasket.pl, we explicitly encode the characters as UTF8
bytes.

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #24 from David Cook <[hidden email]> ---
(In reply to David Cook from comment #23)
> Ok it just looks like a bug to me.
>
> opac/opac-downloadcart.pl doesn't instruct Perl how to output the bytes, and
> I think Perl defaults to N8CS/Latin-1.
>
> With opac/opac-sendbasket.pl, we explicitly encode the characters as UTF8
> bytes.

That being said... I can't reproduce the problem. In 19.11, I added some
Chinese to a test record, and I was able to download it from Staff Client and
OPAC carts and Notepad++ says they're both UTF-8 and renders correctly...

I'll try with ü specifically...

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #25 from David Cook <[hidden email]> ---
Ha! If I use ü instead of 我, it outputs as Latin-1 and ü is a FC byte instead
of the C3 BC bytes.

--
You are receiving this mail because:
You are watching all bug changes.
You are the assignee for the bug.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
Reply | Threaded
Open this post in threaded view
|

[Bug 17842] Broken diacritics on records exported as MARC from cart

bugzilla-daemon
In reply to this post by bugzilla-daemon
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=17842

--- Comment #26 from David Cook <[hidden email]> ---
(In reply to David Cook from comment #25)
> Ha! If I use ü instead of 我, it outputs as Latin-1 and ü is a FC byte
> instead of the C3 BC bytes.

Using 我, I get the correct bytes: e6 88 91.

Now if I add ü after 我, I am guessing that whatever automatic character
encoding is happening (perhaps on the browser end?) will encode ü as UTF-8
instead of Latin-1

--
You are receiving this mail because:
You are the assignee for the bug.
You are watching all bug changes.
_______________________________________________
Koha-bugs mailing list
[hidden email]
https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs
website : http://www.koha-community.org/
git : http://git.koha-community.org/
bugs : http://bugs.koha-community.org/
123