Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Import tool does not read UTF-8 encoded files as UTF-8 #1379

Closed
AnnikaRPS opened this issue Nov 16, 2021 · 5 comments
Closed

Import tool does not read UTF-8 encoded files as UTF-8 #1379

AnnikaRPS opened this issue Nov 16, 2021 · 5 comments
Assignees
@msevestre
Labels
prio: high
Milestone
Version 11 Update 2

Comments

@AnnikaRPS
Copy link

When importing data from an UTF-8 encoded data file, PK-Sim seems to read the data as another format (probably LATIN-1). This results in problems when the file contains a "µ" symbol, as this is encoded differently in UTF-8 in comparison to LATIN-1. The result looks like this:
image
@msevestre msevestre transferred this issue from Open-Systems-Pharmacology/PK-Sim Nov 16, 2021
@georgeDaskalakis
Copy link
Contributor

Hi @AnnikaRPS ! Could you please provide us with the file so that I can more easily reproduce the error?

@AnnikaRPS
Copy link
Author

Hi @georgeDaskalakis,
this is the dummy dataset encoded as UTF-8
DummyDataUTF8.csv

@PavelBal
Copy link
Member

Even excel cannot read this file properly, so I would say - very low prio..

@Yuri05
Copy link
Member

Yuri05 commented Nov 30, 2021

Let's be better than Excel then :)

@msevestre
Copy link
Member

msevestre commented Mar 30, 2023 •
edited
Loading

boom
image

msevestre added a commit that referenced this issue Mar 30, 2023
@msevestre
Fixes #1379
96877d6
@Yuri05 Yuri05 closed this as completed in bf8a9bb Mar 30, 2023
@rwmcintosh rwmcintosh added this to v11.2 Mar 30, 2023
@rwmcintosh rwmcintosh moved this to ✅ Done in v11.2 Mar 30, 2023
@rwmcintosh rwmcintosh added this to the Version 11 Update 2 milestone Mar 30, 2023
rwmcintosh added a commit that referenced this issue Feb 14, 2024
@rwmcintosh @georgeDaskalakis @msevestre
Merge v11.2 into main (#2208)
69e1dfd 
* 1886 importer unit for fraction not recognized (#1892)

* changing the check

* correction to get the first non empty unit

* cleaning up

* Fixes #1925 (#1926)

@Yuri05 Merging. NEed to test in the app

* Fixes #1925 (#1927)

* 2566 fixed (#1932)

* nunit adapter updated (#1938)

* Fixes #1379 (#1948)

* Fixes #1946 mobi cannot handler observed data sets with only 1 point (#1947)

* Fixes #1949 data importer parsing unit should be case insensitive (#1952)

* Fixes #1949 data importer parsing unit should be case insensitive

* Run resharper

* Remove fake to use real dimensions

* Remove fake to use real dimensions

* refactoring and removing further .HasUnit() calls

---------

Co-authored-by: georgeDaskalakis <37107428+georgeDaskalakis@users.noreply.github.com>

* preventing exception (#1957)

* templates changed (#1962)

---------

Co-authored-by: georgeDaskalakis <37107428+georgeDaskalakis@users.noreply.github.com>
Co-authored-by: Michael Sevestre <michael@design2code.ca>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@msevestre msevestre

Labels
prio: high
Projects
No open projects
v11.2
Status: ✅ Done
Milestone
Version 11 Update 2
Development

No branches or pull requests
7 participants
@rwmcintosh @msevestre @abdelr @Yuri05 @PavelBal @georgeDaskalakis @AnnikaRPS