You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Upload it to to datapusher, log says the following:
Fetching from: http://localhost/data/fi/dataset/3180686e-5a17-4b83-8d93-8a3cc954fccd/resource/bdcf31b0-3c90-46e7-8b56-94a6ad1f897f/download/test_data.csv...
File format: CSV
Downloading 52.99MB file...
Fetched 52.99MB file in 0.67 seconds.
ANALYZING WITH QSV..
Normalizing/UTF-8 transcoding CSV...
Identified encoding of the file: UTF-8
File is not UTF-8 encoded. Re-encoding from UTF-8
to UTF-8
iconv: source charset UTF-8
Invalid argument
Job aborted as the file cannot be re-encoded to UTF-8: Command '['iconv', '-f', 'UTF-8\n', '-t', 'UTF-8', '/tmp/tmpr35v1f3a/tmp.CSV', '--output', '/tmp/tmpr35v1f3a/qsv_input_utf_8_encoded.csv']' returned non-zero exit status 1.
Describe the bug
uchardet says that the file is UTF-8 file but datapusher still tries to re-encode it
To Reproduce
Example file https://www.avoindata.fi/data/dataset/4b64be55-5a69-4f6b-a9d5-d4cbbe5c4382/resource/6409bdec-4a48-46a9-8729-5a727e37cd55/download/data.csv
Upload it to to datapusher, log says the following:
it appears to be failing here:
datapusher-plus/datapusher/jobs.py
Line 683 in 2c648b2
The text was updated successfully, but these errors were encountered: