Umlauts are not handled correctly #70

New issue

Open

opened 2025-06-27 18:21:37 +02:00 by magicfelix · 1 comment

magicfelix commented 2025-06-27 18:21:37 +02:00 (Migrated from edugit.org)

Copy link

„straße” from a CSV file results in „stra√üe” in the database. This also causes the street_housenumber regex to fail matching strings containing e.g. an „ß”.

„straße” from a CSV file results in „stra√üe” in the database. This also causes the street_housenumber regex to fail matching strings containing e.g. an „ß”.

magicfelix commented 2025-06-27 18:43:17 +02:00 (Migrated from edugit.org)

Copy link

chardet.detect returns MacRoman for mv CSV file containing ß.

`chardet.detect` returns `MacRoman` for mv CSV file containing `ß`.

Sign in to join this conversation.

No Branch/Tag specified

Branches Tags

master

weblate

weblate-frontend

renovate/numpy-2.x

renovate/pandas-3.x

check/update-builddeps-package-json

66-adapt-to-places

62-add-generic-default-template-for-room

improved-and-export

csv-export

stable/3.0

release/2.0

feature/more-generic-field-types

feature/general-csv-importer

5.0.0

5.0.0b0

4.0.0.post1

4.0.0.post0

4.0.0

3.0.2

3.0.1

3.0

3.0b0

2.3.1

2.3

2.2.1

2.2

2.1

2.0.post0

2.0

2.0rc2

2.0rc1

2.0b1

2.0b0

1.0a3

1.0a2

1.0a1

1.0a0

Labels

Clear labels   

Security

  

TeX

Needs LaTeX template

  

auto-update

  

board

done

  

board

ready

  

board

todo

  

check

delete-eslint-rc-js

  

check

update-builddeps-package-json

  

check

update-eslint-rc-js

  

check

update-gitignore

  

check

update-merge-request-template

  

check

update-prettier-ignore

  

check

update-pyproject-toml

  

check

update-renovate-json

  

check

update-tox-ini

  

part

backend

Backend (view code, models, logic, etc.)

  

part

ci

  

part

docs

Issue or addition to the documentation

  

part

frontend

Frontend (templates, etc.)

  

part

i18n

Translation or internationalisation issue

  

part

non-technical

Non-technical (policy, maintenance, etc.) issue or discussion

  

part

packaging

Issue concerning the packaging of AlekSIS and components

  

prio

1

Priority High

  

prio

2

Priority Medium

  

prio

3

Priority Low

  

release-mr-5.x

  

size

large

  

size

medium

  

size

small

  

source

customer

Requested by a customer or affiliated user

  

source

customer::fsmw

  

source

customer::fss

  

source

customer::teckids

  

source

downstream

Issue or merge request from other projects using AlekSIS or parts of it

  

type

breaking

  

type

bug

Bug

  

type

feature

New feature

  

type

refactoring

  

workflow

blocked

Issue is blocked by another issue

  

workflow

confirmed

The bug is reproducible and will be fixed

  

workflow

current-todo

  

workflow

discussing

Needs to be discussed before implementation

  

workflow

new-app

Requires new AlekSIS app, which has to be created

  

workflow

wontfix

The bug is not reproducible or the feature was decided against

No labels

Security

TeX

auto-update

board

done

board

ready

board

todo

check

delete-eslint-rc-js

check

update-builddeps-package-json

check

update-eslint-rc-js

check

update-gitignore

check

update-merge-request-template

check

update-prettier-ignore

check

update-pyproject-toml

check

update-renovate-json

check

update-tox-ini

part

backend

part

ci

part

docs

part

frontend

part

i18n

part

non-technical

part

packaging

prio

1

prio

2

prio

3

release-mr-5.x

size

large

size

medium

size

small

source

customer

source

customer::fsmw

source

customer::fss

source

customer::teckids

source

downstream

type

breaking

type

bug

type

feature

type

refactoring

workflow

blocked

workflow

confirmed

workflow

current-todo

workflow

discussing

workflow

new-app

workflow

wontfix

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

aleksis/AlekSIS-App-CSVImport#70

No description provided.