Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixing some performance bottlenecks #183

Merged
merged 14 commits into from
May 3, 2022
Merged

Fixing some performance bottlenecks #183

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
1d3ac05
Update md.py
deedy5 Apr 30, 2022
aa368ec
Update utils.py
deedy5 Apr 30, 2022
278bd9b
Update cd.py
deedy5 Apr 30, 2022
b1b3aaf
Update utils.py
deedy5 Apr 30, 2022
ba3945b
add mypyc compilation
deedy5 May 1, 2022
b8f0425
Merge branch 'Ousret:master' into master
deedy5 May 1, 2022
ceb9605
remove mypyc compilation
deedy5 May 1, 2022
8fc2565
Update cd.py
deedy5 May 1, 2022
8f8aa5a
Update utils.py
deedy5 May 1, 2022
f4ba8f8
Update md.py
deedy5 May 1, 2022
2801266
Merge branch 'master' into master
deedy5 May 2, 2022
903e8dd
Update md.py
deedy5 May 3, 2022
9642bb9
small performance correction
deedy5 May 3, 2022
a65f4fe
def is_unprintable() correction
deedy5 May 3, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update md.py
  • Loading branch information
@deedy5
deedy5 authored May 1, 2022
commit f4ba8f816b9084492ec2d3ed7368d6d459d22b98
5 changes: 3 additions & 2 deletions charset_normalizer/md.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -138,7 +138,7 @@ def __init__(self) -> None:

def eligible(self, character: str) -> bool:
return True

def feed(self, character: str) -> None:
if is_unprintable(character):
self._unprintable_count += 1
Expand All @@ -164,7 +164,7 @@ def __init__(self) -> None:

def eligible(self, character: str) -> bool:
return character.isalpha() and is_latin(character)

def feed(self, character: str) -> None:
self._character_count += 1
if (
Expand Down Expand Up @@ -442,6 +442,7 @@ def ratio(self) -> float:

return self._successive_upper_lower_count_final / self._character_count


@lru_cache(maxsize=1024)
def is_suspiciously_successive_range(
unicode_range_a: Optional[str], unicode_range_b: Optional[str]
Expand Down