You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When the beginning and end of spans are not the same, I encounter an error when calculating Krippendorff.
For instance, this error arises when working with the following matrix/dataframe.
begin end annotation
84 95 c1
96 100 c3
84 95 c1
96 99 c3
The error arises due to a RuntimeWarning indicating an invalid value encountered during scalar division. Specifically, it occurs at the calculation step: 1 - (o * d).sum() / (e * d).sum()
krippendorff.py:364
The text was updated successfully, but these errors were encountered:
Krippendorff assumes that the spans are the same and only the labels/annotations differ. In your case, you could either 1) manually ignore non matching annotations (if that makes sense in your use case) or 2) use the gamma IAA measure (also provided in inceptalytics https://aclanthology.org/J15-3003.pdf
When the beginning and end of spans are not the same, I encounter an error when calculating Krippendorff.
For instance, this error arises when working with the following matrix/dataframe.
begin end annotation
84 95 c1
96 100 c3
84 95 c1
96 99 c3
The error arises due to a RuntimeWarning indicating an invalid value encountered during scalar division. Specifically, it occurs at the calculation step: 1 - (o * d).sum() / (e * d).sum()
krippendorff.py:364
The text was updated successfully, but these errors were encountered: