Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Krippendorff's alpha reliability coefficient #4

Open
agarie opened this issue Mar 18, 2015 · 1 comment
Open

Add support for Krippendorff's alpha reliability coefficient #4

agarie opened this issue Mar 18, 2015 · 1 comment

Comments

@agarie
Copy link
Member

agarie commented Mar 18, 2015

(Original: clbustos/statsample#13)

(First of all, thanks so much for this package!
While it took me some time to get used to it, it's super handy even for simple statistics in business applications.)

I might lack the knowledge to combine the pieces of this framework, but I'm missing explicit support for measuring reliability between raters, e.g. Krippendorff's alpha.

R provides a nice interface for this here.

Thanks again for your efforts and time in supporting this project!

@agarie
Copy link
Member Author

agarie commented Mar 18, 2015

@ludwigschubert also replied:

Yes.

The Original paper by Prof. Krippendorf is available here.
Together with a colleague he also provided a (to me unreadable) implementation in SAS here.

Instead, I'd recommend working of Matlab code and the wikipedia article on the subject.
I'm currently using R's package "irr"'s implementation, which can be found here - I extracted the specific file for you in this GIST.

Let me know if there's anything else I can help with - unfortunately I had about one introductory class in statistics, so the finer points of Krippendorf's alpha are entirely lost on me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant