Validate your coder quality in our automatic reliability testing system.
The reliability coefficient is calculated to observe whether different coders have reached an acceptable level of agreement with a consistent coding scheme. If the desired reliability level is not reached, coders need to be trained and instructed again to ensure the desired level of reliability. After that, you can start formal coding. The platform currently provides four commonly used reliability test formulas: Holsti’s Coefficient, Cohen’s Kappa (k), Scott’s Pi, and Krippendorff’s alpha. The application of the formula greatly improves the authority of the reliability test. The platform can directly check the inter-coder reliability on each category question, convenient for coding correction and supervision.
#DiVoMiner #online content analysis platform #inter-coder reliability