{"id":5065,"date":"2025-09-03T16:04:46","date_gmt":"2025-09-03T14:04:46","guid":{"rendered":"https:\/\/www.psyctc.org\/psyctc\/?post_type=docs&#038;p=5065"},"modified":"2025-09-03T16:04:46","modified_gmt":"2025-09-03T14:04:46","password":"","slug":"internal-reliability-consistency","status":"publish","type":"docs","link":"https:\/\/www.psyctc.org\/psyctc\/glossary2\/internal-reliability-consistency\/","title":{"rendered":"Internal reliability \/ consistency"},"content":{"rendered":"\n<p>There&#8217;s a sometimes heated debate about whether the term &#8220;consistency&#8221; is or isn&#8217;t more appropriate than the term &#8220;reliability&#8221;. I favour &#8220;reliability&#8221; and may create a glossary entry to explain why one day.  For now, if a peer reviewer doesn&#8217;t like you using &#8220;reliability&#8221;, well I favour taking them on but the issue is academic and not really important!<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Details<\/h4>\n\n\n\n<p>Internal reliability is one of the categories of ways to evaluate the reliability of a measure.  It is only applicable to multi-item measures whether those are rating scales or self-report questionnaires.  The basic idea is that if the items in the rating scale or questionnaire do reflect something we want to measure as a dimension on which the participants completing the measure differ, then the scores on the items, across a group of participants, should show strong intercorrelation with each other.<\/p>\n\n\n\n<p>That&#8217;s it!<\/p>\n\n\n\n<p>Well, the most used index of internal reliability is Cronbach&#8217;s coefficient alpha, if you like academic distinctions and the minutiae of psychometrics then McDonald&#8217;s omega has a claim to be a slightly better measure though its superiority turns pretty much entirely on how much you think our data fit the strictures of the multi-dimensional versus unidimensional variance in the data and whether the items show heteroscedasticity (variance varying across items) or not.  See the entries for Cronbach&#8217;s alpha and McDonald&#8217;s omega.<\/p>\n\n\n\n<p>One now deceased index, though an easy one to understand was the split-half reliability: the correlation between scores made up by two separate halves of the items in the measure.  Hm, better create an entry for that though if you see it used in a report then either you are reading something from the 1960s or 70s or earlier, or something where someone is way behind developments in psychometrics.  (However, I am much in favour of us not rejecting early reports either simply because they are old, or because they may not  have kept up with sometimes rather &#8220;angels on the head of a pin&#8221; academic issues in psychometrics!<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Try also<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/www.psyctc.org\/psyctc\/glossary2\/reliability\/\" title=\"\">Reliability<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.psyctc.org\/psyctc\/glossary2\/cronbachs-coefficient-alpha\/\" title=\"\">Cronbach&#8217;s coefficient alpha<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.psyctc.org\/psyctc\/glossary2\/mcdonalds-omega\/\" title=\"\">McDonald&#8217;s omega<\/a><\/li>\n\n\n\n<li>Psychometrics<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Chapters<\/h4>\n\n\n\n<p>Chapter 3, \u201cHow to judge the quality of an outcome measure\u201d in the OMbook.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Online resources<\/h4>\n\n\n\n<p>I will probably create an Rblog entry expanding on the issues in here and probably a shiny app that will give you various indices of internal reliability from your data, but none yet! <\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Dates<\/h4>\n\n\n\n<p>First created 3.ix.25.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>There&#8217;s a sometimes heated debate about whether the term &#8220;consistency&#8221; is or isn&#8217;t more appropriate than the term &#8220;reliability&#8221;. I favour &#8220;reliability&#8221; and may create a glossary entry to explain why one day. For now, if a peer reviewer doesn&#8217;t like you using &#8220;reliability&#8221;, well I favour taking them on but the issue is academic &hellip; <a href=\"https:\/\/www.psyctc.org\/psyctc\/glossary2\/internal-reliability-consistency\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Internal reliability \/ consistency<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"footnotes":""},"doc_category":[],"glossaries":[],"doc_tag":[],"knowledge_base":[],"class_list":["post-5065","docs","type-docs","status-publish","hentry"],"year_month":"2026-05","word_count":395,"total_views":"385","reactions":{"happy":"0","normal":"0","sad":"0"},"author_info":{"name":"chris","author_nicename":"chris","author_url":"https:\/\/www.psyctc.org\/psyctc\/author\/chris\/"},"doc_category_info":[],"doc_tag_info":[],"knowledge_base_info":[],"knowledge_base_slug":[],"_links":{"self":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs\/5065","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs"}],"about":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/types\/docs"}],"author":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/comments?post=5065"}],"version-history":[{"count":1,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs\/5065\/revisions"}],"predecessor-version":[{"id":5066,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs\/5065\/revisions\/5066"}],"wp:attachment":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/media?parent=5065"}],"wp:term":[{"taxonomy":"doc_category","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/doc_category?post=5065"},{"taxonomy":"glossaries","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/glossaries?post=5065"},{"taxonomy":"doc_tag","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/doc_tag?post=5065"},{"taxonomy":"knowledge_base","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/knowledge_base?post=5065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}