{"id":4730,"date":"2025-02-18T09:31:50","date_gmt":"2025-02-18T08:31:50","guid":{"rendered":"https:\/\/www.psyctc.org\/psyctc\/?post_type=docs&#038;p=4730"},"modified":"2025-02-18T09:33:17","modified_gmt":"2025-02-18T08:33:17","password":"","slug":"f-measure","status":"publish","type":"docs","link":"https:\/\/www.psyctc.org\/psyctc\/glossary2\/f-measure\/","title":{"rendered":"F-measure"},"content":{"rendered":"\n<p>Also known as the &#8220;positive specific agreement&#8221; measure. <\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Details<\/h4>\n\n\n\n<p>In our field you are likely to see it as a measure of inter-rater agreement where the total number of possible objects to be rated is indeterminate, for example when a text can be broken into ratable segments in many different ways and two raters won&#8217;t break the text into the same segments.  My <a href=\"https:\/\/www.psyctc.org\/Rblog\/index.html\" target=\"_blank\" rel=\"noopener\" title=\"Rblog\">Rblog<\/a> post: <a href=\"https:\/\/www.psyctc.org\/Rblog\/posts\/2025-02-17-f-measure\/\" target=\"_blank\" rel=\"noopener\" title=\"\">F-measure: \u2018positive specific agreement\u2019 index<\/a> shows the details (don&#8217;t worry, it&#8217;s a very short post!) and also shows that Cohen&#8217;s kappa converges on the F-measure as the number of possible segments to rate (say) gets very large.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Try also<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Agreement measures<\/li>\n\n\n\n<li><a href=\"https:\/\/www.psyctc.org\/psyctc\/glossary2\/inter-rater-agreement-reliability\/\" title=\"\">Inter-rater agreement\/reliability<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/www.psyctc.org\/psyctc\/glossary2\/cohens-kappa\/\" title=\"\">Cohen&#8217;s kappa<\/a><\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Chapters<\/h4>\n\n\n\n<p>Not covered in the OMbook.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Online resources<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>My <a href=\"https:\/\/www.psyctc.org\/Rblog\/index.html\" target=\"_blank\" rel=\"noopener\" title=\"Rblog\">Rblog<\/a> post: <a href=\"https:\/\/www.psyctc.org\/Rblog\/posts\/2025-02-17-f-measure\/\" target=\"_blank\" rel=\"noopener\" title=\"\">F-measure: \u2018positive specific agreement\u2019 index<\/a><\/li>\n\n\n\n<li>I will try to create a shiny app to compute the F-measure<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Dates<\/h4>\n\n\n\n<p>First created 18.ii.25.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Also known as the &#8220;positive specific agreement&#8221; measure. Details In our field you are likely to see it as a measure of inter-rater agreement where the total number of possible objects to be rated is indeterminate, for example when a text can be broken into ratable segments in many different ways and two raters won&#8217;t &hellip; <a href=\"https:\/\/www.psyctc.org\/psyctc\/glossary2\/f-measure\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">F-measure<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","template":"","meta":{"footnotes":""},"doc_category":[],"glossaries":[],"doc_tag":[],"knowledge_base":[],"class_list":["post-4730","docs","type-docs","status-publish","hentry"],"year_month":"2026-04","word_count":143,"total_views":"375","reactions":{"happy":"0","normal":"0","sad":"0"},"author_info":{"name":"chris","author_nicename":"chris","author_url":"https:\/\/www.psyctc.org\/psyctc\/author\/chris\/"},"doc_category_info":[],"doc_tag_info":[],"knowledge_base_info":[],"knowledge_base_slug":[],"_links":{"self":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs\/4730","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs"}],"about":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/types\/docs"}],"author":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/comments?post=4730"}],"version-history":[{"count":2,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs\/4730\/revisions"}],"predecessor-version":[{"id":4732,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/docs\/4730\/revisions\/4732"}],"wp:attachment":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/media?parent=4730"}],"wp:term":[{"taxonomy":"doc_category","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/doc_category?post=4730"},{"taxonomy":"glossaries","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/glossaries?post=4730"},{"taxonomy":"doc_tag","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/doc_tag?post=4730"},{"taxonomy":"knowledge_base","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/knowledge_base?post=4730"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}