{"id":2877,"date":"2022-07-23T16:35:25","date_gmt":"2022-07-23T14:35:25","guid":{"rendered":"https:\/\/www.psyctc.org\/psyctc\/?p=2877"},"modified":"2022-07-23T21:23:43","modified_gmt":"2022-07-23T19:23:43","slug":"sometimes-n4-is-enough","status":"publish","type":"post","link":"https:\/\/www.psyctc.org\/psyctc\/2022\/07\/23\/sometimes-n4-is-enough\/","title":{"rendered":"Sometimes n=4 is enough"},"content":{"rendered":"\n<p>Back in 2002, with two colleagues, I published a paper: <br><br>Evans, C., Hughes, J., &amp; Houston, J. (2002). <em>Significance testing the validity of ideographic methods: A little derangement goes a long way<\/em>. British Journal of Mathematical and Statistical Psychology, 55(2), 385\u2013390. <a href=\"https:\/\/doi.org\/10.1348\/000711002760554525\">https:\/\/doi.org\/10.1348\/000711002760554525<\/a>.  <\/p>\n\n\n\n<p><a href=\"https:\/\/www.psyctc.org\/psyctc\/contact-form\/\" rel=\"nofollow\" title=\"Contact Form\">Contact me<\/a> if you&#8217;d like a copy!<\/p>\n\n\n\n<p>In the paper we used a bit of old maths to show a simple way of validating idiographic\/ideographic  data.  The data in question were principal component plots of person repertory grids created by six patients in a prison psychotherapy group (who gave permission for this).  These plots are completely personal to each individual.  They depend on the elements the patients chose for the roles in the grid (e.g. victim, brother, boss, ideal self) and the constructs on which they chose to rate them, (e.g. aggressive, caring, selfish) and the ratings they gave each element.  <\/p>\n\n\n\n<p>Those principal component plots represent the best two dimensional plot of all the ratings for each grid.  Julia (Houston) had asked the two therapists if they could map the six plots back to the patients. As we said in the paper:<br><em>Both therapists matched four of the six pre-therapy grids successfully; one therapist matched all six post-therapy grids and the other matched three of the six. We sought to assess the probabilities that these matchings might have been achieved by chance alone. This paper reports the logic which shows that this probability was lower than a conventional criterion of significance ( p &lt; 0.05) where four or six grids were matched correctly.<\/em><\/p>\n\n\n\n<p>This is a completely general method, the steps are:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Take the data, the idiographic information you have from <em>n <\/em>individuals (<em>n <\/em>&gt;= 4)<\/li><li>Shuffle the data<\/li><li>Present them to someone who knows the people who created the data<\/li><li>Ask judge to match data to people<\/li><li>The score is the number of correct matches<\/li><li>If the score is 4 or more, regardless of <em>n<\/em>, the chances of this being achieved by chance matching alone is p &lt; .05, i.e. statistically significant at the usual criterion for that.<\/li><\/ul>\n\n\n\n<p>Here&#8217;s the same in slightly tongue in cheek cartoon format.<\/p>\n\n\n\n<h4 class=\"has-text-align-center wp-block-heading\">Steps 1 and 2<\/h4>\n\n\n\n<figure class=\"wp-block-image size-large .border-image\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"480\" src=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/steps_1_and_2-1024x480.png\" alt=\"\" class=\"wp-image-2880\" srcset=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/steps_1_and_2-1024x480.png 1024w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/steps_1_and_2-300x141.png 300w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/steps_1_and_2-768x360.png 768w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/steps_1_and_2.png 1131w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<h4 class=\"has-text-align-center wp-block-heading\">Step 3<\/h4>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"834\" height=\"574\" src=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_3.png\" alt=\"\" class=\"wp-image-2881\" srcset=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_3.png 834w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_3-300x206.png 300w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_3-768x529.png 768w\" sizes=\"auto, (max-width: 834px) 100vw, 834px\" \/><\/figure>\n\n\n\n<h4 class=\"has-text-align-center wp-block-heading\">Steps 4 and 5<\/h4>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"556\" src=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_4_and_5-1024x556.png\" alt=\"\" class=\"wp-image-2882\" srcset=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_4_and_5-1024x556.png 1024w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_4_and_5-300x163.png 300w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_4_and_5-768x417.png 768w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/06\/step_4_and_5.png 1219w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>In the cartoon example the only thing that distinguishes the six sets of idiographic data is actually their colour (yes, this is not a very serious example).  The judge successfully mapped four of the six which has probability (that they would score four or even better by chance alone) of p = .022 (see lookup table at <a href=\"https:\/\/www.psyctc.org\/psyctc\/root\/stats\/derangements-lookup-table\/\">https:\/\/www.psyctc.org\/psyctc\/root\/stats\/derangements-lookup-table\/<\/a>).  <\/p>\n\n\n\n<p>That is clearly less than .05 so it meets the conventional criterion of &#8220;statistical significance&#8221;, i.e. by that convention we reject the null hypothesis that no information is contained in the data and accept the alternative that, though the data were idiographic, and the way the judge did the mapping may have been unique to that one judge and their particular knowledge of the six people (i.e. an idiographic judgement on idiographic data), it has some validity.<\/p>\n\n\n\n<p>To most of us who are neither mathematicians nor statisticians it may seem utterly  counter-intuitive that <em>regardless of the number of objects<\/em> a score of four or more is always good enough for p &lt; .05.  Perhaps it&#8217;s so counter-intuitive perhaps that we switch off our own judgement and either decide that the method was published in a good peer-reviewed journal and so must be correct (it is!), or simply believe it cannot be correct.<\/p>\n\n\n\n<p>However, it&#8217;s not as counter-intuitive as it may first seem: as the <em>n <\/em>goes up the number of ways of mapping just four of them correctly does go up rapidly as this table shows.   <\/p>\n\n\n<h2 class=\"wpdt-c\" id=\"wdt-table-title-14\">Number of ways of getting four correct from n objects<\/h2>\n<div class=\"wpdt-c wdt-skin-light\">\n    \n    <input type=\"hidden\" id=\"wdtNonceFrontendServerSide_14\" name=\"wdtNonceFrontendServerSide_14\" value=\"121637e6e6\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/psyctc\/wp-json\/wp\/v2\/posts\/2877\" \/>    <input type=\"hidden\" id=\"table_1_desc\"\n           value='{\"tableId\":\"table_1\",\"tableType\":\"manual\",\"selector\":\"#table_1\",\"responsive\":false,\"responsiveAction\":\"icon\",\"editable\":false,\"inlineEditing\":false,\"infoBlock\":false,\"pagination_top\":0,\"pagination\":0,\"paginationAlign\":\"right\",\"paginationLayout\":\"full_numbers\",\"paginationLayoutMobile\":\"simple\",\"file_location\":\"\",\"tableSkin\":\"light\",\"table_wcag\":0,\"simple_template_id\":0,\"scrollable\":false,\"fixedLayout\":false,\"globalSearch\":false,\"showRowsPerPage\":false,\"popoverTools\":false,\"loader\":\"1\",\"showCartInformation\":1,\"hideBeforeLoad\":false,\"number_format\":2,\"decimalPlaces\":2,\"spinnerSrc\":\"https:\\\/\\\/www.psyctc.org\\\/psyctc\\\/wp-content\\\/plugins\\\/wpdatatables\\\/assets\\\/\\\/img\\\/spinner.gif\",\"groupingEnabled\":false,\"tableWpId\":14,\"dataTableParams\":{\"sDom\":\"BT\\u003C\\u0027clear\\u0027\\u003Et\",\"bSortCellsTop\":false,\"bFilter\":true,\"aLengthMenu\":[[1,5,10,25,50,100,-1],[1,5,10,25,50,100,\"All\"]],\"iDisplayLength\":10,\"columnDefs\":[{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":false,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"wdt_ID\",\"origHeader\":\"wdt_ID\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-wdt_id\",\"aTargets\":[0]},{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"n\",\"origHeader\":\"n\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-n\",\"aTargets\":[1]},{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"number\",\"origHeader\":\"number\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-number\",\"aTargets\":[2]}],\"bAutoWidth\":false,\"order\":[[0,\"asc\"]],\"ordering\":false,\"fixedHeader\":{\"header\":false,\"headerOffset\":0},\"fixedColumns\":false,\"buttons\":[{\"extend\":\"print\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_print\",\"title\":\"Number of ways of getting four correct from n objects\",\"text\":\"Print\"},{\"extend\":\"excelHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_xls\",\"filename\":\"Number of ways of getting four correct from n objects\",\"title\":null,\"text\":\"Excel\"},{\"extend\":\"csvHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_csv\",\"title\":\"Number of ways of getting four correct from n objects\",\"text\":\"CSV\"},{\"extend\":\"copyHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_copy\",\"filename\":\"Number of ways of getting four correct from n objects\",\"title\":null,\"text\":\"Copy\"}],\"oLanguage\":{\"sSearchPlaceholder\":\"\"},\"bProcessing\":false,\"serverSide\":true,\"ajax\":{\"url\":\"https:\\\/\\\/www.psyctc.org\\\/psyctc\\\/wp-admin\\\/admin-ajax.php?action=get_wdtable&table_id=14\",\"type\":\"POST\"},\"oSearch\":{\"bSmart\":false,\"bRegex\":false,\"sSearch\":\"\"}},\"customRowDisplay\":\"\",\"tabletWidth\":\"1024\",\"mobileWidth\":\"480\",\"renderFilter\":\"footer\",\"advancedFilterEnabled\":false,\"serverSide\":true,\"autoRefreshInterval\":0,\"processing\":true,\"fnServerData\":true,\"columnsFixed\":0,\"sumFunctionsLabel\":\"\",\"avgFunctionsLabel\":\"\",\"minFunctionsLabel\":\"\",\"maxFunctionsLabel\":\"\",\"columnsDecimalPlaces\":{\"wdt_ID\":-1,\"n\":-1,\"number\":-1},\"columnsThousandsSeparator\":{\"wdt_ID\":0,\"n\":1,\"number\":1},\"sumColumns\":[],\"avgColumns\":[],\"sumAvgColumns\":[],\"timeFormat\":\"h:i A\",\"datepickFormat\":\"dd\\\/mm\\\/yy\"}'\/>\n\n    <table id=\"table_1\"\n           class=\"   display nowrap wdt-no-display data-t data-t wpDataTable wpDataTableID-14 \"\n           style=\"\"\n           data-described-by='table_1_desc'\n           data-wpdatatable_id=\"14\">\n        \n        <!-- Table header -->\n        \n<thead>\n<tr>\n                    <th\n                        class=\" wdtheader sort numdata integer \"\n        style=\"\">        wdt_ID<\/th>        <th\n        data-class=\"expand\"                class=\" wdtheader sort numdata integer \"\n        style=\"\">        n<\/th>        <th\n                        class=\" wdtheader sort numdata integer \"\n        style=\"\">        Number of ways of getting four correct from n<\/th>    <\/tr>\n<\/thead>\n        <!-- \/Table header -->\n\n        <!-- Table body -->\n        \n<tbody>\n<!-- Table body -->\n<div data-id=\"14\"\n     class=\"wdt-timeline-item wdt-timeline-table_1\"\n     style=\"\">\n    <div class=\"wdt-table-loader\">\n        <div class=\"wdt-table-loader-row wdt-table-loader-header\">\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n        <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n            <\/div>\n<\/div><!-- \/Table body -->\n                    <tr id=\"table_14_row_0\"\n            data-row-index=\"0\">\n                            <td style=\"\">1<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">1<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_1\"\n            data-row-index=\"1\">\n                            <td style=\"\">2<\/td>\n                            <td style=\"\">5<\/td>\n                            <td style=\"\">0<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_2\"\n            data-row-index=\"2\">\n                            <td style=\"\">3<\/td>\n                            <td style=\"\">6<\/td>\n                            <td style=\"\">15<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_3\"\n            data-row-index=\"3\">\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">7<\/td>\n                            <td style=\"\">70<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_4\"\n            data-row-index=\"4\">\n                            <td style=\"\">5<\/td>\n                            <td style=\"\">8<\/td>\n                            <td style=\"\">630<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_5\"\n            data-row-index=\"5\">\n                            <td style=\"\">6<\/td>\n                            <td style=\"\">9<\/td>\n                            <td style=\"\">5,544<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_6\"\n            data-row-index=\"6\">\n                            <td style=\"\">7<\/td>\n                            <td style=\"\">10<\/td>\n                            <td style=\"\">55,650<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_7\"\n            data-row-index=\"7\">\n                            <td style=\"\">8<\/td>\n                            <td style=\"\">11<\/td>\n                            <td style=\"\">611,820<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_8\"\n            data-row-index=\"8\">\n                            <td style=\"\">9<\/td>\n                            <td style=\"\">12<\/td>\n                            <td style=\"\">7,342,335<\/td>\n                    <\/tr>\n                            <tr id=\"table_14_row_9\"\n            data-row-index=\"9\">\n                            <td style=\"\">10<\/td>\n                            <td style=\"\">13<\/td>\n                            <td style=\"\">95,449,640<\/td>\n                    <\/tr>\n            <\/tbody>        <!-- \/Table body -->\n\n        <!-- Table footer -->\n        \n        <!-- \/Table footer -->\n    <\/table>\n\n<\/div><style>\n<\/style>\n<style>\n                    \n                                                                                        \/* table font color *\/\n    .wpdt-c.wpDataTablesWrapper table.wpdtSimpleTable,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable {\n        font-family: Lucida Sans Unicode, Lucida Grande, sans-serif !important;\n    }\n\n            \/* table font size *\/\n    .wpdt-c.wpDataTablesWrapper table.wpdtSimpleTable,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable {\n        font-size: 20px !important;\n    }\n\n            \n                <\/style>\n<style>\n<\/style>\n<style>\n                            \n                                \/* table font color *\/\n    .wpdt-c.wpDataTablesWrapper table#wpdtSimpleTable-14,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable.wpDataTableID-14 {\n        font-family: Lucida Sans Unicode, Lucida Grande, sans-serif !important;\n    }\n\n                \n                <\/style>\n\n\n\n\n<p> However, the total number of ways of permuting the <em>n <\/em>is also rocketing up and faster:<\/p>\n\n\n<h2 class=\"wpdt-c\" id=\"wdt-table-title-13\">Total number of ways of permuting n objects<\/h2>\n<div class=\"wpdt-c wdt-skin-light\">\n    \n    <input type=\"hidden\" id=\"wdtNonceFrontendServerSide_13\" name=\"wdtNonceFrontendServerSide_13\" value=\"dabb9ec0ed\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/psyctc\/wp-json\/wp\/v2\/posts\/2877\" \/>    <input type=\"hidden\" id=\"table_2_desc\"\n           value='{\"tableId\":\"table_2\",\"tableType\":\"manual\",\"selector\":\"#table_2\",\"responsive\":false,\"responsiveAction\":\"icon\",\"editable\":false,\"inlineEditing\":false,\"infoBlock\":false,\"pagination_top\":0,\"pagination\":0,\"paginationAlign\":\"right\",\"paginationLayout\":\"full_numbers\",\"paginationLayoutMobile\":\"simple\",\"file_location\":\"\",\"tableSkin\":\"light\",\"table_wcag\":0,\"simple_template_id\":0,\"scrollable\":false,\"fixedLayout\":false,\"globalSearch\":false,\"showRowsPerPage\":false,\"popoverTools\":false,\"loader\":\"1\",\"showCartInformation\":1,\"hideBeforeLoad\":false,\"number_format\":2,\"decimalPlaces\":2,\"spinnerSrc\":\"https:\\\/\\\/www.psyctc.org\\\/psyctc\\\/wp-content\\\/plugins\\\/wpdatatables\\\/assets\\\/\\\/img\\\/spinner.gif\",\"groupingEnabled\":false,\"tableWpId\":13,\"dataTableParams\":{\"sDom\":\"BT\\u003C\\u0027clear\\u0027\\u003Et\",\"bSortCellsTop\":false,\"bFilter\":true,\"aLengthMenu\":[[1,5,10,25,50,100,-1],[1,5,10,25,50,100,\"All\"]],\"iDisplayLength\":-1,\"columnDefs\":[{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":false,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"wdt_ID\",\"origHeader\":\"wdt_ID\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-wdt_id\",\"aTargets\":[0]},{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"n\",\"origHeader\":\"n\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-n\",\"aTargets\":[1]},{\"sType\":\"string\",\"wdtType\":\"string\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"possibleways\",\"origHeader\":\"possibleways\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\" column-possibleways\",\"aTargets\":[2]}],\"bAutoWidth\":false,\"order\":[[0,\"asc\"]],\"ordering\":false,\"fixedHeader\":{\"header\":false,\"headerOffset\":0},\"fixedColumns\":false,\"buttons\":[{\"extend\":\"print\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_print\",\"title\":\"Total number of ways of permuting n objects\",\"text\":\"Print\"},{\"extend\":\"excelHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_xls\",\"filename\":\"Total number of ways of permuting n objects\",\"title\":null,\"text\":\"Excel\"},{\"extend\":\"csvHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_csv\",\"title\":\"Total number of ways of permuting n objects\",\"text\":\"CSV\"},{\"extend\":\"copyHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_copy\",\"filename\":\"Total number of ways of permuting n objects\",\"title\":null,\"text\":\"Copy\"}],\"oLanguage\":{\"sSearchPlaceholder\":\"\"},\"bProcessing\":false,\"serverSide\":true,\"ajax\":{\"url\":\"https:\\\/\\\/www.psyctc.org\\\/psyctc\\\/wp-admin\\\/admin-ajax.php?action=get_wdtable&table_id=13\",\"type\":\"POST\"},\"oSearch\":{\"bSmart\":false,\"bRegex\":false,\"sSearch\":\"\"}},\"customRowDisplay\":\"\",\"tabletWidth\":\"1024\",\"mobileWidth\":\"480\",\"renderFilter\":\"footer\",\"advancedFilterEnabled\":false,\"serverSide\":true,\"autoRefreshInterval\":0,\"processing\":true,\"fnServerData\":true,\"columnsFixed\":0,\"sumFunctionsLabel\":\"\",\"avgFunctionsLabel\":\"\",\"minFunctionsLabel\":\"\",\"maxFunctionsLabel\":\"\",\"columnsDecimalPlaces\":{\"wdt_ID\":-1,\"n\":-1,\"possibleways\":-1},\"columnsThousandsSeparator\":{\"wdt_ID\":0,\"n\":1},\"sumColumns\":[],\"avgColumns\":[],\"sumAvgColumns\":[],\"timeFormat\":\"h:i A\",\"datepickFormat\":\"dd\\\/mm\\\/yy\"}'\/>\n\n    <table id=\"table_2\"\n           class=\"   display nowrap wdt-no-display data-t data-t wpDataTable wpDataTableID-13 \"\n           style=\"\"\n           data-described-by='table_2_desc'\n           data-wpdatatable_id=\"13\">\n        \n        <!-- Table header -->\n        \n<thead>\n<tr>\n                    <th\n                        class=\" wdtheader sort numdata integer \"\n        style=\"\">        wdt_ID<\/th>        <th\n        data-class=\"expand\"                class=\" wdtheader sort numdata integer \"\n        style=\"\">        n<\/th>        <th\n                        class=\" wdtheader sort \"\n        style=\"\">        PossibleWays<\/th>    <\/tr>\n<\/thead>\n        <!-- \/Table header -->\n\n        <!-- Table body -->\n        \n<tbody>\n<!-- Table body -->\n<div data-id=\"13\"\n     class=\"wdt-timeline-item wdt-timeline-table_2\"\n     style=\"\">\n    <div class=\"wdt-table-loader\">\n        <div class=\"wdt-table-loader-row wdt-table-loader-header\">\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n        <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n            <\/div>\n<\/div><!-- \/Table body -->\n                    <tr id=\"table_13_row_0\"\n            data-row-index=\"0\">\n                            <td style=\"\">1<\/td>\n                            <td style=\"\">1<\/td>\n                            <td style=\"\">1<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_1\"\n            data-row-index=\"1\">\n                            <td style=\"\">2<\/td>\n                            <td style=\"\">2<\/td>\n                            <td style=\"\">2<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_2\"\n            data-row-index=\"2\">\n                            <td style=\"\">3<\/td>\n                            <td style=\"\">3<\/td>\n                            <td style=\"\">6<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_3\"\n            data-row-index=\"3\">\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">24<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_4\"\n            data-row-index=\"4\">\n                            <td style=\"\">5<\/td>\n                            <td style=\"\">5<\/td>\n                            <td style=\"\">120<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_5\"\n            data-row-index=\"5\">\n                            <td style=\"\">6<\/td>\n                            <td style=\"\">6<\/td>\n                            <td style=\"\">720<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_6\"\n            data-row-index=\"6\">\n                            <td style=\"\">7<\/td>\n                            <td style=\"\">7<\/td>\n                            <td style=\"\">5040<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_7\"\n            data-row-index=\"7\">\n                            <td style=\"\">8<\/td>\n                            <td style=\"\">8<\/td>\n                            <td style=\"\">40320<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_8\"\n            data-row-index=\"8\">\n                            <td style=\"\">9<\/td>\n                            <td style=\"\">9<\/td>\n                            <td style=\"\">362880<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_9\"\n            data-row-index=\"9\">\n                            <td style=\"\">10<\/td>\n                            <td style=\"\">10<\/td>\n                            <td style=\"\">3628800<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_10\"\n            data-row-index=\"10\">\n                            <td style=\"\">11<\/td>\n                            <td style=\"\">11<\/td>\n                            <td style=\"\">39916800<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_11\"\n            data-row-index=\"11\">\n                            <td style=\"\">12<\/td>\n                            <td style=\"\">12<\/td>\n                            <td style=\"\">479001600<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_12\"\n            data-row-index=\"12\">\n                            <td style=\"\">13<\/td>\n                            <td style=\"\">13<\/td>\n                            <td style=\"\">2147483647<\/td>\n                    <\/tr>\n                            <tr id=\"table_13_row_13\"\n            data-row-index=\"13\">\n                            <td style=\"\">14<\/td>\n                            <td style=\"\">14<\/td>\n                            <td style=\"\">2147483647<\/td>\n                    <\/tr>\n            <\/tbody>        <!-- \/Table body -->\n\n        <!-- Table footer -->\n        \n        <!-- \/Table footer -->\n    <\/table>\n\n<\/div><style>\n<\/style>\n<style>\n                    \n                                                                                        \/* table font color *\/\n    .wpdt-c.wpDataTablesWrapper table.wpdtSimpleTable,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable {\n        font-family: Lucida Sans Unicode, Lucida Grande, sans-serif !important;\n    }\n\n            \/* table font size *\/\n    .wpdt-c.wpDataTablesWrapper table.wpdtSimpleTable,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable {\n        font-size: 20px !important;\n    }\n\n            \n                <\/style>\n<style>\n<\/style>\n<style>\n                            \n                                \/* table font color *\/\n    .wpdt-c.wpDataTablesWrapper table#wpdtSimpleTable-13,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable.wpDataTableID-13 {\n        font-family: Lucida Sans Unicode, Lucida Grande, sans-serif !important;\n    }\n\n                \n                <\/style>\n\n\n\n\n<p> The two accelerations pretty much cancel out and so  keep the probability of getting four or more correct by chance alone below .05 for any <em>n<\/em> as shown below.<\/p>\n\n\n<h2 class=\"wpdt-c\" id=\"wdt-table-title-15\">Significance of scoring four or more<\/h2>\n<div class=\"wpdt-c wdt-skin-light\">\n    \n    <input type=\"hidden\" id=\"wdtNonceFrontendServerSide_15\" name=\"wdtNonceFrontendServerSide_15\" value=\"f9a5c8ad11\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/psyctc\/wp-json\/wp\/v2\/posts\/2877\" \/>    <input type=\"hidden\" id=\"table_3_desc\"\n           value='{\"tableId\":\"table_3\",\"tableType\":\"manual\",\"selector\":\"#table_3\",\"responsive\":false,\"responsiveAction\":\"icon\",\"editable\":false,\"inlineEditing\":false,\"infoBlock\":false,\"pagination_top\":0,\"pagination\":0,\"paginationAlign\":\"right\",\"paginationLayout\":\"full_numbers\",\"paginationLayoutMobile\":\"simple\",\"file_location\":\"\",\"tableSkin\":\"light\",\"table_wcag\":0,\"simple_template_id\":0,\"scrollable\":false,\"fixedLayout\":false,\"globalSearch\":false,\"showRowsPerPage\":false,\"popoverTools\":false,\"loader\":\"1\",\"showCartInformation\":1,\"hideBeforeLoad\":false,\"number_format\":2,\"decimalPlaces\":2,\"spinnerSrc\":\"https:\\\/\\\/www.psyctc.org\\\/psyctc\\\/wp-content\\\/plugins\\\/wpdatatables\\\/assets\\\/\\\/img\\\/spinner.gif\",\"groupingEnabled\":false,\"tableWpId\":15,\"dataTableParams\":{\"sDom\":\"BT\\u003C\\u0027clear\\u0027\\u003Et\",\"bSortCellsTop\":false,\"bFilter\":true,\"aLengthMenu\":[[1,5,10,25,50,100,-1],[1,5,10,25,50,100,\"All\"]],\"iDisplayLength\":-1,\"columnDefs\":[{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":false,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"wdt_ID\",\"origHeader\":\"wdt_ID\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-wdt_id\",\"aTargets\":[0]},{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"n\",\"origHeader\":\"n\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-n\",\"aTargets\":[1]},{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"totalperms\",\"origHeader\":\"totalperms\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-totalperms\",\"aTargets\":[2]},{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"score\",\"origHeader\":\"score\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-score\",\"aTargets\":[3]},{\"sType\":\"formatted-num\",\"wdtType\":\"int\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"number\",\"origHeader\":\"number\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata integer  column-number\",\"aTargets\":[4]},{\"sType\":\"formatted-num\",\"wdtType\":\"float\",\"bVisible\":true,\"orderable\":true,\"searchable\":true,\"InputType\":\"text\",\"name\":\"cumprob\",\"origHeader\":\"cumprob\",\"notNull\":false,\"conditionalFormattingRules\":[],\"transformValueRules\":\"\",\"className\":\"numdata float  column-cumprob\",\"aTargets\":[5]}],\"bAutoWidth\":false,\"order\":[[0,\"asc\"]],\"ordering\":false,\"fixedHeader\":{\"header\":false,\"headerOffset\":0},\"fixedColumns\":false,\"buttons\":[{\"extend\":\"print\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_print\",\"title\":\"Significance of scoring four or more\",\"text\":\"Print\"},{\"extend\":\"excelHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_xls\",\"filename\":\"Significance of scoring four or more\",\"title\":null,\"text\":\"Excel\"},{\"extend\":\"csvHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_csv\",\"title\":\"Significance of scoring four or more\",\"text\":\"CSV\"},{\"extend\":\"copyHtml5\",\"exportOptions\":{\"columns\":\":visible\",\"stripHtml\":true},\"className\":\"DTTT_button DTTT_button_copy\",\"filename\":\"Significance of scoring four or more\",\"title\":null,\"text\":\"Copy\"}],\"oLanguage\":{\"sSearchPlaceholder\":\"\"},\"bProcessing\":false,\"serverSide\":true,\"ajax\":{\"url\":\"https:\\\/\\\/www.psyctc.org\\\/psyctc\\\/wp-admin\\\/admin-ajax.php?action=get_wdtable&table_id=15\",\"type\":\"POST\"},\"oSearch\":{\"bSmart\":false,\"bRegex\":false,\"sSearch\":\"\"}},\"customRowDisplay\":\"\",\"tabletWidth\":\"1024\",\"mobileWidth\":\"480\",\"renderFilter\":\"footer\",\"advancedFilterEnabled\":false,\"serverSide\":true,\"autoRefreshInterval\":0,\"processing\":true,\"fnServerData\":true,\"columnsFixed\":0,\"sumFunctionsLabel\":\"\",\"avgFunctionsLabel\":\"\",\"minFunctionsLabel\":\"\",\"maxFunctionsLabel\":\"\",\"columnsDecimalPlaces\":{\"wdt_ID\":-1,\"n\":-1,\"totalperms\":-1,\"score\":-1,\"number\":-1,\"cumprob\":-1},\"columnsThousandsSeparator\":{\"wdt_ID\":0,\"n\":1,\"totalperms\":1,\"score\":1,\"number\":1},\"sumColumns\":[],\"avgColumns\":[],\"sumAvgColumns\":[],\"timeFormat\":\"h:i A\",\"datepickFormat\":\"dd\\\/mm\\\/yy\"}'\/>\n\n    <table id=\"table_3\"\n           class=\"   display nowrap wdt-no-display data-t data-t wpDataTable wpDataTableID-15 \"\n           style=\"\"\n           data-described-by='table_3_desc'\n           data-wpdatatable_id=\"15\">\n        \n        <!-- Table header -->\n        \n<thead>\n<tr>\n                    <th\n                        class=\" wdtheader sort numdata integer \"\n        style=\"\">        wdt_ID<\/th>        <th\n        data-class=\"expand\"                class=\" wdtheader sort numdata integer \"\n        style=\"\">        n<\/th>        <th\n                        class=\" wdtheader sort numdata integer \"\n        style=\"\">        Total possible permutations<\/th>        <th\n                        class=\" wdtheader sort numdata integer \"\n        style=\"\">        score<\/th>        <th\n                        class=\" wdtheader sort numdata integer \"\n        style=\"\">        Number of ways of getting four correct<\/th>        <th\n                        class=\" wdtheader sort numdata float \"\n        style=\"\">        p (for four or more correct)<\/th>    <\/tr>\n<\/thead>\n        <!-- \/Table header -->\n\n        <!-- Table body -->\n        \n<tbody>\n<!-- Table body -->\n<div data-id=\"15\"\n     class=\"wdt-timeline-item wdt-timeline-table_3\"\n     style=\"\">\n    <div class=\"wdt-table-loader\">\n        <div class=\"wdt-table-loader-row wdt-table-loader-header\">\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n            <div class=\"wdt-table-loader-header-cell wdt-animated-background\"><\/div>\n        <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n                    <div class=\"wdt-table-loader-row\">\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n                <div class=\"wdt-table-loader-cell wdt-animated-background\"><\/div>\n            <\/div>\n            <\/div>\n<\/div><!-- \/Table body -->\n                    <tr id=\"table_15_row_0\"\n            data-row-index=\"0\">\n                            <td style=\"\">1<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">24<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">1<\/td>\n                            <td style=\"\">0.04<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_1\"\n            data-row-index=\"1\">\n                            <td style=\"\">2<\/td>\n                            <td style=\"\">5<\/td>\n                            <td style=\"\">120<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">0<\/td>\n                            <td style=\"\">0.01<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_2\"\n            data-row-index=\"2\">\n                            <td style=\"\">3<\/td>\n                            <td style=\"\">6<\/td>\n                            <td style=\"\">720<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">15<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_3\"\n            data-row-index=\"3\">\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">7<\/td>\n                            <td style=\"\">5,040<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">70<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_4\"\n            data-row-index=\"4\">\n                            <td style=\"\">5<\/td>\n                            <td style=\"\">8<\/td>\n                            <td style=\"\">40,320<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">630<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_5\"\n            data-row-index=\"5\">\n                            <td style=\"\">6<\/td>\n                            <td style=\"\">9<\/td>\n                            <td style=\"\">362,880<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">5,544<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_6\"\n            data-row-index=\"6\">\n                            <td style=\"\">7<\/td>\n                            <td style=\"\">10<\/td>\n                            <td style=\"\">3,628,800<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">55,650<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_7\"\n            data-row-index=\"7\">\n                            <td style=\"\">8<\/td>\n                            <td style=\"\">11<\/td>\n                            <td style=\"\">39,916,800<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">611,820<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_8\"\n            data-row-index=\"8\">\n                            <td style=\"\">9<\/td>\n                            <td style=\"\">12<\/td>\n                            <td style=\"\">479,001,600<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">7,342,335<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_9\"\n            data-row-index=\"9\">\n                            <td style=\"\">10<\/td>\n                            <td style=\"\">13<\/td>\n                            <td style=\"\">2,147,483,647<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">95,449,640<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n                            <tr id=\"table_15_row_10\"\n            data-row-index=\"10\">\n                            <td style=\"\">11<\/td>\n                            <td style=\"\">14<\/td>\n                            <td style=\"\">2,147,483,647<\/td>\n                            <td style=\"\">4<\/td>\n                            <td style=\"\">1,336,295,961<\/td>\n                            <td style=\"\">0.02<\/td>\n                    <\/tr>\n            <\/tbody>        <!-- \/Table body -->\n\n        <!-- Table footer -->\n        \n        <!-- \/Table footer -->\n    <\/table>\n\n<\/div><style>\n<\/style>\n<style>\n                    \n                                                                                        \/* table font color *\/\n    .wpdt-c.wpDataTablesWrapper table.wpdtSimpleTable,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable {\n        font-family: Lucida Sans Unicode, Lucida Grande, sans-serif !important;\n    }\n\n            \/* table font size *\/\n    .wpdt-c.wpDataTablesWrapper table.wpdtSimpleTable,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable {\n        font-size: 20px !important;\n    }\n\n            \n                <\/style>\n<style>\n<\/style>\n<style>\n                            \n                                \/* table font color *\/\n    .wpdt-c.wpDataTablesWrapper table#wpdtSimpleTable-15,\n    .wpdt-c .wpDataTablesWrapper table.wpDataTable.wpDataTableID-15 {\n        font-family: Lucida Sans Unicode, Lucida Grande, sans-serif !important;\n    }\n\n                \n                <\/style>\n\n\n\n\n<p>This shows how the p value for various scores (on the y axis)  stabilises as the number of objects, n,  goes up (x axis).<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"781\" src=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements1-1024x781.png\" alt=\"\" class=\"wp-image-2911\" srcset=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements1-1024x781.png 1024w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements1-300x229.png 300w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements1-768x585.png 768w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements1-1536x1171.png 1536w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements1.png 1624w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Here&#8217;s the same data but with the p values on a log10 scale on the y axis.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"781\" src=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements2-1024x781.png\" alt=\"\" class=\"wp-image-2912\" srcset=\"https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements2-1024x781.png 1024w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements2-300x229.png 300w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements2-768x585.png 768w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements2-1536x1171.png 1536w, https:\/\/www.psyctc.org\/psyctc\/wp-content\/uploads\/2022\/07\/derangements2.png 1624w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Back in 2002, with two colleagues, I published a paper: Evans, C., Hughes, J., &amp; Houston, J. (2002). Significance testing the validity of ideographic methods: A little derangement goes a long way. British Journal of Mathematical and Statistical Psychology, 55(2), 385\u2013390. https:\/\/doi.org\/10.1348\/000711002760554525. Contact me if you&#8217;d like a copy! In the paper we used a &hellip; <a href=\"https:\/\/www.psyctc.org\/psyctc\/2022\/07\/23\/sometimes-n4-is-enough\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Sometimes n=4 is enough<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":2899,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2877","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorised"],"_links":{"self":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/posts\/2877","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/comments?post=2877"}],"version-history":[{"count":20,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/posts\/2877\/revisions"}],"predecessor-version":[{"id":2913,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/posts\/2877\/revisions\/2913"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/media\/2899"}],"wp:attachment":[{"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/media?parent=2877"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/categories?post=2877"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.psyctc.org\/psyctc\/wp-json\/wp\/v2\/tags?post=2877"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}