{"id":1878,"date":"2017-11-29T10:00:21","date_gmt":"2017-11-29T09:00:21","guid":{"rendered":"http:\/\/blogs.kcl.ac.uk\/editlab\/?p=1878"},"modified":"2018-02-16T15:50:05","modified_gmt":"2018-02-16T14:50:05","slug":"replication-in-the-age-of-genomics","status":"publish","type":"post","link":"https:\/\/blogs.kcl.ac.uk\/editlab\/2017\/11\/29\/replication-in-the-age-of-genomics\/","title":{"rendered":"Replication in the Age of Genomics"},"content":{"rendered":"

Replication is the lifeblood of science \u2013 but how do you replicate when your cohort is the biggest available? EDiT Lab Associate Member and genomics crank-turner <\/span>postdoc extraordinaire Joni gives three ways how.
\n<\/strong><\/h2>\n

<\/p>\n

\"joni-coleman-200x280\"<\/a><\/strong><\/p>\n

\n

There is little more important than replication in science. While we might lust over novelty and fetishise the unexpected, it\u2019s the confirmation of the known that actually moves science forward. Traditionally, that has meant that you find something, you ask your frenemy with some similar data to see if they see the same thing, you confirm your finding, and then you get all the power and wealth and everyone wants to hire you. Or, more normally, they don\u2019t see anything of the sort, you swear loudly, sulk for a day and then spend the next few weeks trying to understand exactly what\u2019s gone wrong.<\/p>\n

\"I<\/a>

I have no idea who these scientists are, but they’re probably laughing at your failure to replicate that finding<\/p><\/div>\n

But what do you do when there are no frenemies left? Not because you have finally completed your nefarious plan for world domination (Gerome<\/a><\/em>), but because all the frenemies are now friends, and all the data are now one. In short, what do you do when there is no replication cohort? This, to an extent, is the situation that many of the investigators interested in psychiatric disorders now find themselves in. Many of the available genetic data on psychiatric disorders is now gathered together by the Psychiatric Genetics Consortium<\/a>. So, how can you test whether your findings are real? Here\u2019s three ways how\u2026<\/p>\n

1. Look within<\/h3>\n

In 2009, the International Schizophrenia Consortium had a slight problem. They had expended a great deal of time and effort to gather a large sample of individuals with schizophrenia<\/a> and had consciously created a carefully-curated control cohort (which isn\u2019t easy to say with a mouthful of beans). But, for all their work, they hadn\u2019t quite got the punchline \u2013 they had found only a single genetic region (albeit one<\/a> that is<\/a>\u00a0quite important<\/a>) that differed between cases and controls at a level greater than chance (given that they had searched the whole genome), and the difference observed was only very slight.<\/p>\n

So how to prove that this fledgling \u201cgenome-wide association study\u201d (GWAS) thing\u00a0for which they\u2019d been pushing wasn\u2019t a wash, and that, against all the slings and arrows of outrage fortune<\/a>, the field should persevere? To do so, they developed the concept of \u201cleave one out polygenic risk scoring\u201d. Rather than examining how variants differ between cases and controls in all samples (call them ABCDEFG), they instead only looked at a sub-sample (ABCDEF) Then, they took the results from that sub-sample analysis and looked at whether weighting variants in the rest of the cohort (G) by the ABCDEF results gave a significant prediction. And it did \u2013 the genetic differences seen in one part of the cohort were (overall if not individually) mirrored in the other, independent part. Furthermore, this happened in all of the seven possible set-ups, suggesting that the overall effect was likely to be robust in entirely independent cohorts. And so, a crucial technique for internal replication was born, along with a whole field<\/a>\u2026<\/p>\n

\"A<\/a>

A Polygenic Risk Scoring Plot (Euesden et al, 2015: https:\/\/academic.oup.com\/bioinformatics\/article\/31\/9\/1466\/200539)<\/p><\/div>\n

2. Squint a bit<\/h3>\n

At the beginning of the year, a big GWAS of IQ<\/a> was published, identifying 18 parts of the genome where variants differ with increasing IQ. This was not the first such GWAS, but it represented a big step forward in the number of regions identified. But furthermore, it represented a big chunk of the available data for replication \u2013 there were a few cohorts not included, but they were generally difficult to access, or considerably smaller than this new GWAS (and so a failed replication might simply be because the replication cohort was too small to see anything. So how to replicate? Leave one out polygenic scoring showed promising results, but could the investigators go further? Obviously. Why else would I be bringing up this paper (other than the scientific brilliance, wit and sheer aura of raw physical attractiveness of the fifth-named author?). Sniekers and colleagues used another technique for replication, that of the proxy-replication.<\/p>\n

Educational success is correlated with IQ. It is also relatively straightforward to measure. If you have a group of genotyped people, and permission to access their exam results (or to ask them how many years they were in education for), you can do a GWAS of educational attainment. This had in fact been very successful \u2013 the latest such GWAS<\/a> had identified 74 regions. Looking up 306 variants that differed strongly with IQ in their data, the authors showed that 305 of these affected educational attainment in the same direction as in IQ, and that 9 of the 16 top regions they could test from the IQ differed in educational attainment more than would be expected by chance alone. When the exact same trait isn\u2019t available, related traits can be informative.<\/p>\n

3. Wait<\/h3>\n

GWAS are like buses. They carry a lot of people, and you tend to get on strange ones when you\u2019re drunk. [Edit: What?! From context alone I can only assume you were actually going for \u201cthere\u2019s always another one along in a minute\u201d\u2026]<\/em><\/p>\n

\"A<\/a>

A shiny GWAS<\/p><\/div>\n

With time come new samples, new data and replication. Take the 18 IQ loci \u2013 in a cohort nearly four times the size, 15 of those loci remained significant. Or look at the schizophrenia region found in 2009 \u2013 that\u2019s now arguably the most robust region in schizophrenia genetics, with a plausible functional role (that perhaps wasn\u2019t the one initially expected) and is now coming up in other psychiatric disorders like depression<\/a> (arguing that it might be associated with psychiatric disorders more generally). As such, a kind of replication reminiscent of the traditional method is still possible in GWAS, through building new cohorts into the older cohorts, and seeing what survives.<\/p>\n

Because it\u2019s now Christmas, as told by the traditional herald angels\u00a0John and Lewis<\/a>, I leave you with a present of blogs yet to come focussed on the spirit of GWAS past. Here, I\u2019ve said a kind of replication can be achieved by the addition of new samples to older GWAS. Next time, I will show that it can be informative to look back at old GWAS to understand the evolution of newly-discovered hits.<\/p>\n","protected":false},"excerpt":{"rendered":"

Replication is the lifeblood of science \u2013 but how do you replicate when your cohort is the biggest available? EDiT Lab Associate Member and genomics crank-turner postdoc extraordinaire Joni gives three ways how.<\/p>\n","protected":false},"author":163,"featured_media":1880,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[9],"tags":[38,22,71,83,230,67,219],"class_list":["post-1878","post","type-post","status-publish","format-standard","has-post-thumbnail","category-research-matters","tag-genetics","tag-genomics","tag-mental-health-research","tag-methodology","tag-replication","tag-research-methods","tag-statistics"],"_links":{"self":[{"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/posts\/1878","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/users\/163"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/comments?post=1878"}],"version-history":[{"count":17,"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/posts\/1878\/revisions"}],"predecessor-version":[{"id":1913,"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/posts\/1878\/revisions\/1913"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/media\/1880"}],"wp:attachment":[{"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/media?parent=1878"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/categories?post=1878"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.kcl.ac.uk\/editlab\/wp-json\/wp\/v2\/tags?post=1878"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}