Email updates

Keep up to date with the latest news and content from Silence and BioMed Central.

This article is part of the series Non-coding RNA.

Open Access Highly Accessed Review

Experimental design, preprocessing, normalization and differential expression analysis of small RNA sequencing experiments

Kevin P McCormick1, Matthew R Willmann2 and Blake C Meyers1*

Author Affiliations

1 Department of Plant and Soil Sciences and Delaware Biotechnology Institute, University of Delaware, Newark, DE 19711, USA

2 Department of Biology, University of Pennsylvania, Philadelphia, PA 19104, USA

For all author emails, please log on.

Silence 2011, 2:2  doi:10.1186/1758-907X-2-2


The electronic version of this article is the complete one and can be found online at: http://www.silencejournal.com/content/2/1/2


Received:22 December 2010
Accepted:28 February 2011
Published:28 February 2011

© 2011 McCormick et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Prior to the advent of new, deep sequencing methods, small RNA (sRNA) discovery was dependent on Sanger sequencing, which was time-consuming and limited knowledge to only the most abundant sRNA. The innovation of large-scale, next-generation sequencing has exponentially increased knowledge of the biology, diversity and abundance of sRNA populations. In this review, we discuss issues involved in the design of sRNA sequencing experiments, including choosing a sequencing platform, inherent biases that affect sRNA measurements and replication. We outline the steps involved in preprocessing sRNA sequencing data and review both the principles behind and the current options for normalization. Finally, we discuss differential expression analysis in the absence and presence of biological replicates. While our focus is on sRNA sequencing experiments, many of the principles discussed are applicable to the sequencing of other RNA populations.

Introduction

Deep sequencing technologies have revolutionized the field of genomics since their inception in 2000, when Lynx Therapeutics' Massively Parallel Signature Sequencing (MPSS; Lynx Therapeutics, Hayward, CA, USA) was described as a way to quantify messenger RNA (mRNA) populations [1]. MPSS allowed the parallel sequencing of 17- or 20-nucleotide (nt) signatures from hundreds of thousands of cloned RNA, but it has been made obsolete by newer systems enabling longer sequence reads with fewer biases. Next-generation sequencing has since been adapted to the study of a wide range of nucleic acid populations, including mRNA (RNA-seq) [2], small RNA (sRNA) [3], microRNA (miRNA)-directed mRNA cleavage sites (called parallel analysis of RNA ends (PARE), genome-wide mapping of uncapped transcripts (GMUCT) or degradome sequencing) [4-6], double-stranded RNA (dsRNA) [7,8], actively transcribing RNA (NET-seq) [9], translated mRNA [10], transcription factor DNA binding sites and histone modification sites (chromatin immunoprecipitation (ChIP)-seq) [11], methylated DNA (BS-seq) [12] and genomic DNA (DNA-seq) [13-15]. These applications vary with regard to the templates used, but they rely on the same sequencing technologies.

Prior to high-throughput sequencing, DNA microarrays were the predominant method of genome-wide transcriptional analysis. Microarrays have been used to quantify the levels of both known and unknown mRNA, alternative splicing products, translated mRNA and miRNA, as well as to detect miRNA cleavage sites, transcription factor binding sites, single-nucleotide polymorphisms and deletions. Now, however, high-throughput sequencing is often favored over microarrays for such experiments because sequencing avoids several problems encountered in microarray experiments. First, unlike microarrays, sequencing approaches do not require knowledge of the genome a priori, enabling any organism to be easily studied. Second, sequencing is not dependent on hybridization. Microarray data are obtained by hybridizing a labeled target to complementary DNA probes immobilized on a solid surface, and the strength of this hybridization is dependent on the base composition of the probe [16-20]. With arrays, it is possible for cross-hybridization to occur, such that the signal may come from sources besides the perfectly complementary intended target [17,18,21]. Sequencing, however, has a single-nucleotide resolution, which increases specificity and is far superior for certain applications, such as defining transcription factor binding sites to the probe-defined resolution of microarrays. Third, sequencing produces digital data by counting the number of copies of a particular sequence, enabling accurate determination of low-, middle- and high-abundance species. Because microarray data are based on the intensity of the fluorescence label at each spot on the hybridized array and intensity falls on a continuum, the data are analog. The disadvantage of this is that it is hard to accurately quantify signals at the two extremes: signals near the lower limit of detection [22-28] and those near the intensity saturation point [29,30]. The proper quantification of intensity also depends on accurate measurement of background levels, which is not an issue for digital data [31-33]. Although sequencing is free from these intrinsic experimental limitations, microarray experiments are cheaper (at the moment) and do not suffer from ligation biases (discussed below in the section "Library preparation and inherent biases").

Next-generation sequencing has proved to be a boon to the study of sRNA. Sequencing of individual sRNA clones by traditional Sanger sequencing was laborious and did not achieve a sufficient sequencing depth to detect rare species [34-39]. There are several biologically relevant and functionally diverse classes of sRNA of specific sizes and produced by different, genetically separable pathways. These include miRNA, small interfering RNA (siRNA) and the animal-specific Piwi-interacting RNA (piRNA, originally called repeat-associated siRNA or rasiRNA). miRNA are 19 to 25 nt long and originate from noncoding RNA called pri-miRNA that have extensive secondary structure [40]. miRNA posttranscriptionally silence non-self-targeted mRNA through imperfect base pairing, directing target cleavage [41,42] or translational inhibition [40,43].

The biogenesis of miRNA is in contrast to that of siRNA (20 to 24 nt), which are formed from long dsRNA [44-46]. siRNA can direct the cleavage of perfectly base-paired mRNA, including the RNA from which they originate [34,46]. Several subclasses of siRNA exist, which vary by name or by type in different organisms. In animals, siRNA are designated on the basis of their source: endogenous dsRNA (endo-siRNA, or esiRNA) and exogenous dsRNA (exo-siRNA) [47,48]. esiRNA are derived from long dsRNA made by RNA-dependent RNA polymerases (RDRs) from sense transcripts, pairing between convergent transcripts (sense and natural antisense transcripts) or long self-complementary RNA, while exo-siRNA come from RNA viruses. The Caenorhabditis elegans and plant literature distinguish primary siRNA, that is, those that are formed from the dsRNA that initiates a silencing event, from secondary siRNA, that is, those that are formed from the cleaved target mRNA and perpetuate and amplify silencing [49-52]. In plants, siRNA are also defined based on their origin and/or function and include heterochromatic siRNA (hc-siRNA, sometimes also referred to as rasiRNA), natural antisense transcript-derived siRNA (nat-siRNA), and trans-acting siRNA (ta-siRNA). hc-siRNA are 23- to 24-nt siRNA found in plants and Schizosaccharomyces pombe that direct methylation of DNA and histones, leading to transcriptional gene silencing, particularly in repeat regions [53-55]. A second subset of siRNA in plants, nat-siRNA, arise from the hybridization of sense transcripts with their naturally occurring antisense forms and subsequent cleavage [56]. siRNA derived from natural antisense transcripts are also found in animals, but are not always referred to as nat-siRNA [57-60]. ta-siRNA appear to be plant-specific and originate from noncoding RNA that are the targets of miRNA. Following miRNA cleavage, the cleavage products are made double-stranded and then chopped into 20- or 21-nt ta-siRNA. These ta-siRNA target non-self-targeted mRNA via imperfect base pairing for cleavage, similarly to miRNA [61-64].

The most recently identified major class of sRNA is the piRNA group, a 25- to 30-nt sRNA associated with the Piwi subclade of Argonaute family of proteins, and these sRNA have functions in the germline of animals [65-71]. All of these kinds of sRNA can be identified by generating sRNA sequencing libraries from size-selected populations of RNA that are approximately 18 to 30 nt long. Along with these biologically relevant sRNA, RNA degradation products, including fragments of transfer RNA (tRNA) and ribosomal RNA (rRNA), are also sequenced. Studies have found an abundance of specific tRNA-derived sRNA in Saccharomyces cerevisiae, Arabidopsis and human cells [72-74], at least some of which are Dicer cleavage products [73], and methionine tRNA, or tRNAMet, was associated with human Argonaute 2 protein, or Ago2, in human cells [75]. The finding by the Dutta laboratory [72] that some of these tRNA sequences, called tRNA-derived RNA fragments, have a biological function further suggests that new classes of and roles for sRNA will likely continue to be identified.

Sequencing can also be used to study sRNA targets. RNA-seq can directly quantify expression levels of mRNA that are targets of sRNA. High-throughput sequencing has recently been applied to the identification of miRNA cleavage sites, a method alternately called degradome sequencing [4], PARE [5] and GMUCT [6]. This approach is useful for identifying precise miRNA target sites because the fragment immediately downstream of the cleavage site will appear much more abundantly than any surrounding sequences produced by nonspecific decay. These methods will not detect the effects of miRNA on target translation, however. New approaches that combine immunopurification of polysomes (mRNA that are associated with ribosomes) with deep sequencing allow for the sequencing of RNA that are actively being translated and enable the detection of miRNA-mediated translational inhibition [10,76]. In contrast to miRNA, the target of hc-siRNA is chromatin, and hc-siRNA-induced DNA and histone methylation can be identified using BS-seq and ChIP-seq, respectively.

Next-generation sequencing data sets are similar to one another in several aspects, regardless of the technology or template used. In all cases, raw data files in the form of images must be preprocessed and normalized before they can be stored for analysis or visualization. The preprocessing of data comprises a series of steps that involve converting image files to raw sequences (also called "reads"), handling low-quality base calls, trimming adapters from raw sequencing reads, tabulating numbers of trimmed reads per distinct sequence and aligning these reads to a reference genome if available. Normalization, the process of comparing raw sequence counts against some common denominator, is a critical step when processing expression data of all types. Normalization removes technical artefacts arising from the method itself or from unintended variation, with the goal that differences remaining between samples are truly or predominantly biological in nature. Figure 1 demonstrates the flow of data for typical sequencing experiments.

thumbnailFigure 1. Flowchart of typical data-handling steps for small RNA (sRNA) libraries. Flowchart depicting the steps involved in creating, processing and normalizing next-generation sequencing libraries. In this article, we focus on sRNA data, but the methods for analyzing other RNA-based or even chromatin immunoprecipitation sequencing data are similar.

In this review, we consider the design of sRNA sequencing experiments, the preprocessing and normalization of sequencing data and basic differential expression analysis. We discuss various approaches for normalizing sequencing data, starting with what has been learned from microarrays about the fundamentals of normalizing large-scale transcriptional data sets. Because the cost of sequencing is still somewhat high (although it is dropping rapidly), many experiments do not currently involve biological replicates, so we discuss statistical approaches for differential expression analysis when replicates are and are not available.

Designing sRNA sequencing experiments

Sequencing technologies and inherent biases

The first decision to make when designing a sequencing experiment is which sequencing technology to use. Today there are two main varieties of next-generation sequencing: (1) sequencing by synthesis (SBS), employed by 454 sequencing http://www.454.com/ webcite; 454 Life Sciences/Roche, Branford, CT, USA) [77], Illumina (formerly called Solexa sequencing; http://www.illumina.com/ webcite; San Diego, CA, USA) [13], Helicos http://www.helicosbio.com/ webcite; Helicos Biosciences Corp., Cambridge, MA, USA) [78,79] and the latest entrant into the market, small-molecule, real-time sequencing, or SMRT, sequencing introduced by Pacific BioSciences http://pacificbiosciences.com/ webcite; Menlo Park, CA, USA) [80]; and (2) sequencing by ligation (SBL), used in SOLiD (Sequencing by Oligonucleotide Ligation and Detection; http://www.appliedbiosystems.com/ webcite; Applied Biosystems, Carlsbad, California, USA) [81] and Polonator sequencing http://www.polonator.org/ webcite; Dover Systems, Salem, New Hampshire, USA) [82]. Table 1 shows the current efficiency statistics for each of these methods as provided by the product websites, but the sequencing depth, speed and accuracy of these technologies are constantly increasing. Most of these approaches can be implemented as paired-end runs, in which both ends of each clone are sequenced, increasing the amount of information gleaned per fragment, but single-end runs are sufficient for the short length of sRNA [83-85].

Table 1. Comparison of next-generation sequencing technologiesa

The choice of sequencing method often comes down to cost, read length and sequencing depth. Because sRNA are in the range of approximately 18 to 30 nt and high sequencing depth is necessary to observe rare species, Illumina and SOLiD are currently the most appropriate methods for sRNA sequencing studies (Table 1). Illumina uses a four-color, reversible terminator sequencing-by-synthesis technology to sequence one base at a time. SOLiD uses 16 dinucleotide probes, each labeled with one of four fluorophores, to sequence by ligation two nucleotides of each clone at a time. This means that four dinucleotide pairs share the same label, making the analysis of SOLiD data a little more complicated. An algorithm generates the nucleotide sequence of a particular base n from this color space by examining the labels for the overlapping dinucleotides n - 1, n and n, n + 1 [81]. In this fashion, two different probes interrogate each base, which accounts for the reportedly high accuracy of this method. A single color call error, however, invalidates the sequence determination for all positions after this point. The read length and sequencing depth of Helicos sequencing make Helicos appropriate for sRNA sequencing as well, but this application has not been widely commercialized. For Helicos sequencing, cDNA molecules are polyadenylated and then annealed to immobilized oligo(dT) primers. Individual molecules are sequenced by sequential addition of each of the four nucleotides. One advantage of the Helicos method is that it allows for the sequencing of individual DNA molecules, eliminating the need for polymerase chain reaction (PCR) amplification and its inherent error rate. While Polonator sequencing allows for 26-nt reads at great sequencing depths, a 3- to 4-nt sequence gap remains in the middle of each read, which is not ideal for sRNA experiments.

Library preparation and inherent biases

Recent data have shown that the library preparation method, more than the sequencing technology, can significantly affect the diversity and abundance of the sRNA that are sequenced [86]. For differential expression analyses comparing the relative abundance of the same sequence in different libraries, this is not a problem because all libraries will be affected equally by biases due to library preparation. Despite the digital nature of sequencing data, however, the relative levels of different sequences within the same library will be affected by these biases. Some sequences present in the biological samples may even be absent in the libraries because of preparation bias.

Illumina and SOLiD sRNA sequencing libraries are made by ligating RNA adapters of known sequence to the 5' and 3' ends of single molecules in a purified sRNA population. Alternatively, SOLiD sequencing can be performed by in vitro polyadenylation of the 3' end of the sRNA and addition of a 5' adapter [86]. In either case, the adapter-ligated sequences are reverse-transcribed, amplified by PCR to increase the size of the library, applied to the platform and amplified again in situ to form millions of clusters of DNA of the same sequence. Then these clusters are sequenced in parallel.

Three steps in this process have the potential to influence the sequencing results: adapter ligation, reverse transcription and PCR amplification. Adapter ligation is the most important. The adapters have typically been ligated to each sRNA using T4 RNA ligase 1, which is capable of ligating two single-stranded oligoribonucleotides, where the acceptor nucleotide (≥3 nt long) has a free 3'-hydroxyl group and the donor (≥1 nt) has a 5'-monophosphate [87]. The ligation efficiency of T4 RNA ligase 1 is very sensitive to nucleotide base composition at the ligation site and to sRNA modifications, however, and not all sRNA can act as donor substrates for the enzyme. Studies have suggested that the sequences of both the acceptor and the donor have an effect on ligation efficiency [86-91], but the acceptor sequence is more important [87]. The identity of at least the three 3'-most nucleotides of the acceptor affects ligation efficiency [87,91], with a different base preference at each position (5'-nucleotide: A > G ≈ C > U; middle nucleotide: A > C > U > G; 3'-nucleotide: A > C > G > U when using a pUUUCp donor) [91]. The donor sequence appears to be less important, but the bias for the 5' nucleotide is C > U ≥ A > G [88,89].

Many sRNA are modified, and these modifications can also make them poor substrates for T4 RNA ligase 1. In particular, miRNA, siRNA, hc-siRNA, ta-siRNA and nat-siRNA in plants, siRNA and piRNA in insects and piRNA in animals are known to be 2'-O-methylated on the 3' end by the conserved methyltransferase HUA ENHANCER 1 (HEN1) (reviewed in [92]), and this modification lowers ligation efficiency by T4 RNA ligase 1 by 30% to 72%, depending on assay conditions [93-95]. The 2'-O-methylation also introduces a sequence bias for the 3' nucleotide of the acceptor at the ligation site, such that the efficiency is G = C > A > U [95]. Unlike previous studies, the study by Munafó et al. [95] did not find sequence bias at the acceptor site in unmethylated sRNA. Both of these issues are eliminated by using a truncated version of a closely related ligase, T4 RNA ligase 2, with a preadenylated 3'-RNA adapter [95], so this enzyme is being used more and more for library preparation. Illumina's first-generation sRNA library preparation kits used T4 RNA ligase 1 for the ligation of both the 5'- and 3'-adapters, but their Small RNA version 1.5 and TrueSeq™ RNA Sample Preparation kits use the truncated form of T4 RNA ligase 2 for the ligation of the 3'-adapter. T4 RNA ligase 1 is still required for the ligation of the 5'-adapter, however, because of the need by the truncated T4 RNA ligase 2 for a preadenylated donor, which in this case is the sample itself. Thus, sequence bias is eliminated in only one of the two ligation reactions. To test whether an sRNA is 3'-modified or to specifically clone 3'-modified products, sRNA can be oxidized with NaIO4 followed by β-eliminated at an alkaline pH. This treatment removes the 3'-most nucleotide from all sequences with 2',3'-OH groups (that is, unmodified sRNA), but not from modified sRNA, leaving a 3'-phosphate [96-98], which is not a substrate for T4 RNA ligase 1 or 2.

Because T4 RNA ligase 1 requires a 5'-monophosphate on the donor sequence, sRNA lacking this group are absent from standard libraries. A large population of 5'-ligation-resistant secondary siRNA was found in C. elegans [51,52]. These secondary siRNA are involved in the perpetuation of RNA interference (RNAi) and have a 5'-triphosphate, which is not a substrate for T4 RNA ligase 1. sRNA with 5'-diphosphate or 5'-triphosphate have also been found in the single-celled eukaryote Entamoeba histolytica [99]. The 5'-caps similarly block ligation by the enzyme and have been seen on 18- to 25-nt sRNA associated with the human hepatitis delta virus and on some RNA under 200 nt in human cells [100,101]. Both of these ligase-resistant 5'-modifications can be removed by pretreatment with tobacco acid pyrophosphatase before ligation of a 5'-adapter [101]. Alternatively, a 5'-adapter-independent method can be used [51,99,100]; however, this approach is not compatible with Illumina and SOLiD sequencing technologies. The importance of considering such a method, however, is highlighted by a study by Pak et al. [51], who studied RNAi-induced C. elegans that used a 5'-adapter-independent library preparation protocol. In contrast to work that did not account for the possibility of 5'-ligation-resistant sRNA, which suggested that miRNA vastly outnumbered siRNA, they demonstrated that the two classes are actually found in similar degrees of abundance [51].

Because sRNA acts as the donor during the 5'-adapter ligation and as the acceptor during the 3'-adapter ligation, the best solution for avoiding this bias would be to use a ligation-independent library preparation. Such a method has been applied to the generation of Illumina sequencing libraries [10] and would be applicable to SOLiD sequencing as well. This method involves using Escherichia coli poly(A) polymerase (PAP) to polyadenylate the RNA molecules and then performing a reverse transcription reaction with an oligo(dT) primer having both 5'- and 3'-adapter sequences at the 5' end of the primer. The products are then circularized and cut with a restriction enzyme that cleaves between the 5'- and 3'-adapters, yielding the typical linear read of 5'-adapter, clone and 3'-adapter. Ligation-independent methods that rely on 3'-polyadenylation of the sRNA population, such as this technique and the one used for Helicos sequencing, may be better than ligation-dependent methods, but they are still not perfect. PAP has a bias for the 3'-nucleotide A = G > C > U, but the efficiencies of the different bases are within twofold of each other [95]. As seen with T4 RNA ligase 1, 2'-O-methylation greatly reduces the efficiency of PAP by up to 10-fold, with the sequence bias altered to 2'-O-meG > 2'-O-meA = 2'-O-meU > 2'-O-meC [93-95].

While adapter ligation is probably the largest potential source of bias, bias can also be introduced during reverse transcription and amplification. The 2'-O-methylation of sRNA reduces the efficiency of reverse transcription as well as adapter ligation [95,102]. The step of PCR amplification during library preparation can be a problem with sequences that have very low or very high guanine-cytosine (GC) content, reducing the likelihood that these sequences will be represented in the final population. Two techniques that do not require the initial library amplification and are compatible with Illumina sequencing have been used for DNA-seq and RNA-seq, and both methods provide a less biased library preparation for low GC sequences [103,104]. These approaches remain to be tried with sRNA libraries and still require the standard amplification within the Illumina flow cell to generate clusters of identical sequences. The Helicos system will provide a truly amplification-independent sequencing protocol because it does not require PCR in the library preparation and sequences only single molecules, not clusters of molecules.

Multiplexing

High-throughput sequencing can be costly when loading only one sample per sequencing lane. To help improve cost efficiency, users can multiplex two or more samples in a single lane using bar coding [105-113]. As the number of reads per run has increased (Table 1), sufficiently deep sequencing can be achieved even when running multiple samples in the same lane, with the number of multiplexed samples depending on the desired depth. Multiplexing either incorporates a unique sequence called a bar code into the 5'- or 3'-adapter of each library to be run in the same lane or adds the bar code during a PCR step after adapter ligation, an approach that minimizes ligation bias. All of the reads in a lane can be sorted into their respective libraries using their bar codes after sequencing has taken place. Because of the inherent error rate of sequencing, it is recommended that bar codes be long enough so that each pair varies by multiple substitutions, thereby reducing the likelihood that sequencing errors in the bar code will result in assigning reads to the wrong sample [107,112]. In particular, Illumina sequencing has a tendency to erroneously incorporate adenine more than the other bases [114], which should also be taken into account when designing your own bar codes. Multiplexing library preparation kits are now available for both Illumina and SOLiD. In both cases, the bar code is located within one of the adapters and separated by multiple bases from the ligation site, reducing the likelihood that the bar code will introduce any ligation bias. Helicos is also compatible with bar coding, though it requires a ligation step not in the original protocol. The one downside of using a bar code is that it may reduce the maximum length of the sRNA that can be sequenced, trimmed and assigned to a sample. However, the latest multiplexing systems for the Illumina and SOLiD machines incorporate the index into the 3' PCR primer and perform a second reaction specifically to sequence the bar code. This type of approach has numerous advantages, such as reducing or eliminating ligation bias, ensuring long reads across the sRNA and enabling multiplexing that reduces sequencing costs.

Replication

Several reports have used technical replicates, that is, the same library sequenced multiple times or independent libraries constructed from the same biological sample, to demonstrate the high reliability of Illumina [86,115-118] and SOLiD sequencing [86]. Similar results are possible for biological replicates [115,118,119]. Because of the high cost of deep sequencing, most experiments published to date have not used biological replicates, even though they can increase the statistical significance and reduce both false-positive and false-negative rates. With biological replicates, the significance analysis of microarrays (SAM) [115] and the Bioconductor program edgeR [118,120] can be applied to differential expression analysis of sequencing data, as we discuss later in the section "Differential expression analysis". Standards for deep sequencing experiments remain to be agreed upon, but as sequencing costs go down, sequencing depths further increase and multiplexing becomes more widely adopted, the requirement for biological replicates in differential expression experiments will surely follow.

Preprocessing of sequencing data

The raw data of a sequencing experiment typically comprise a series of image files: one image per cycle of nucleotide addition for Illumina or dinucleotide ligation for SOLiD. Because of the size of flow cells, each one is subdivided into a number of "tiles" for imaging purposes. Thus, there is a series of images for every nucleotide. The images contain thousands of spots, one spot for every cluster, with a cluster representing one read. Each of these files must be analyzed to designate one of the four nucleotide bases (Illumina) or color space call (SOLiD) for each spot on the image, and then the data from each image for the same spot must be combined to give full sequence reads, one per spot. Each technology has its own specifications regarding the file formats used; for example, Illumina recently changed its standard output format from .qseq, which uses ASCII-64 encoding of Phred quality scores (a widely accepted metric to characterize the quality of DNA sequences), to .bcl, a binary format containing base call and quality for each tile in each cycle. SOLiD systems use .csfasta to encode color space calls and .qual files to record the quality values for each sequence call. Because one color call error will affect the sequence of all 3'-nucleotdies, SOLiD data are maintained in color space for much of the preprocessing. Figure 2 demonstrates a sample pipeline for Illumina data files.

thumbnailFigure 2. Sample file formats for small RNA libraries. Illumina machines generate .bcl files, which are in binary form and are not human-readable. These files are converted into .qseq files, which record the most likely sequence and a quality score for each read. Scripts are available to convert files in .qseq format into .fastq or SCARF format (Solexa Compact ASCII Read Format). Files in these formats are often converted to a "tag count" format so that they can be easily stored and analyzed.

For many sequenced reads, ambiguous bases will exist. Ambiguous bases are the result of low confidence in any particular nucleotide. In the case of Illumina, a probability is assigned for a given nucleotide being each of the four bases. For a sequence designation to be assigned, the likelihood of the most likely base has to be at least 1.5 times greater than that of the next highest base; otherwise, the position in question will be deemed an ambiguous base. Different sequencing platforms and/or software pipelines have alternative approaches for handling ambiguous reads, usually denoted with an "N" in a sequence. Some will simply discard any sequence with an ambiguous read if the sequencing depth is sufficient, while others will assign the most likely base call at that nucleotide in an attempt to maximize the number of reads. A very sophisticated approach to this step is to record each read as more than a static sequence by using a probability matrix to record the probability of each nucleotide at each position [12]. This additional information can help recover reads that would otherwise be classified as sequencing errors. For example, the most likely sequence for an ambiguous read, according to its probability matrix, might not map to any genomic locus, but the second most likely sequence might correspond to a known miRNA. This approach is likely to increase the number of usable reads for any given library, but it is undecided whether this increase is enough to warrant the increase in computational complexity that it brings. This approach will also likely mistakenly assign the sequence of some reads. The location of the ambiguities may also allow some reads to be saved. Ambiguities in the middle of a read will require that it be discarded from further analysis, but if it is within the adapter sequences, the read may still be retained.

The next step in processing next-generation sequencing data is to trim or remove any adapter sequences. Because these adapters are artificially introduced and are not part of the organism's transcriptome, it is necessary to remove any remnants of them before attempting to map the libraries against a reference genome. Trimming scripts require a minimum number of bases for adaptor recognition, so the maximum usable read length of Illumina and SOLiD is less than the total number of sequenced bases. This also means that longer sRNA may be lost as a result of an insufficient adapter sequence for matching and trimming. This is not a problem for the typical 19- to 30-nt sRNA, as current technologies generate sequences > 36 nt. The process of removing adapters can be inefficient because it is possible (even likely) that sRNA sequences contain subsequences of the adapter. Thus, researchers must be careful when defining exact rules for determining which sequences to keep, which ones to trim and which ones to throw out altogether.

The final steps before data analysis can begin are to count the abundance for each distinct tag in a library and to map distinct tags to a reference genome if one exists. Calculating the abundance is computationally trivial, given current sequencing depth and standard computational limitations, so many researchers use their own programs for this step. Genome mapping, on the other hand, can be computationally expensive, but fortunately there are a number of publicly available programs to perform this task, such as SOAP [121] and Bowtie [122], each with its own benefits and limitations. Some programs use multithreading and efficient memory allocation to maximize mapping speed.

The number of trimmed reads in a given library that will align perfectly to a reference genome depends on issues specific to the organism, the sample or the sequencing run, as well as on decisions made during data analysis. The completeness of the genome sequence is a major factor. Even in so-called "complete" genomes, there are highly repetitive regions (such as in centromeres and telomeres) that remain undetermined. Because a large number of sRNA originate from these locations, many reads will incorrectly fail to map to the genome. The sequence divergence between the reference genome and the sample will also have an effect. Low-quality sequencing runs will have reads riddled with erroneous base callings, causing them to be classified as nongenomic as well.

There are also some data analysis decisions that will influence the number of reads that align to a genome, including minimum read length, how to handle reads mapping to multiple genomic loci and how many mismatches to allow. Shorter sequences are more likely to map to multiple loci in the genome. Because sRNA researchers are generally interested in Dicer-mediated cleavage events, and because the shortest known Dicer products are 19 nt in length, it is recommended that any reads shorter than 18 nt be excluded. In plants, because the dominant size classes are miRNA and hc-siRNA, with the bulk of these being 20 or 21 nt and 23 or 24 nt, respectively, the data should demonstrate a significant decrease in the number of both distinct and total 18- or 19-nt and > 25-nt reads. Figure 3 demonstrates how reads shorter than 20 nt or longer than 24 nt are mostly derived from tRNA, rRNA, small nuclear RNA (snRNA) or small nucleolar RNA (snoRNA) loci.

thumbnailFigure 3. Small RNA (sRNA) reads derived from structural RNA versus other sRNA-generated loci. (A) The number of total and distinct reads for all genomic sequences divided into those derived from ribosomal RNA, transfer RNA (tRNA), small nuclear RNA (snRNA) or other "structural" noncoding RNA-derived and other categories for each size class from 18 to 34 nt across 51 publicly available Arabidopsis sRNA libraries. We typically refer to the sRNA from nonstructural loci as "good" sRNA. (B) The percentage of tRNA-derived reads for each size class from 18 to 34 nt across 24 publicly available wild-type Arabidopsis libraries. Because of variations in sequencing read lengths among libraries, some libraries are missing data for sizes above 27 nt or 31 nt.

Several strategies have been employed to handle reads that map to multiple loci, also known as multireads. Reads that map to only one locus are called unique reads, which should not be confused with the distinct reads, which are reads with different nucleotide sequences. Figure 4 shows the relative abundance of unique and nonunique reads across all sRNA size classes. In some cases, researchers have chosen to exclude all multireads from analysis [123], or to exclude those multireads mapping to more loci than some threshold [124,125], as many of these will map to centromeres and telomeres. However, this will result in a loss of sequencing depth. When choosing to keep multireads, the problem arises how to allocate those reads between the different possible source loci. The two most common approaches are to allocate the total number of copies of a read to each mapped locus or to divide the number of copies evenly among the mapped loci. Allocating all copies to each locus ignores the fact that this is biologically impossible, but allows for the possibility that any locus might be the sole transcriptional source of a read. Distributing the copies evenly, while reflecting a biologically possible scenario, precludes such a possibility. A more sophisticated approach is to estimate the proportion of multiread transcriptions at each locus by examining the levels of uniquely mapping reads at nearby loci [126,127]. This approach has several names, but we shall refer to it as "probability mapping," since it involves estimating the probability that a transcript originated from each associated locus. The basic idea of probability mapping can be explained with this simple scenario. Suppose a multiread maps to genomic loci L1 and L2 and that the number of uniquely mapping reads overlapping L1 greatly outnumber those that overlap L2. Intuitively, we can presume that most of the copies of the multiread in question originated from L1, since there is likely a higher level of transcription occurring at L1 than at L2. The proportion of copies allocated to L1 is then approximately equal to the proportion of uniquely mapping reads overlapping L1 compared to those at L2. While it remains unknown whether the presence of uniquely mapping reads is an indication of a higher overall level of transcription, the data from applications of this technique seem to support the idea.

thumbnailFigure 4. Repetitiveness of small RNA (sRNA) reads measured across sizes. The number of total reads for all uniquely and nonuniquely mapping genomic sequences divided into ribosomal RNA- or transfer RNA-derived and other (also known as "good") categories for each size class from 18 to 34 nt across 51 publicly available Arabidopsis sRNA libraries. For each size class, structural RNA-derived reads are more likely to map nonuniquely mapping genomic sequences (that is, to more than one genomic location), whereas good reads are more likely to map uniquely mapping genomic sequences (that is, to one genomic location).

The number of mismatches to allow when performing genome mapping can be a difficult issue to resolve. Individual specific DNA polymorphisms and posttranscriptional sequence modifications, which have been seen in RNA from mitochondrial and plastid genomes, tRNA and miRNA, will also cause some reads not to map to the genome. Computational techniques that allow indels and mismatches when performing genome mapping are capable of "recovering" these modified reads that would otherwise be classified as nongenomic [125,128,129]. Allowing mismatches increases the number of raw reads that will map to the genome but also decreases the likelihood that those reads originated from the matched loci. Because of the short length of sRNA, it is generally recommended that only perfectly matched reads be utilized, unless specific known polymorphisms or posttranscriptional RNA sequence modifications exist between the reference genome and the sample in question.

Quality control

Once sRNA data have been preprocessed, it is common for researchers to verify the quality of the data before moving on to normalization and analysis. There are several ways to perform quality control on sRNA data. Each base of every Illumina sequenced read or each color call of every SOLiD sequenced read is given a quality score, which can be used to calculate an average error rate for each cycle of a sequencing run. While it is normal for the error rate to increase toward the end of a run, for a good run the average error rate throughout should be relatively similar and close to the expected rate for the technology. Creating size distribution graphs should reveal peaks of sequences corresponding to the dominant size classes. For example, in Arabidopsis, the dominant classes are 20 or 21 nt and 23 or 24 nt, which correspond to miRNA and hc-siRNA, respectively. Libraries made from high-quality RNA should have low levels of sRNA corresponding to highly abundant mRNA. Libraries made from green tissues of plants, for instance, should have low levels of sRNA for genes encoding the highly expressed photosynthetic proteins. Computing the levels of other RNA types, such as tRNA or rRNA, among different libraries in a data set may or may not be informative, as the relative level of tRNA can vary significantly. For example, from 51 public Arabidopsis sRNA libraries in our databases, tRNA represented from 4% to 40% of the total number of sequenced reads. Ideally, the level of nongenomic reads should also be similar between libraries to be compared.

Data normalization

Lessons from microarrays

The more than 20-year history of microarray experiments provides a good starting point for considering how to normalize next-generation sequencing data. While there are many technology-specific issues involved when handling raw microarray and sequencing data, the basic problem is still the same: how to convert raw data, in the form of image files, to numerical data, such that any expression differences between samples are due solely to biological variation, not to technical, experimentally introduced variation. In the case of microarrays, technical bias can be introduced during sample preparation (differences in RNA isolation, quality and amplification; target labeling; total amount of target; dye biases for spotted arrays; and so on), array manufacture (array surface chemistry, sequences used for the probes, locations of the probes within a gene, array printing for spotted arrays, scratches and so on) and array processing (hybridization conditions and scanning intensity and settings). Failing to properly remove these biases can lead to false conclusions when making comparisons within a single array or between two different arrays. Normalization attempts to remove technical bias without introducing noise.

Normalization requires two basic decisions: (1) which subset of genes (also called the normalization baseline or reference population) to use to determine the normalization factor and (2) which normalization method to employ [130]. These two choices are independent, such that a given reference population can be used in combination with any of the different normalization methods. A good reference population is invariant in expression, meaning that the true expression levels are constant across biological treatments and span the entire expression range. Reference populations that have been used previously for microarray normalization include housekeeping genes [131], spike-ins of nonendogenous RNA or genomic DNA, an algorithmically identified set of invariant genes [29,132-135] and all genes [130]. Housekeeping genes are typically used for normalizing northern blot analysis results and quantitative reverse transcription PCR (qRT-PCR) because of their supposedly constant expression level, but it has become ever more apparent that even these genes can vary in their expression [136-141]. Commercial arrays typically have probes for nonendogenous genes, and in vitro transcribed RNA from these genes can be used as spike-ins at various steps in the target preparation and array hybridization procedure. The point chosen will determine how much and what kind of technical variation will be corrected by the normalization. Genomic DNA has also been used for normalization because the concentration of a control sequence is readily known. In the absence of knowledge regarding invariant genes, algorithms have been developed that identify a set of invariant genes from the set of arrays themselves. These genes are discovered by comparing expression-ranked lists of all of the probes in each array to find the most rank-invariant genes [29,132-135]. This method is advantageous because it makes no assumptions about the expression patterns of individual genes. Normalization is generally improved by increasing the size of the reference population, which has been a disadvantage of spike-ins because only a few sequences are typically added. As an alternative to using a subset of probes for normalization, all probes can be used. This type of normalization assumes that because the RNA content is constant between treatments and most of the genes do not change in expression between treatments, the median or mean expression across all of the genes is unchanged.

There are many different algorithms for normalizing microarray data on the basis of the chosen reference population, but they fall into four main categories: linear scaling (as in the MAS5.0 algorithm), nonlinear scaling (as in locally weighted linear regression (LOWESS), cyclic LOWESS), quantile normalization (as in robust multi-array average (RMA), GC-RMA (a variation of RMA), dChip) and variance stabilization normalization (VSN), two of which (linear and nonlinear scaling) have been applied to sRNA sequencing data as we will see later in the section "Normalization methods". Linear scaling uses the reference population to determine a single factor by which the population varies when compared to a set target, such as a predetermined mean or median expression value. The expression of each probe or gene on the array is multiplied by this factor to achieve the normalized expression value. The advantage of using linear scaling is that the scaling factor is determined independently for each sample, unlike the other approaches, which normalize the data with reference to the other arrays in the data set. Linear normalization of microarray data has been largely abandoned, though, because expression values are not necessarily linear, particularly at the extremes [142]. In attempt to overcome this problem, nonlinear scaling methods have been developed that, for a given pair of arrays or for an individual array and the mean or median data derived from all of the arrays in question, first fit a curve to the expression values of the reference using LOWESS or splines and then normalize the data such that the average fold change when comparing any two arrays is 1 (that is, no change) across the expression range. Thus, a scaling factor is determined independently for small windows across the entire expression range. Quantile normalization uses a nonscaling approach that assumes that most genes are not differentially expressed and that the true expression distribution is similar between different samples [142]. The average distribution of the reference population is determined from all of the arrays in question, and then each array is normalized to have this same distribution. Variance stabilization normalization likewise assumes that most genes are not differentially expressed. Using a generalized logarithmic transformation, VSN methods fit the data such that the variance is equal across the expression range, allowing for greater precision for low expression values, which are generally subject to greater variance [143-145]. Many studies have been performed comparing these different normalization methods, but beyond the opinion that linear scaling is not as ideal because of the analog nature of microarray data, the general conclusion is that there is no single "best" normalization method [31,131,142,146-149]. Even though the data are digital, the same is likely to be true in the case of RNA sequencing experiments as discussed below in the section "Normalization methods".

Sources of nonbiological variation in sRNA sequencing experiments

There are a number of nonbiological sources of variation that can add noise to sRNA sequencing experiments. RNA quality is a major issue because low quality can result in an increase in sequencing of degradation products. As discussed above in the section "Library preparation and inherent biases", the choice of library preparation methods has a significant impact on the makeup of the library because of biases in ligation, reverse transcription, PCR amplification or polyadenylation efficiency. While not currently done, it may be possible to develop methods to correct for these biases. One issue that can be dealt with to some extent by normalization is differences in sequencing depth between libraries. More total reads equate to a higher likelihood of any particular sequence's appearing in a library, and standardizing the total number of reads per library or sequence run is not a realizable goal. One way to reduce the impact of this kind of variation (or other technical variations encountered as a result of the sequencing procedure itself) is to sequence all of the libraries to be compared at the same time or to use multiplexing to run the samples in the same lane or at least on the same flow cell.

Microarray and sequencing experiments start with equal amounts of total RNA when constructing a library or a labeled target. When performing differential expression analyses using such data, an inherent assumption is that a set amount of starting RNA comes from the same number of cells in each sample. It is well known, though, that transcription rates change depending on the stage of growth, development or environment of the cell, tissue, organ or organism. Thus, this assumption can result in over- or underestimation of differences between samples. This issue is probably most significant when comparing different stages of growth or development. Studies of the per-cell abundance of sRNA in different experimental conditions have not been performed, but such studies might help improve our estimates of differential expression as well as our knowledge of the biology of sRNA.

Selecting a normalization baseline for sRNA sequencing experiments

Three reference populations for normalization have been used with sRNA sequencing experiments: spike-ins, all "good reads" and all reads. As discussed earlier in the section "Lessons from microarrays", housekeeping genes have been shown to be nonideal for normalizing microarray data because of their variable expression [136-141]. In the case of sRNA, few "housekeeping" sequences have been delineated. The identification of rank-invariant sRNA sequences would help to establish a statistically significant baseline for normalization, but this has not been done to date. RNA spike-ins of foreign sequences have proven useful, however, to account for multiple sources of variation in sequencing experiments, particularly when the spike-in RNA have been added to the total sample RNA prior to library preparation [115]. Fahlgren et al. [115] added multiple spike-ins at different concentrations to cover a range of abundances. Some sequences were more likely sequenced than others even when added at the same concentration, possibly as a result of sequence biases, so it is probably best to include multiple spike-ins of varying base compositions for each of the concentrations to be tested. Spike-ins also have proven useful in demonstrating the accuracy of some downstream data analyses [126,150].

Many other studies have used all reads or, more often, all "good reads" for the normalization baseline, which is comparable to using all probe sets when normalizing microarrays. Good reads are defined as all tags that map to a reference genome, except those associated with tRNA, rRNA, snRNA, snoRNA or other structural RNA [124,151]. This approach helps to mitigate the effects of bad sequencing runs and contamination with foreign RNA, both of which result in higher numbers of sequences that do not map to the reference genome. Experiments focusing on a specific RNA type, such as miRNA, may choose to use only these sequences for the normalization baseline [152,153].

In sRNA sequencing experiments, the majority of distinct reads will be sequenced in only one copy and often will be observed in only a single library. Because these sequences can act as outliers, it is sometimes best to eliminate them from the normalization baseline as discussed in the next section.

Normalization methods

Once a normalization baseline has been chosen, there is still the decision which normalization method to use. Existing methods can be classified as either linear or nonlinear. Linear total count scaling is perhaps the simplest of all existing methods. It involves using the summation of all reads belonging to the normalization baseline as a "library size," choosing an appropriate "control" library size (either the actual size of a control library or the average size of all libraries in the experiment) and then multiplying the abundance of each individual read by the normalization value (control divided by library size). This method has been widely applied to different types of data, including sRNA Illumina data, mRNA Illumina data [154] and PARE Illumina data [151]. Linear total count scaling has been shown to be no better than the analog data of microarray experiments for detecting differentially expressed genes [154]. A slight variation of this method is to use the number of distinct sequences, rather than the total abundance, as the size of each library [155].

Total count scaling is computationally simple but, for some experiments, biologically naïve. Consider this hypothetical scenario in which total count scaling fails: If sample A contains all reads from sample B, as well as a novel set of reads equal in size to the first set, total count scaling will result in underrepresenting reads from sample A and overrepresenting reads from sample B [120]. Total count scaling is particularly inefficient in the context of sRNA sequencing because it ignores the number of distinct reads within each sample. One proposed method that incorporates this number is quantile-based normalization, which uses the upper quartile of expressed genes (after excluding genes not expressed in any library) as a linear scaling factor [154]. (Note that this differs from quantile normalization, which scales data within each quantile separately.) The quantile-based method has been shown to yield better concordance with qRT-PCR results (with a bias near zero) than linear total count scaling, making quantile-based normalization better at detecting differentially expressed genes [154]. This quantile-based method has been used with RNA-seq data, where all reads per gene have been grouped together to yield one total per gene, but it has not been used with sRNA sequencing data. Our attempts to apply this approach to sRNA sequencing data (about 0.5 to 2 million distinct reads per library) found that the 75th-percentile sRNA were found at only one or two copies per library. Even grouping sRNA by gene or by 500-bp sliding window found very low copy numbers at this percentile. As a result, this method may need further modification to be applied to sRNA data, such as not considering distinct reads sequenced only one time or raising the percentile used for the normalization.

Even quantile-based normalization has its limitations, because it assumes a similar distribution of abundances per distinct read among all libraries being normalized. It is not yet known how accurate next-generation sequencing is with regard to read distribution. It is possible, however, to properly normalize libraries that may not have similar abundance distributions by using linear regression [123]. This method involves performing linear regression by comparing the abundance of each baseline element between two samples or between one sample and the mean or median of all samples, and then using the slope of the regression line as a linear scaling factor.

Because the total RNA output of each sample is unknown, linear total count scaling and other naïve methods can lead to underrepresentation of counts from high-output samples. Highly expressed genes (or other genomic elements) can sometimes take up too much "sequencing real estate" in a sample. The number of reads that map to a particular gene depends not only on gene length and expression level but also on the composition of the RNA population being sampled [120]. In some studies, it is assumed that most genes are not differentially expressed and thus that their true relative expression levels should be pretty similar. The trimmed mean of M value (TMM) normalization method exploits this fact by calculating, for each baseline element, the log expression ratio (M values) of the experimental sample to a control sample (or the mean or median of all samples) and using their trimmed mean as a linear scaling factor. Although Robinson and Oshlack [120] applied this method to genes using RNA-seq data, it could be applied to individual sRNA sequence counts as well.

All of the normalization methods discussed thus far are linear scaling methods, and they suffer from an inherent flaw in assuming that the level of noise in an sRNA library is directly proportional to the size of the library. A two-step nonlinear regression method can be used to eliminate nonlinear noise without making any assumptions about its shape [156]. A previously published implementation of this method is shown in Figure 5. This method uses the number of sequences mapping to each genomic window as well as the averages of these counts across the set of libraries. While this particular normalization method assumes that the data include only uniquely mapping sequences, multireads could be included by using probability mapping (described above in the section "Preprocessing of sRNA data") to estimate the total number of transcripts originating from within each genomic window. The first step is to regress observed counts of differences (control minus sample) on the mean to estimate fitted values and then subtract these fitted values from the observed difference counts. This results in each observed count's being transformed into a mean normalized difference. The second step is to estimate the moving mean absolute deviation (by regressing the absolute value of mean normalized differences on absolute mean counts) and then divide the mean normalized difference counts by the estimated mean of absolute deviation.

thumbnailFigure 5. Example of two-step nonlinear normalization. An example of the normalization process applied to the binding quantity difference regarding breast cancer data on human chromosome 1 between (1) MCF-7 control and (2) MCF-7 with E2 stimulation. (A) Raw data with clear bias toward the positive direction. (B) Data normalized with respect to the mean. (C) Data normalized with respect to both mean and variance (x-axis is zoomed in). Green dashed-dotted line and magenta dashed line represent the locally weighted linear regression line with respect to the mean and variance, respectively. Red dotted line represents the zero difference line. Reproduced with permission from Oxford University Press from Taslim et al. [156].

A summary of the normalization methods discussed here is given in Table 2. Because modern computational standards make most of the more advanced normalization methods relatively trivial, especially when compared to the task of genome mapping, we recommend that researchers not hesitate to use the more sophisticated approaches described herein. In particular, the methods implemented by Robinson et al. [120] (TMM) and Taslim et al. [156] (two-step nonlinear regression) seem to account for many flaws inherent in total count linear scaling, which has been the predominant normalization method of choice. A study comparing these two methods, as well as others, with each other would help to provide a much-needed "gold standard" for normalizing sRNA data. We also recommend using absolute counts, rather than log ratios, when performing normalization, as log ratios fail to account for the vast differences in magnitude evident in many sRNA data sets but absent from microarray experiments.

Table 2. Comparison of sRNA normalization methodsa

Differential expression analysis

Once sRNA libraries have been normalized, there are many different analyses that can be performed on them, but most fall under some category of differential expression analysis. Differential expression analysis can be performed on (1) individual sequences of interest, such as miRNA; (2) genomic elements, such as genes or transposons; or (3) discrete sRNA-generating genomic loci, also known as "clusters" or "bins." Clustering or binning involves dividing the genome into windows of equal size and summing all normalized counts for tags mapping each window. For experiments involving sRNA data, clustering is not ideal when comparing genomic elements with specific, singular mature sequences, such as miRNA, but can be useful in identifying differentially expressed regions in promoters, noncoding DNA or previously unannotated genes.

The methods for identifying genes expressed differentially with statistical significance differ depending on whether biological replicates were performed. The approach to identifying differential expression between digital tag counts first implemented by Audic and Claverie [157] is particularly sensitive to small differences in low tag counts and is useful for comparing data sets without replicates. Their A-C statistic involves computing the probability that two independent digital measurements of a particular sequence (or set of sequences) come from similar populations. As the actual values being compared increase, the minimum fold change between them recognized as significant decreases. Although this approach relies upon a single measurement for establishing an assumed Poisson distribution for a given sequence, it has been shown that this assumed distribution is never far from the true (but unknown) Poisson distribution [158]. The original implementations by Audic and Claverie [157] were for relatively small data sets (< 10 K reads) and modern sRNA data sets are several orders of magnitude bigger, but the statistical principles guiding the approach remain the same. Thus, the A-C statistic has become popular among biologists seeking to perform comparisons between large RNA data sets [124,158-160]. There has been at least one study, however, that demonstrated a poor fit between RNA-seq data and a Poisson distribution [161]. The nature of these types of data makes it difficult to identify a "true" distribution, leaving researchers to assume a distribution that they see most fit. Other distributions assumed include binomial [123] and negative binomial [120]. It should also be noted that Audic and Claverie [157] provided an alternative formula that allows for both normalization and differential expression analysis, but this alternative formula is not recommended for normalization purposes as it essentially implements a total count linear scaling and does not exclude tRNA or nongenomic reads.

For differential expression analyses on data sets with replicates, at least two approaches have been implemented recently. Bioconductor http://bioconductor.org/ webcite offers a software package called edgeR (empirical analysis of digital gene expression in R) that detects differentially expressed genes in a replicated experiment using an overdispersed Poisson model (a Poisson model allowing for greater variability) and an empirical Bayes procedure to moderate the degree of overdispersion [162]. By using a parameter to estimate the dispersion between replicates, the model can separate biological variation from technical variation. The edgeR program takes raw sequence counts and total library counts as input parameters, so the data do not have to be normalized first. This approach was used by Eveland et al. [118] to identify differentially expressed genes from maize RNA-seq libraries. Using qRT-PCR, significant differences were validated for 80% of genes identified as differentially expressed. Differential expression detection was possible on tags found in more than 10 copies, but the statistical strength increased with higher counts. The results of analyzing individual tags also corresponded well with the results of analyzing entire genes.

Fahlgren et al. [115] provided another approach for identifying differentially expressed genes from sequencing data sets with replicates by adapting the significance analysis of microarrays (SAM) to sequencing data, a method they call SAM-seq. The differential expression score between the samples incorporates the average abundance across each replicate set for a given sRNA as well as the standard deviation across all samples (from all replicate sets). It also incorporates a small but positive constant to minimize the coefficient of variation for the data set. Therefore, the differential expression score is essentially a t-statistic that has been modified to increase inferential power. This approach also uses a Q-value to allow for control of the false discovery rate. The power to detect differentially expressed genes (1 - false-negative rate) using this approach increases with the number of replicates as well as with the number of differentially expressed sRNA, but even with five replicates, it still remained in the 75% to 95% range. Conversely, the false discovery rate remained under 5%, even with as few as two replicates.

Conclusions

The use of next-generation sequencing to analyze small RNA populations is driving a large number of discoveries in many different organisms. The digital nature and the vast sequencing depth afforded by these approaches provide data that is both qualitatively and quantitatively highly informative. The technologies themselves, including read lengths, sequencing depths, cost and methods of library preparation, continue to improve. While standards for these experiments are still lacking, approaches for designing these experiments, preprocessing and normalizing the data and identifying differentially expressed genes continue to develop. To date, most experiments still do not use biological replicates because of cost. The application of the A-C statistic can still allow statistically meaningful conclusions to be drawn from such experiments, but replicates are still ideal. The ability to multiplex samples in single lanes combined with greater sequencing depths will make this financially more feasible, and we expect that in the near future replication will be required as it is for other genomic approaches. While next-generation sequencing is a vast improvement over microarrays for differential gene expression studies, it is not free from bias; the relative levels of different sequences within the same sample do not necessarily represent the biological situation, owing to bias during library preparation. No method is completely free of bias, but it can be reduced by using T4 RNA ligase 2 for adapter ligation, ligation-free library preparation and/or amplification-free sequencing methods. To date, normalization primarily accounts for differences in sequencing depths between libraries, but further experimental study of these biases may enable the biases to be corrected for during normalization. Normalization is still generally done by total linear count scaling, but positive results from RNA-seq and ChIP-seq experiments suggest that quantile-based or nonlinear scaling methods may be more appropriate for sRNA sequencing studies as well because of the abundance of low copy number reads. The issue of multireads complicates all of these analyses. We have attempted to use probability mapping in our studies, but we have found that a single, highly abundant, distinct sequence within a highly conserved region may throw off the apportioning between loci. Probability mapping approaches are also likely affected by sequencing biases, so both issues will need to be accounted for in improved methods.

Abbreviations

dsRNA: double-stranded RNA; endo-siRNA or esiRNA: endogenous siRNA; exo-siRNA: exogenous siRNA; GMUCT: genome-wide mapping of uncapped transcripts; hc-siRNA: heterochromatic siRNA; LOWESS: locally weighted linear regression; RMA: robust multi-array average; miRNA: microRNA; MPSS: massively parallel signature sequencing; nat-siRNA: natural antisense transcript-derived siRNA; NET-seq: native elongating transcript sequencing; PAP: poly(A) polymerase; PARE: parallel analysis of RNA ends; piRNA: Piwi-interacting RNA; rasiRNA: repeat-associated siRNA; RDR: RNA-dependent RNA polymerase; RNAi: RNA interference; SAM: significance analysis of microarrays; SBL: sequencing by ligation; SBS: sequencing by synthesis; siRNA: small interfering RNA; sRNA: small RNA; ta-siRNA: trans-acting siRNA; TMM: trimmed mean of M value; VSN: variance stabilization normalization.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

KPM and MRW prepared this manuscript with input, feedback and advice from BCM. All authors read and approved the final manuscript.

Acknowledgements

KPM and MRW are funded by National Science Foundation Arabidopsis 2010 award 0725968 to BCM and R. Scott Poethig of the Department of Biology, University of Pennsylvania, Philadelphia, PA, USA.

References

  1. Brenner S, Johnson M, Bridgham J, Golda G, Lloyd DH, Johnson D, Luo S, McCurdy S, Foy M, Ewan M, Roth R, George D, Eletr S, Albrecht G, Vermaas E, Williams SR, Moon K, Burcham T, Pallas M, DuBridge RB, Kirchner J, Fearon K, Mao J, Corcoran K: Gene expression analysis by massively parallel signature sequencing (MPSS) on microbead arrays.

    Nat Biotechnol 2000, 18:630-634. PubMed Abstract | Publisher Full Text OpenURL

  2. Nagalakshmi U, Wang Z, Waern K, Shou C, Raha D, Gerstein M, Snyder M: The transcriptional landscape of the yeast genome defined by RNA sequencing.

    Science 2008, 320:1344-1349. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Lu C, Tej SS, Luo S, Haudenschild CD, Meyers BC, Green PJ: Elucidation of the small RNA component of the transcriptome.

    Science 2005, 309:1567-1569. PubMed Abstract | Publisher Full Text OpenURL

  4. Addo-Quaye C, Eshoo TW, Bartel DP, Axtell MJ: Endogenous siRNA and miRNA targets identified by sequencing of the Arabidopsis degradome.

    Curr Biol 2008, 18:758-762. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  5. German MA, Pillay M, Jeong DH, Hetawal A, Luo S, Janardhanan P, Kannan V, Rymarquis LA, Nobuta K, German R, De Paoli E, Lu C, Schroth G, Meyers BC, Green PJ: Global identification of microRNA-target RNA pairs by parallel analysis of RNA ends.

    Nat Biotechnol 2008, 26:941-946. PubMed Abstract | Publisher Full Text OpenURL

  6. Gregory BD, O'Malley RC, Lister R, Urich MA, Tonti-Filippini J, Chen H, Millar AH, Ecker JR: A link between RNA metabolism and silencing affecting Arabidopsis development.

    Dev Cell 2008, 14:854-866. PubMed Abstract | Publisher Full Text OpenURL

  7. Kertesz M, Wan Y, Mazor E, Rinn JL, Nutter RC, Chang HY, Segal E: Genome-wide measurement of RNA secondary structure in yeast.

    Nature 2010, 467:103-107. PubMed Abstract | Publisher Full Text OpenURL

  8. Zheng Q, Ryvkin P, Li F, Dragomir I, Valladares O, Yang J, Cao K, Wang LS, Gregory BD: Genome-wide double-stranded RNA sequencing reveals the functional significance of base-paired RNAs in Arabidopsis.

    PLoS Genet 2010, 6:e1001141.

    pii

    PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  9. Churchman LS, Weissman JS: Nascent transcript sequencing visualizes transcription at nucleotide resolution.

    Nature 2011, 469:368-373. PubMed Abstract | Publisher Full Text OpenURL

  10. Ingolia NT, Ghaemmaghami S, Newman JR, Weissman JS: Genome-wide analysis in vivo of translation with nucleotide resolution using ribosome profiling.

    Science 2009, 324:218-223. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  11. Robertson G, Hirst M, Bainbridge M, Bilenky M, Zhao Y, Zeng T, Euskirchen G, Bernier B, Varhol R, Delaney A, Thiessen N, Griffith OL, He A, Marra M, Snyder M, Jones S: Genome-wide profiles of STAT1 DNA association using chromatin immunoprecipitation and massively parallel sequencing.

    Nat Methods 2007, 4:651-657. PubMed Abstract | Publisher Full Text OpenURL

  12. Cokus SJ, Feng S, Zhang X, Chen Z, Merriman B, Haudenschild CD, Pradhan S, Nelson SF, Pellegrini M, Jacobsen SE: Shotgun bisulphite sequencing of the Arabidopsis genome reveals DNA methylation patterning.

    Nature 2008, 452:215-219. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  13. Bentley DR, Balasubramanian S, Swerdlow HP, Smith GP, Milton J, Brown CG, Hall KP, Evers DJ, Barnes CL, Bignell HR, Boutell JM, Bryant J, Carter RJ, Keira Cheetham R, Cox AJ, Ellis DJ, Flatbush MR, Gormley NA, Humphray SJ, Irving LJ, Karbelashvili MS, Kirk SM, Li H, Liu X, Maisinger KS, Murray LJ, Obradovic B, Ost T, Parkinson ML, Pratt MR, et al.: Accurate whole human genome sequencing using reversible terminator chemistry.

    Nature 2008, 456:53-59. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  14. Wang J, Wang W, Li R, Li Y, Tian G, Goodman L, Fan W, Zhang J, Li J, Zhang J, Guo Y, Feng B, Li H, Lu Y, Fang X, Liang H, Du Z, Li D, Zhao Y, Hu Y, Yang Z, Zheng H, Hellmann I, Inouye M, Pool J, Yi X, Zhao J, Duan J, Zhou Y, Qin J, et al.: The diploid genome sequence of an Asian individual.

    Nature 2008, 456:60-65. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. Wheeler DA, Srinivasan M, Egholm M, Shen Y, Chen L, McGuire A, He W, Chen YJ, Makhijani V, Roth GT, Gomes X, Tartaro K, Niazi F, Turcotte CL, Irzyk GP, Lupski JR, Chinault C, Song XZ, Liu Y, Yuan Y, Nazareth L, Qin X, Muzny DM, Margulies M, Weinstock GM, Gibbs RA, Rothberg JM: The complete genome of an individual by massively parallel DNA sequencing.

    Nature 2008, 452:872-876. PubMed Abstract | Publisher Full Text OpenURL

  16. Talla E, Tekaia F, Brino L, Dujon B: A novel design of whole-genome microarray probes for Saccharomyces cerevisiae which minimizes cross-hybridization.

    BMC Genomics 2003, 4:38. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  17. Binder H, Kirsten T, Loeffler M, Stadler PF: Sensitivity of microarray oligonucleotide probes: variability and effect of base composition.

    J Phys Chem B 2004, 108:18003-18014. Publisher Full Text OpenURL

  18. Kucho K, Yoneda H, Harada M, Ishiura M: Determinants of sensitivity and specificity in spotted DNA microarrays with unmodified oligonucleotides.

    Genes Genet Syst 2004, 79:189-197. PubMed Abstract | Publisher Full Text OpenURL

  19. Royce TE, Rozowsky JS, Gerstein MB: Assessing the need for sequence-based normalization in tiling microarray experiments.

    Bioinformatics 2007, 23:988-997. PubMed Abstract | Publisher Full Text OpenURL

  20. Elkon R, Agami R: Removal of AU bias from microarray mRNA expression data enhances computational identification of active microRNAs.

    PLoS Comput Biol 2008, 4:e1000189. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  21. Irizarry RA, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, Scherf U, Speed TP: Exploration, normalization, and summaries of high density oligonucleotide array probe level data.

    Biostatistics 2003, 4:249-264. PubMed Abstract | Publisher Full Text OpenURL

  22. Agarwal A, Koppstein D, Rozowsky J, Sboner A, Habegger L, Hillier LW, Sasidharan R, Reinke V, Waterston RH, Gerstein M: Comparison and calibration of transcriptome data from RNA-Seq and tiling arrays.

    BMC Genomics 2010, 11:383. PubMed Abstract | BioMed Central Full Text OpenURL

  23. Bradford JR, Hey Y, Yates T, Li Y, Pepper SD, Miller CJ: A comparison of massively parallel nucleotide sequencing with oligonucleotide microarrays for global transcription profiling.

    BMC Genomics 2010, 11:282. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  24. Chen J, Agrawal V, Rattray M, West MA, St Clair DA, Michelmore RW, Coughlan SJ, Meyers BC: A comparison of microarray and MPSS technology platforms for expression analysis of Arabidopsis.

    BMC Genomics 2007, 8:414. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  25. Coughlan SJ, Agrawal V, Meyers B: A comparison of global gene expression measurement technologies in Arabidopsis thaliana.

    Comp Funct Genomics 2004, 5:245-252. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  26. Ishii M, Hashimoto S, Tsutsumi S, Wada Y, Matsushima K, Kodama T, Aburatani H: Direct comparison of GeneChip and SAGE on the quantitative accuracy in transcript profiling analysis.

    Genomics 2000, 68:136-143. PubMed Abstract | Publisher Full Text OpenURL

  27. Liu F, Jenssen TK, Trimarchi J, Punzo C, Cepko CL, Ohno-Machado L, Hovig E, Kuo WP: Comparison of hybridization-based and sequencing-based gene expression technologies on biological replicates.

    BMC Genomics 2007, 8:153. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  28. 'tHoen PA, Ariyurek Y, Thygesen HH, Vreugdenhil E, Vossen RH, de Menezes RX, Boer JM, van Ommen GJ, den Dunnen JT: Deep sequencing-based expression analysis shows major advances in robustness, resolution and inter-lab portability over five microarray platforms.

    Nucleic Acids Res 2008, 36:e141. PubMed Abstract | PubMed Central Full Text OpenURL

  29. Schadt EE, Li C, Su C, Wong WH: Analyzing high-density oligonucleotide gene expression array data.

    J Cell Biochem 2000, 80:192-202. PubMed Abstract | Publisher Full Text OpenURL

  30. Hsiao LL, Jensen RV, Yoshida T, Clark KE, Blumenstock JE, Gullans SR: Correcting for signal saturation errors in the analysis of microarray data.

    Biotechniques 2002, 32:330-332.

    334, 336

    PubMed Abstract OpenURL

  31. Irizarry RA, Wu Z, Jaffee HA: Comparison of Affymetrix GeneChip expression measures.

    Bioinformatics 2006, 22:789-794. PubMed Abstract | Publisher Full Text OpenURL

  32. Qin LX, Kerr KF: Empirical evaluation of data transformations and ranking statistics for microarray analysis.

    Nucleic Acids Res 2004, 32:5471-5479. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  33. Ritchie ME, Silver J, Oshlack A, Holmes M, Diyagama D, Holloway A, Smyth GK: A comparison of background correction methods for two-colour microarrays.

    Bioinformatics 2007, 23:2700-2707. PubMed Abstract | Publisher Full Text OpenURL

  34. Elbashir SM, Lendeckel W, Tuschl T: RNA interference is mediated by 21- and 22-nucleotide RNAs.

    Genes Dev 2001, 15:188-200. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  35. Lagos-Quintana M, Rauhut R, Lendeckel W, Tuschl T: Identification of novel genes coding for small expressed RNAs.

    Science 2001, 294:853-858. PubMed Abstract | Publisher Full Text OpenURL

  36. Lau NC, Lim LP, Weinstein EG, Bartel DP: An abundant class of tiny RNAs with probable regulatory roles in Caenorhabditis elegans.

    Science 2001, 294:858-862. PubMed Abstract | Publisher Full Text OpenURL

  37. Lee RC, Ambros V: An extensive class of small RNAs in Caenorhabditis elegans.

    Science 2001, 294:862-864. PubMed Abstract | Publisher Full Text OpenURL

  38. Reinhart BJ, Weinstein EG, Rhoades MW, Bartel B, Bartel DP: MicroRNAs in plants.

    Genes Dev 2002, 16:1616-1626. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  39. Llave C, Kasschau KD, Rector MA, Carrington JC: Endogenous and silencing-associated small RNAs in plants.

    Plant Cell 2002, 14:1605-1619. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  40. Lee RC, Feinbaum RL, Ambros V: The C. elegans heterochronic gene lin-4 encodes small RNAs with antisense complementarity to lin-14.

    Cell 1993, 75:843-854. PubMed Abstract | Publisher Full Text OpenURL

  41. Hutvagner G, Zamore PD: A microRNA in a multiple-turnover RNAi enzyme complex.

    Science 2002, 297:2056-2060. PubMed Abstract | Publisher Full Text OpenURL

  42. Llave C, Xie Z, Kasschau KD, Carrington JC: Cleavage of Scarecrow-like mRNA targets directed by a class of Arabidopsis miRNA.

    Science 2002, 297:2053-2056. PubMed Abstract | Publisher Full Text OpenURL

  43. Wightman B, Ha I, Ruvkun G: Posttranscriptional regulation of the heterochronic gene lin-14 by lin-4 mediates temporal pattern formation in C. elegans.

    Cell 1993, 75:855-862. PubMed Abstract | Publisher Full Text OpenURL

  44. Fire A, Xu S, Montgomery MK, Kostas SA, Driver SE, Mello CC: Potent and specific genetic interference by double-stranded RNA in Caenorhabditis elegans.

    Nature 1998, 391:806-811. PubMed Abstract | Publisher Full Text OpenURL

  45. Hamilton AJ, Baulcombe DC: A species of small antisense RNA in posttranscriptional gene silencing in plants.

    Science 1999, 286:950-952. PubMed Abstract | Publisher Full Text OpenURL

  46. Zamore PD, Tuschl T, Sharp PA, Bartel DP: RNAi: double-stranded RNA directs the ATP-dependent cleavage of mRNA at 21 to 23 nucleotide intervals.

    Cell 2000, 101:25-33. PubMed Abstract | Publisher Full Text OpenURL

  47. Duchaine TF, Wohlschlegel JA, Kennedy S, Bei Y, Conte D Jr, Pang K, Brownell DR, Harding S, Mitani S, Ruvkun G, Yates JR, Mello C: Functional proteomics reveals the biochemical niche of C. elegans DCR-1 in multiple small-RNA-mediated pathways.

    Cell 2006, 124:343-354. PubMed Abstract | Publisher Full Text OpenURL

  48. Lee RC, Hammell CM, Ambros V: Interacting endogenous and exogenous RNAi pathways in Caenorhabditis elegans.

    RNA 2006, 12:589-597. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  49. Sijen T, Fleenor J, Simmer F, Thijssen KL, Parrish S, Timmons L, Plasterk RH, Fire A: On the role of RNA amplification in dsRNA-triggered gene silencing.

    Cell 2001, 107:465-476. PubMed Abstract | Publisher Full Text OpenURL

  50. Vaistij FE, Jones L, Baulcombe DC: Spreading of RNA targeting and DNA methylation in RNA silencing requires transcription of the target gene and a putative RNA-dependent RNA polymerase.

    Plant Cell 2002, 14:857-867. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  51. Pak J, Fire A: Distinct populations of primary and secondary effectors during RNAi in C. elegans.

    Science 2007, 315:241-244. PubMed Abstract | Publisher Full Text OpenURL

  52. Sijen T, Steiner FA, Thijssen KL, Plasterk RH: Secondary siRNAs result from unprimed RNA synthesis and form a distinct class.

    Science 2007, 315:244-247. PubMed Abstract | Publisher Full Text OpenURL

  53. Mette MF, Aufsatz W, van der Winden J, Matzke MA, Matzke AJ: Transcriptional silencing and promoter methylation triggered by double-stranded RNA.

    EMBO J 2000, 19:5194-5201. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  54. Hamilton A, Voinnet O, Chappell L, Baulcombe D: Two classes of short interfering RNA in RNA silencing.

    EMBO J 2002, 21:4671-4679. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  55. Reinhart BJ, Bartel DP: Small RNAs correspond to centromere heterochromatic repeats.

    Science 2002, 297:1831. PubMed Abstract | Publisher Full Text OpenURL

  56. Borsani O, Zhu J, Verslues PE, Sunkar R, Zhu JK: Endogenous siRNAs derived from a pair of natural cis-antisense transcripts regulate salt tolerance in Arabidopsis.

    Cell 2005, 123:1279-1291. PubMed Abstract | Publisher Full Text OpenURL

  57. Carlile M, Nalbant P, Preston-Fayers K, McHaffie GS, Werner A: Processing of naturally occurring sense/antisense transcripts of the vertebrate Slc34a gene into short RNAs.

    Physiol Genomics 2008, 34:95-100. PubMed Abstract | Publisher Full Text OpenURL

  58. Czech B, Malone CD, Zhou R, Stark A, Schlingeheyde C, Dus M, Perrimon N, Kellis M, Wohlschlegel JA, Sachidanandam R, Hannon GJ, Brennecke J: An endogenous small interfering RNA pathway in Drosophila.

    Nature 2008, 453:798-802. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  59. Watanabe T, Totoki Y, Toyoda A, Kaneda M, Kuramochi-Miyagawa S, Obata Y, Chiba H, Kohara Y, Kono T, Nakano T, Surani MA, Sakaki Y, Sasaki H: Endogenous siRNAs from naturally formed dsRNAs regulate transcripts in mouse oocytes.

    Nature 2008, 453:539-543. PubMed Abstract | Publisher Full Text OpenURL

  60. Okamura K, Balla S, Martin R, Liu N, Lai EC: Two distinct mechanisms generate endogenous siRNAs from bidirectional transcription in Drosophila melanogaster.

    Nat Struct Mol Biol 2008, 15:998. PubMed Abstract | Publisher Full Text OpenURL

  61. Peragine A, Yoshikawa M, Wu G, Albrecht HL, Poethig RS: SGS3 and SGS2/SDE1/RDR6 are required for juvenile development and the production of trans-acting siRNAs in Arabidopsis.

    Genes Dev 2004, 18:2368-2379. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  62. Vazquez F, Vaucheret H, Rajagopalan R, Lepers C, Gasciolli V, Mallory AC, Hilbert JL, Bartel DP, Crete P: Endogenous trans-acting siRNAs regulate the accumulation of Arabidopsis mRNAs.

    Mol Cell 2004, 16:69-79. PubMed Abstract | Publisher Full Text OpenURL

  63. Yoshikawa M, Peragine A, Park MY, Poethig RS: A pathway for the biogenesis of trans-acting siRNAs in Arabidopsis.

    Genes Dev 2005, 19:2164-2175. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  64. Allen E, Xie Z, Gustafson AM, Carrington JC: microRNA-directed phasing during trans-acting siRNA biogenesis in plants.

    Cell 2005, 121:207-221. PubMed Abstract | Publisher Full Text OpenURL

  65. Aravin A, Gaidatzis D, Pfeffer S, Lagos-Quintana M, Landgraf P, Iovino N, Morris P, Brownstein MJ, Kuramochi-Miyagawa S, Nakano T, Chien M, Russo JJ, Ju J, Sheridan R, Sander C, Zavolan M, Tuschl T: A novel class of small RNAs bind to MILI protein in mouse testes.

    Nature 2006, 442:203-207. PubMed Abstract | Publisher Full Text OpenURL

  66. Girard A, Sachidanandam R, Hannon GJ, Carmell MA: A germline-specific class of small RNAs binds mammalian Piwi proteins.

    Nature 2006, 442:199-202. PubMed Abstract | Publisher Full Text OpenURL

  67. Grivna ST, Beyret E, Wang Z, Lin H: A novel class of small RNAs in mouse spermatogenic cells.

    Genes Dev 2006, 20:1709-1714. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  68. Lau NC, Seto AG, Kim J, Kuramochi-Miyagawa S, Nakano T, Bartel DP, Kingston RE: Characterization of the piRNA complex from rat testes.

    Science 2006, 313:363-367. PubMed Abstract | Publisher Full Text OpenURL

  69. Watanabe T, Takeda A, Tsukiyama T, Mise K, Okuno T, Sasaki H, Minami N, Imai H: Identification and characterization of two novel classes of small RNAs in the mouse germline: retrotransposon-derived siRNAs in oocytes and germline small RNAs in testes.

    Genes Dev 2006, 20:1732-1743. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  70. Saito K, Nishida KM, Mori T, Kawamura Y, Miyoshi K, Nagami T, Siomi H, Siomi MC: Specific association of Piwi with rasiRNAs derived from retrotransposon and heterochromatic regions in the Drosophila genome.

    Genes Dev 2006, 20:2214-2222. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  71. Vagin VV, Sigova A, Li C, Seitz H, Gvozdev V, Zamore PD: A distinct small RNA pathway silences selfish genetic elements in the germline.

    Science 2006, 313:320-324. PubMed Abstract | Publisher Full Text OpenURL

  72. Lee YS, Shibata Y, Malhotra A, Dutta A: A novel class of small RNAs: tRNA-derived RNA fragments (tRFs).

    Genes Dev 2009, 23:2639-2649. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  73. Cole C, Sobala A, Lu C, Thatcher SR, Bowman A, Brown JW, Green PJ, Barton GJ, Hutvagner G: Filtering of deep sequencing data reveals the existence of abundant Dicer-dependent small RNAs derived from tRNAs.

    RNA 2009, 15:2147-2160. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  74. Thompson DM, Lu C, Green PJ, Parker R: tRNA cleavage is a conserved response to oxidative stress in eukaryotes.

    RNA 2008, 14:2095-2103. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  75. Maniataki E, Mourelatos Z: Human mitochondrial tRNAMet is exported to the cytoplasm and associates with the Argonaute 2 protein.

    RNA 2005, 11:849-852. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  76. Jiao Y, Meyerowitz EM: Cell-type specific analysis of translating RNAs in developing flowers reveals new levels of control.

    Mol Syst Biol 2010, 6:419. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  77. Margulies M, Egholm M, Altman WE, Attiya S, Bader JS, Bemben LA, Berka J, Braverman MS, Chen YJ, Chen Z, Dewell SB, Du L, Fierro JM, Gomes XV, Godwin BC, He W, Helgesen S, Ho CH, Irzyk GP, Jando SC, Alenquer ML, Jarvie TP, Jirage KB, Kim JB, Knight JR, Lanza JR, Leamon JH, Lefkowitz SM, Lei M, Li J, et al.: Genome sequencing in microfabricated high-density picolitre reactors.

    Nature 2005, 437:376-380. PubMed Abstract | PubMed Central Full Text OpenURL

  78. Harris TD, Buzby PR, Babcock H, Beer E, Bowers J, Braslavsky I, Causey M, Colonell J, Dimeo J, Efcavitch JW, Giladi E, Gill J, Healy J, Jarosz M, Lapen D, Moulton K, Quake SR, Steinmann K, Thayer E, Tyurina A, Ward R, Weiss H, Xie Z: Single-molecule DNA sequencing of a viral genome.

    Science 2008, 320:106-109. PubMed Abstract | Publisher Full Text OpenURL

  79. Lipson D, Raz T, Kieu A, Jones DR, Giladi E, Thayer E, Thompson JF, Letovsky S, Milos P, Causey M: Quantification of the yeast transcriptome by single-molecule sequencing.

    Nat Biotechnol 2009, 27:652-658. PubMed Abstract | Publisher Full Text OpenURL

  80. Eid J, Fehr A, Gray J, Luong K, Lyle J, Otto G, Peluso P, Rank D, Baybayan P, Bettman B, Bibillo A, Bjornson K, Chaudhuri B, Christians F, Cicero R, Clark S, Dalal R, Dewinter A, Dixon J, Foquet M, Gaertner A, Hardenbol P, Heiner C, Hester K, Holden D, Kearns G, Kong X, Kuse R, Lacroix Y, Lin S, et al.: Real-time DNA sequencing from single polymerase molecules.

    Science 2009, 323:133-138. PubMed Abstract | Publisher Full Text OpenURL

  81. Valouev A, Ichikawa J, Tonthat T, Stuart J, Ranade S, Peckham H, Zeng K, Malek JA, Costa G, McKernan K, Sidow A, Fire A, Johnson SM: A high-resolution, nucleosome position map of C. elegans reveals a lack of universal sequence-dictated positioning.

    Genome Res 2008, 18:1051-1063. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  82. Shendure J, Porreca GJ, Reppas NB, Lin X, McCutcheon JP, Rosenbaum AM, Wang MD, Zhang K, Mitra RD, Church GM: Accurate multiplex polony sequencing of an evolved bacterial genome.

    Science 2005, 309:1728-1732. PubMed Abstract | Publisher Full Text OpenURL

  83. Campbell PJ, Stephens PJ, Pleasance ED, O'Meara S, Li H, Santarius T, Stebbings LA, Leroy C, Edkins S, Hardy C, Teague JW, Menzies A, Goodhead I, Turner DJ, Clee CM, Quail MA, Cox A, Brown C, Durbin R, Hurles ME, Edwards PA, Bignell GR, Stratton MR, Futreal PA: Identification of somatically acquired rearrangements in cancer using genome-wide massively parallel paired-end sequencing.

    Nat Genet 2008, 40:722-729. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  84. Ng P, Tan JJ, Ooi HS, Lee YL, Chiu KP, Fullwood MJ, Srinivasan KG, Perbost C, Du L, Sung WK, Wei CL, Ruan Y: Multiplex sequencing of paired-end ditags (MS-PET): a strategy for the ultra-high-throughput analysis of transcriptomes and genomes.

    Nucleic Acids Res 2006, 34:e84. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  85. Shen Y, Sarin S, Liu Y, Hobert O, Pe'er I: Comparing platforms for C. elegans mutant identification using high-throughput whole-genome sequencing.

    PLoS One 2008, 3:e4012. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  86. Linsen SE, de Wit E, Janssens G, Heater S, Chapman L, Parkin RK, Fritz B, Wyman SK, de Bruijn E, Voest EE, Kuersten S, Tewari M, Cuppen E: Limitations and possibilities of small RNA digital gene expression profiling.

    Nat Methods 2009, 6:474-476. PubMed Abstract | Publisher Full Text OpenURL

  87. England TE, Uhlenbeck OC: Enzymatic oligoribonucleotide synthesis with T4 RNA ligase.

    Biochemistry 1978, 17:2069-2076. PubMed Abstract | Publisher Full Text OpenURL

  88. Kikuchi Y, Hishinuma F, Sakaguchi K: Addition of mononucleotides to oligoribonucleotide acceptors with T4 RNA ligase.

    Proc Natl Acad Sci USA 1978, 75:1270-1273. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  89. McLaughlin LW, Piel N, Graeser E: Donor activation in the T4 RNA ligase reaction.

    Biochemistry 1985, 24:267-273. PubMed Abstract | Publisher Full Text OpenURL

  90. Ohtsuka E, Nishikawa S, Sugiura M, Ikehara M: Joining of ribooligonucleotides with T4 RNA ligase and identification of the oligonucleotide-adenylate intermediate.

    Nucleic Acids Res 1976, 3:1613-1623. PubMed Abstract | PubMed Central Full Text OpenURL

  91. Romaniuk E, McLaughlin LW, Neilson T, Romaniuk PJ: The effect of acceptor oligoribonucleotide sequence on the T4 RNA ligase reaction.

    Eur J Biochem 1982, 125:639-643. PubMed Abstract | Publisher Full Text OpenURL

  92. Farazi TA, Juranek SA, Tuschl T: The growing catalog of small RNAs and their association with distinct Argonaute/Piwi family members.

    Development 2008, 135:1201-1214. PubMed Abstract | Publisher Full Text OpenURL

  93. Ebhardt HA, Thi EP, Wang MB, Unrau PJ: Extensive 3' modification of plant small RNAs is modulated by helper component-proteinase expression.

    Proc Natl Acad Sci USA 2005, 102:13398-13403. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  94. Yang Z, Ebright YW, Yu B, Chen X: HEN1 recognizes 21-24 nt small RNA duplexes and deposits a methyl group onto the 2' OH of the 3' terminal nucleotide.

    Nucleic Acids Res 2006, 34:667-675. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  95. Munafó DB, Robb GB: Optimization of enzymatic reaction conditions for generating representative pools of cDNA from small RNA.

    RNA 2010, 16:2537-2552. PubMed Abstract | PubMed Central Full Text OpenURL

  96. Alefelder S, Patel BK, Eckstein F: Incorporation of terminal phosphorothioates into oligonucleotides.

    Nucleic Acids Res 1998, 26:4983-4988. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  97. Hutvágner G, McLachlan J, Pasquinelli AE, Balint E, Tuschl T, Zamore PD: A cellular function for the RNA-interference enzyme Dicer in the maturation of the let-7 small temporal RNA.

    Science 2001, 293:834-838. PubMed Abstract | Publisher Full Text OpenURL

  98. Yu B, Yang Z, Li J, Minakhina S, Yang M, Padgett RW, Steward R, Chen X: Methylation as a crucial step in plant microRNA biogenesis.

    Science 2005, 307:932-935. PubMed Abstract | Publisher Full Text OpenURL

  99. Zhang H, Ehrenkaufer GM, Pompey JM, Hackney JA, Singh U: Small RNAs with 5'-polyphosphate termini associate with a Piwi-related protein and regulate gene expression in the single-celled eukaryote Entamoeba histolytica.

    PLoS Pathog 2008, 4:e1000219. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  100. Haussecker D, Cao D, Huang Y, Parameswaran P, Fire AZ, Kay MA: Capped small RNAs and MOV10 in human hepatitis delta virus replication.

    Nat Struct Mol Biol 2008, 15:714-721. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  101. Affymetrix ENCODE Transcriptome Project; Cold Spring Harbor Laboratory ENCODE Transcriptome Project: Post-transcriptional processing generates a diversity of 5'-modified long and short RNAs.

    Nature 2009, 457:1028-1032. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  102. Maden BE, Corbett ME, Heeney PA, Pugh K, Ajuh PM: Classical and novel approaches to the detection and localization of the numerous modified nucleotides in eukaryotic ribosomal RNA.

    Biochimie 1995, 77:22-29. PubMed Abstract | Publisher Full Text OpenURL

  103. Kozarewa I, Ning Z, Quail MA, Sanders MJ, Berriman M, Turner DJ: Amplification-free Illumina sequencing-library preparation facilitates improved mapping and assembly of (G+C)-biased genomes.

    Nat Methods 2009, 6:291-295. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  104. Mamanova L, Andrews RM, James KD, Sheridan EM, Ellis PD, Langford CF, Ost TW, Collins JE, Turner DJ: FRT-seq: amplification-free, strand-specific transcriptome sequencing.

    Nat Methods 2010, 7:130-132. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  105. Kim JB, Porreca GJ, Song L, Greenway SC, Gorham JM, Church GM, Seidman CE, Seidman JG: Polony multiplex analysis of gene expression (PMAGE) in mouse hypertrophic cardiomyopathy.

    Science 2007, 316:1481-1484. PubMed Abstract | Publisher Full Text OpenURL

  106. Kasschau KD, Fahlgren N, Chapman EJ, Sullivan CM, Cumbie JS, Givan SA, Carrington JC: Genome-wide profiling and analysis of Arabidopsis siRNAs.

    PLoS Biol 2007, 5:e57. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  107. Meyer M, Stenzel U, Hofreiter M: Parallel tagged sequencing on the 454 platform.

    Nat Protoc 2008, 3:267-278. PubMed Abstract | Publisher Full Text OpenURL

  108. Hamady M, Walker JJ, Harris JK, Gold NJ, Knight R: Error-correcting barcoded primers for pyrosequencing hundreds of samples in multiplex.

    Nat Methods 2008, 5:235-237. PubMed Abstract | Publisher Full Text OpenURL

  109. Craig DW, Pearson JV, Szelinger S, Sekar A, Redman M, Corneveaux JJ, Pawlowski TL, Laub T, Nunn G, Stephan DA, Homer N, Huentelman MJ: Identification of genetic variants using bar-coded multiplexed sequencing.

    Nat Methods 2008, 5:887-893. PubMed Abstract | Publisher Full Text OpenURL

  110. Smith AM, Heisler LE, St Onge RP, Farias-Hesson E, Wallace IM, Bodeau J, Harris AN, Perry KM, Giaever G, Pourmand N, Nislow C: Highly-multiplexed barcode sequencing: an efficient method for parallel analysis of pooled samples.

    Nucleic Acids Res 2010, 38:e142. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  111. Binladen J, Gilbert MT, Bollback JP, Panitz F, Bendixen C, Nielsen R, Willerslev E: The use of coded PCR primers enables high-throughput sequencing of multiple homolog amplification products by 454 parallel sequencing.

    PLoS One 2007, 2:e197. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  112. Meyer M, Stenzel U, Myles S, Prufer K, Hofreiter M: Targeted high-throughput sequencing of tagged nucleic acid samples.

    Nucleic Acids Res 2007, 35:e97. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  113. Stiller M, Knapp M, Stenzel U, Hofreiter M, Meyer M: Direct multiplex sequencing (DMPS): a novel method for targeted high-throughput sequencing of ancient and highly degraded DNA.

    Genome Res 2009, 19:1843-1848. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  114. Cronn R, Liston A, Parks M, Gernandt DS, Shen R, Mockler T: Multiplex sequencing of plant chloroplast genomes using Solexa sequencing-by-synthesis technology.

    Nucleic Acids Res 2008, 36:e122-e122. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  115. Fahlgren N, Sullivan CM, Kasschau KD, Chapman EJ, Cumbie JS, Montgomery TA, Gilbert SD, Dasenko M, Backman TWH, Givan SA, Carrington JC: Computational and analytical framework for small RNA profiling by high-throughput sequencing.

    RNA 2009, 15:992-1002. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  116. Marioni JC, Mason CE, Mane SM, Stephens M, Gilad Y: RNA-seq: an assessment of technical reproducibility and comparison with gene expression arrays.

    Genome Research 2008, 18:1509-1517. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  117. Li M, Schonberg A, Schaefer M, Schroeder R, Nasidze I, Stoneking M: Detecting heteroplasmy from high-throughput sequencing of complete human mitochondrial DNA genomes.

    Am J Hum Genet 2010, 87:237-249. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  118. Eveland AL, Satoh-Nagasawa N, Goldshmidt A, Meyer S, Beatty M, Sakai H, Ware D, Jackson D: Digital gene expression signatures for maize development.

    Plant Physiol 2010, 154:1024-1039. PubMed Abstract | Publisher Full Text OpenURL

  119. Wood HM, Belvedere O, Conway C, Daly C, Chalkley R, Bickerdike M, McKinley C, Egan P, Ross L, Hayward B, Morgan J, Davidson L, MacLennan K, Ong TK, Papagiannopoulos K, Cook I, Adams DJ, Taylor GR, Rabbitts P: Using next-generation sequencing for high resolution multiplex analysis of copy number variation from nanogram quantities of DNA from formalin-fixed paraffin-embedded specimens.

    Nucleic Acids Res 2010, 38:e151. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  120. Robinson MD, Oshlack A: A scaling normalization method for differential expression analysis of RNA-seq data.

    Genome Biol 2010, 11:R25. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  121. Li R, Li Y, Kristiansen K, Wang J: SOAP: short oligonucleotide alignment program.

    Bioinformatics 2008, 24:713-714. PubMed Abstract | Publisher Full Text OpenURL

  122. Langmead B, Trapnell C, Pop M, Salzberg SL: Ultrafast and memory-efficient alignment of short DNA sequences to the human genome.

    Genome Biol 2009, 10:R25. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  123. Rozowsky J, Euskirchen G, Auerbach RK, Zhang ZD, Gibson T, Bjornson R, Carriero N, Snyder M, Gerstein MB: PeakSeq enables systematic scoring of ChIP-seq experiments relative to controls.

    Nat Biotechnol 2009, 27:66-75. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  124. Zhang H, Yang JH, Zheng YS, Zhang P, Chen X, Wu J, Xu L, Luo XQ, Ke ZY, Zhou H, Qu LH, Chen YQ: Genome-wide analysis of small RNA and novel microRNA discovery in human acute lymphoblastic leukemia based on extensive sequencing approach.

    PLoS One 2009, 4:e6849. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  125. de Hoon MJL, Taft RJ, Hashimoto T, Kanamori-Katayama M, Kawaji H, Kawano M, Kishima M, Lassmann T, Faulkner GJ, Mattick JS, Daub CO, Carninci P, Kawai J, Suzuki H, Hayashizaki Y: Cross-mapping and the identification of editing sites in mature microRNAs in high-throughput sequencing libraries.

    Genome Res 2010, 20:257-264. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  126. Mortazavi A, Williams BA, McCue K, Schaeffer L, Wold B: Mapping and quantifying mammalian transcriptomes by RNA-seq.

    Nat Methods 2008, 5:621-628. PubMed Abstract | Publisher Full Text OpenURL

  127. Li B, Ruotti V, Stewart RM, Thomson JA, Dewey CN: RNA-seq gene expression estimation with read mapping uncertainty.

    Bioinformatics 2010, 26:493-500. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  128. Ebhardt HA, Tsang HH, Dai DC, Liu Y, Bostan B, Fahlman RP: Meta-analysis of small RNA-sequencing errors reveals ubiquitous post-transcriptional RNA modifications.

    Nucleic Acids Res 2009, 37:2461-2470. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  129. Iida K, Jin H, Zhu JK: Bioinformatics analysis suggests base modifications of tRNAs and miRNAs in Arabidopsis thaliana.

    BMC Genomics 2009, 10:155. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  130. Bilban M, Buehler LK, Head S, Desoye G, Quaranta V: Normalizing DNA microarray data.

    Curr Issues Mol Biol 2002, 4:57-64. PubMed Abstract | Publisher Full Text OpenURL

  131. Autio R, Kilpinen S, Saarela M, Kallioniemi O, Hautaniemi S, Astola J: Comparison of Affymetrix data normalization methods using 6,926 experiments across five array generations.

    BMC Bioinformatics 2009, 10(Suppl 1):S24. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  132. Li C, Wong WH: Model-based analysis of oligonucleotide arrays: expression index computation and outlier detection.

    Proc Natl Acad Sci USA 2001, 98:31-36. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  133. Pelz CR, Kulesz-Martin M, Bagby G, Sears RC: Global rank-invariant set normalization (GRSN) to reduce systematic distortions in microarray data.

    BMC Bioinformatics 2008, 9:520. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  134. Schadt EE, Li C, Ellis B, Wong WH: Feature extraction and normalization algorithms for high-density oligonucleotide gene expression array data.

    J Cell Biochem Suppl 2001, (Suppl 37):120-125. PubMed Abstract | Publisher Full Text OpenURL

  135. Tseng GC, Oh MK, Rohlin L, Liao JC, Wong WH: Issues in cDNA microarray analysis: quality filtering, channel normalization, models of variations and assessment of gene effects.

    Nucleic Acids Res 2001, 29:2549-2557. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  136. Thellin O, Zorzi W, Lakaye B, De Borman B, Coumans B, Hennen G, Grisar T, Igout A, Heinen E: Housekeeping genes as internal standards: use and limits.

    J Biotechnol 1999, 75:291-295. PubMed Abstract | Publisher Full Text OpenURL

  137. Suzuki T, Higgins PJ, Crawford DR: Control selection for RNA quantitation.

    Biotechniques 2000, 29:332-337. PubMed Abstract OpenURL

  138. Lee PD, Sladek R, Greenwood CM, Hudson TJ: Control genes and variability: absence of ubiquitous reference transcripts in diverse mammalian expression studies.

    Genome Res 2002, 12:292-297. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  139. Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, De Paepe A, Speleman F: Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes.

    Genome Biol 2002, 3:RESEARCH0034. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  140. Czechowski T, Stitt M, Altmann T, Udvardi MK, Scheible WR: Genome-wide identification and testing of superior reference genes for transcript normalization in Arabidopsis.

    Plant Physiol 2005, 139:5-17. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  141. Khimani AH, Mhashilkar AM, Mikulskis A, O'Malley M, Liao J, Golenko EE, Mayer P, Chada S, Killian JB, Lott ST: Housekeeping genes in cancer: normalization of array data.

    Biotechniques 2005, 38:739-745. PubMed Abstract | Publisher Full Text OpenURL

  142. Bolstad BM, Irizarry RA, Astrand M, Speed TP: A comparison of normalization methods for high density oligonucleotide array data based on variance and bias.

    Bioinformatics 2003, 19:185-193. PubMed Abstract | Publisher Full Text OpenURL

  143. Durbin BP, Hardin JS, Hawkins DM, Rocke DM: A variance-stabilizing transformation for gene-expression microarray data.

    Bioinformatics 2002, 18(Suppl 1):S105-S110. PubMed Abstract | Publisher Full Text OpenURL

  144. Huber W, von Heydebreck A, Sultmann H, Poustka A, Vingron M: Variance stabilization applied to microarray data calibration and to the quantification of differential expression.

    Bioinformatics 2002, 18(Suppl 1):S96-S104. PubMed Abstract | Publisher Full Text OpenURL

  145. Munson P: A 'consistency' test for determining the significance of gene expression changes on replicate samples and two-convenient variance-stabilizing transformations. [http://oz.berkeley.edu/users/terry/zarray/Affy/GL_Workshop/genelogic2001.html] webcite

    In Proceedings of the GeneLogic Workshop on Low Level Analysis of Affymetrix GeneChip Data Edited by Speed T. Bethesda, MD; 2001. OpenURL

  146. Barbacioru CC, Wang Y, Canales RD, Sun YA, Keys DN, Chan F, Poulter KA, Samaha RR: Effect of various normalization methods on Applied Biosystems expression array system data.

    BMC Bioinformatics 2006, 7:533. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  147. Binder H, Preibisch S, Berger H: Calibration of microarray gene-expression data.

    Methods Mol Biol 2010, 576:375-407. PubMed Abstract | Publisher Full Text OpenURL

  148. Harr B, Schlotterer C: Comparison of algorithms for the analysis of Affymetrix microarray data as evaluated by co-expression of genes in known operons.

    Nucleic Acids Res 2006, 34:e8. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  149. Millenaar FF, Okyere J, May ST, van Zanten M, Voesenek LA, Peeters AJ: How to decide? Different methods of calculating gene expression from short oligonucleotide array data will give different results.

    BMC Bioinformatics 2006, 7:137. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  150. Trapnell C, Williams BA, Pertea G, Mortazavi A, Kwan G, van Baren MJ, Salzberg SL, Wold BJ, Pachter L: Transcript assembly and quantification by RNA-seq reveals unannotated transcripts and isoform switching during cell differentiation.

    Nat Biotechnol 2010, 28:511-515. PubMed Abstract | Publisher Full Text OpenURL

  151. German MA, Pillay M, Jeong DH, Hetawal A, Luo S, Janardhanan P, Kannan V, Rymarquis LA, Nobuta K, German R, De Paoli E, Lu C, Schroth G, Meyers BC, Green PJ: Global identification of microRNA-target RNA pairs by parallel analysis of RNA ends.

    Nat Biotechnol 2008, 26:941-946. PubMed Abstract | Publisher Full Text OpenURL

  152. Chellappan P, Xia J, Zhou X, Gao S, Zhang X, Coutino G, Vazquez F, Zhang W, Jin H: siRNAs from miRNA sites mediate DNA methylation of target genes.

    Nucleic Acids Res 2010, 38:6883-6894. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  153. Chen HM, Chen LT, Patel K, Li YH, Baulcombe DC, Wu SH: From the cover: 22-nucleotide RNAs trigger secondary siRNA biogenesis in plants.

    Proc Natl Acad Sci 2010, 107:15269-15274. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  154. Bullard JH, Purdom E, Hansen KD, Dudoit S: Evaluation of statistical methods for normalization and differential expression in mRNA-seq experiments.

    BMC Bioinformatics 2010, 11:94. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  155. Heisel SE, Zhang Y, Allen E, Guo L, Reynolds TL, Yang X, Kovalic D, Roberts JK: Characterization of unique small RNA populations from rice grain.

    PLoS One 2008, 3:e2871. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  156. Taslim C, Wu J, Yan P, Singer G, Parvin J, Huang T, Lin S, Huang K: Comparative study on ChIP-seq data: normalization and binding pattern characterization.

    Bioinformatics 2009, 25:2334-2340. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  157. Audic S, Claverie JM: The significance of digital gene expression profiles.

    Genome Res 1997, 7:986-995. PubMed Abstract | Publisher Full Text OpenURL

  158. Tiňo P: Basic properties and information theory of Audic-Claverie statistic for analyzing cDNA arrays.

    BMC Bioinformatics 2009, 10:310. PubMed Abstract | PubMed Central Full Text OpenURL

  159. Sultan M, Schulz MH, Richard H, Magen A, Klingenhoff A, Scherf M, Seifert M, Borodina T, Soldatov A, Parkhomchuk D, Schmidt D, O'Keeffe S, Haas S, Vingron M, Lehrach H, Yaspo ML: A global view of gene activity and alternative splicing by deep sequencing of the human transcriptome.

    Science 2008, 321:956-960. PubMed Abstract | Publisher Full Text OpenURL

  160. Morin RD, O'Connor MD, Griffith M, Kuchenbauer F, Delaney A, Prabhu AL, Zhao Y, McDonald H, Zeng T, Hirst M, Eaves CJ, Marra MA: Application of massively parallel sequencing to microRNA profiling and discovery in human embryonic stem cells.

    Genome Res 2008, 18:610-621. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  161. Li J, Jiang H, Wong W: Modeling non-uniformity in short-read rates in RNA-seq data.

    Genome Biol 2010, 11:R50. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  162. Robinson MD, McCarthy DJ, Smyth GK: edgeR: a Bioconductor package for differential expression analysis of digital gene expression data.

    Bioinformatics 2009, 26:139-140. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL