Clearance of an immunosuppressive virus from the CNS coincides with immune reanimation and diversification
© Lauterbach et al; licensee BioMed Central Ltd. 2007
Received: 13 April 2007
Accepted: 06 June 2007
Published: 06 June 2007
We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact us so we can address the problem.
Once a virus infection establishes persistence in the central nervous system (CNS), it is especially difficult to eliminate from this specialized compartment. Therefore, it is of the utmost importance to fully understand scenarios during which a persisting virus is ultimately purged from the CNS by the adaptive immune system. Such a scenario can be found following infection of adult mice with an immunosuppressive variant of lymphocytic choriomeningitis virus (LCMV) referred to as clone 13. In this study we demonstrate that following intravenous inoculation, clone 13 rapidly infected peripheral tissues within one week, but more slowly inundated the entire brain parenchyma over the course of a month. During the establishment of persistence, we observed that genetically tagged LCMV-specific cytotoxic T lymphocytes (CTL) progressively lost function; however, the severity of this loss in the CNS was never as substantial as that observed in the periphery. One of the most impressive features of this model system is that the peripheral T cell response eventually regains functionality at ~60–80 days post-infection, and this was associated with a rapid decline in virus from the periphery. Coincident with this "reanimation phase" was a massive influx of CD4 T and B cells into the CNS and a dramatic reduction in viral distribution. In fact, olfactory bulb neurons served as the last refuge for the persisting virus, which was ultimately purged from the CNS within 200 days post-infection. These data indicate that a functionally revived immune response can prevail over a virus that establishes widespread presence both in the periphery and brain parenchyma, and that therapeutic enhancement of an existing response could serve as an effective means to thwart long term CNS persistence.
Viral infections of the central nervous system (CNS) can remain asymptomatic or result in long-lasting neurological dysfunction, and in some extreme cases, death. Viruses that infect the CNS include herpesviruses, rhabdoviruses, retroviruses, picornaviruses, flaviviruses and arenaviruses (reviewed in ). Upon entry the means by which viruses adversely affect the CNS consist of direct mechanisms such as cellular lysis and blockade of cellular function or indirect mechanisms mediated by infiltrating immune cells attempting to ward off the invading pathogen. In fact, under certain conditions, the immune response necessary to eliminate the infectious agent can actually become detrimental to the host [2–4]. To limit the degree of immunopathology within the CNS, strong evolutionary pressures have likely led to the acquisition of several immune dampening mechanisms, such as compartmentalization behind a non-fenestrated blood-brain-barrier (BBB) and the limited expression of antigen-presenting machinery (i.e., major histocompatibility complex class I and II) (reviewed in [5, 6]). The downside of this tight immune regulation is that a multitude of pathogens can exploit this weakness in order to establish long term persistence in CNS resident cells. Because the CNS is fraught with mechanisms to limit the toxicity (and most likely the effectiveness) of the immune response, it is surmised that this tissue compartment provides a favorable environment for prolonged viral persistence and neurologic dysfunction long after sterilizing immunity is achieved in the periphery (i.e., the route through which neurotropic viruses enter naturally).
Fetal infection in humans with lymphocytic choriomeningitis virus (LCMV) can lead to serious neurological complications, such as microcephaly, hydrocephalus, reduced mitosis in developing brain cells and mental retardation . If mice are infected at birth or in utero with LCMV, neurons are the predominant cell population in the CNS parenchyma that harbor the virus . Intravenous infection of adult mice with the parental strain of LCMV referred to as Armstrong results in an acute infection, which is resolved by virus-specific CD8 and CD4 T cells within 8–10 days . In contrast, viral variants have been isolated that abort the T cell response and establish persistence in multiple tissues [10–16]. The prototypic member of this viral family is referred to as clone 13 and differs from wild type LCMV Armstrong by only two amino acids [10–12, 14]. Clone 13 infection shares some of the features associated with persistent HIV-1 infection in humans, including infection/impairment of dendritic cells (DC) , exhaustion/deletion of the virus-specific T cell response [17–21], and the rapid establishment of viral persistence in the CNS as well as the periphery . Interestingly, despite immune exhaustion (i.e., functional hyporesponsiveness of T cells), the virus-specific immune response eventually reacquires effector function and is able to clear clone 13 from peripheral tissues such as the blood, spleen, and liver [15, 20]. However, studies have shown that clone 13 continues to persist in the CNS past the time when the virus is purged in the periphery .
Presently, it is not known why clone 13 continues to persist in the CNS for an extended time frame following viral clearance from the periphery , nor is it known which cell population(s) residing in the brain parenchyma harbors clone 13 during the early and late phases of persistence. It is also not known which elements of the cellular immune response enter the CNS in response to clone 13. In this study we set out to address these unanswered questions by simultaneously analyzing clone 13 tropism as well as the responding anti-viral immune response within the CNS. We demonstrate that clone 13 completely inundated the brain parenchyma with delayed kinetics when compared to peripheral tissues. Within the CNS parenchyma clone 13 sought early refuge within astrocytes and later infected olfactory bulb neurons before it was eventually purged from the entire compartment. When the functionality of the infiltrating CTL response was examined over this protracted clearance phase, signs of CTL exhaustion were evident but never as severe as that observed in peripheral tissues such as the spleen and liver. Interestingly, during the "functional reanimation" phase, a time period when the anti-viral CTL response regained functionality in all tissues, a major shift in the composition of the CNS immune repertoire was observed. Most notably, CD4 T and B cells increased both in frequency and cell number within the CNS during this phase. This coincided with a dramatic reduction in the number of persistently infected astrocytes and the eventual eradication of clone 13 from the CNS. These data provide a framework for understanding the cellular constituents responsible for purging an established persistent infection from the CNS and should facilitate future studies that aim to identify the precise mechanism(s) of clearance.
C57BL/6 (H-2 b , Thy1.2+) and C57BL/6 Thy1.1+DbGP33–41 TCR-tg (P14) mice were bred and maintained in a closed breeding facility at The Scripps Research Institute. The handling of all mice conformed to the requirements of the National Institutes of Health and The Scripps Research Institute animal research committee.
Six- to eight-week-old C57BL/6 mice were infected intravenously (i.v.) with 2 × 106 PFU of LCMV Armstrong clone 53b or LCMV Clone 13 to generate acute or persistent infection, respectively. Stocks were prepared by a single passage on BHK-21 cells, and viral titers were determined by plaque formation on Vero cells. The phenotypic and genotypic characterization of both LCMV strains, their passage, and viral plaque assays for quantification are described elsewhere .
RT-PCR and Mnl I digestion from CNS viral clones
The RT-PCR and Mnl I digestion procedures were performed as described . Briefly, brain homogenate was subjected to a standard plaque assay. Single plaques were picked and transferred into individual wells with a monolayer of BHK-21 cells. After two days total RNA was isolated (TRI REAGENT, Molecular Research Center, Inc.) and transcribed into cDNA using SuperScript III Reverse Transcriptase and random hexamer primers (Invitrogen). PCR was performed on the cDNA product with primers specific for the LCMV GP resulting in a 362 bp long DNA fragment. 10 μg of the PCR product were digested with Mnl I (NEB) and analyzed by agarose gel electrophoresis. This method allows detection of the U-to-C change at nucleotide 855 in the viral RNA of clone 13, which creates a cleavage site for Mnl I.
T cell isolation and adoptive transfers
CD8 T cells were purified from the spleens of naïve P14 mice by negative selection (StemCell Technologies), and 5 × 103 purified cells were transferred i.v. into C57BL/6 mice. The mice were then infected 1–2 days later with LCMV.
Mononuclear cell isolations and tissue processing
To obtain cell suspensions for flow cytometric analyses and stimulation cultures, the spleens, livers and CNS were harvested from mice after an intracardiac perfusion with a 0.9% saline solution to remove the contaminating blood lymphocytes. If noted, organs were incubated with 1 ml collagenase D (1 mg/ml; Roche) at 37°C for 20 min. Single-cell suspensions were then prepared by mechanically disrupting the organs through a 100-μm filter. Spleen cells were treated with red blood cell lysis buffer (0.14 M NH4Cl and 0.017 M Tris-HCl, pH 7.2), washed twice, and analyzed. Intrahepatic lymphocytes were further isolated by centrifugation in 35% Percoll (Amersham Biosciences) and then subjected to red blood cell lysis. To extract brain-infiltrating leukocytes, homogenates were resuspended in 90% Percoll (4 ml), which was overlaid with 60% Percoll (3 ml), 40% Percoll (4 ml), and finally 1× HBSS (3 ml). The Percoll gradients were then centrifuged at 1,500 rpm for 15 min, after which the band corresponding to mononuclear cells was carefully extracted, washed, and, ultimately, analyzed. The number of mononuclear cells was determined from each organ preparation and used to calculate the absolute number of specific cell populations. For immunohistochemical analyses, fresh, unfixed tissues were frozen on dry ice in optimal cutting temperature (OCT; Tissue-Tek). For the detection of infectious virus in the CNS, brains were cut sagittally and then half was homogenized using a Mini Beadbeater (BioSpec Products). Homogenates were analyzed using a standard plaque assay on Vero cells.
Flow cytometry and intracellular cytokine staining
The following antibodies purchased from BD Biosciences were used to stain splenocytes as well as intrahepatic and brain-infiltrating leukocytes: anti-CD3-PE, anti-CD4-APC-Cy7, anti-CD11b-PE-Cy7, anti-CD11c-APC, CD19-PerCP-Cy5.5, anti-CD45.2-FITC, anti-NK1.1-PE, anti-Thy1.1-PerCP, anti-Thy1.2-PE, anti-TNFa-FITC, anti-IFNγ-PE and anti-IL-2-APC. Anti-CD8-Pacific Blue was purchased from Caltag. Before staining, all cell preparations were blocked with 3.3 μg/ml anti-mouse CD16/CD32 (Fc block; BD Biosciences) in PBS containing 1% FBS for 10 min. The Fc block was also included in all 20 min surface stains. For intracellular cytokine staining cell suspensions were stimulated for 5 hrs with 5 μg/ml of a dominant CD8 epitope mapping to amino acids 33–41 of the LCMV glycoprotein (GP33–41) in the presence of 50 U/ml recombinant IL-2 (NIH) and 1 μg/ml brefeldin A (Sigma). Afterward, cells surface stained with CD8-Pacific Blue and Thy1.1-PerCP and were then simultaneously fixed/permeabilized with a paraformaldehyde-saponin solution and, finally, stained with antibodies directed against IFN-γ, TNF-α and IL-2. Cells were acquired using a digital flow cytometer (Digital LSR II; Becton Dickinson) that allows up to 10-color detection by using four different excitation lasers. Flow cytometric data were analyzed with FlowJo software (Tree Star, Inc.). Gates for cytokine analyses were set based on non-peptide-stimulated controls and cells that stained negative for the protein of interest.
Data handling, analysis, and graphical representations were performed using Microsoft Excel 2003 and SigmaPlot 9.0 (Systat). Statistical differences were determined by Student's t test or Mann-Whitney Rank Sum Test (P < 0.05) using SigmaStat 3.1 (SigmaStat).
CNS viral clearance is delayed in mice infected intravenously with LCMV clone 13
High dose infection of adult mice with LCMV clone 13 results in a chronic viral infection during which the virus distributes systemically both in lymphoid and non-lymphoid tissues [12, 20, 23, 24]. In nearly all peripheral tissues, clone 13 is purged within 2 to 3 months ; however, a few studies have suggested that virus might persist for the lifetime of the host in the CNS [11, 20]. This is of particular interest because the CNS is an immunologically specialized compartment [6, 25] known to limit the effectiveness of adaptive immune response. Thus, it is plausible that once a virus like clone 13 establishes long term persistence within the CNS it is difficult (if not impossible) to completely remove.
Brain Viral Titers. Kinetics of viral clearance from the brain. Clone 13 infected mice were perfused with saline and then brains were isolated at the denoted days post infection (DPI). The titer of infectious virus was determined by plaque assay and is expressed as plaque forming units (PFU) per gram tissue. The lower limit of detection is 200 PFU/g of tissue
Brain Virus Titer (PFU/g)
4.04 × 105
3.90 × 106
2.16 × 106
1.16 × 105
5.73 × 103
Interestingly, and in support of previous studies , the pattern of clearance in the CNS did not closely mirror that of peripheral tissues such as the spleen and liver. Whereas the blood (data not shown), liver (data not shown), and spleen (Fig. 1) were completely purged of virus within 60–80 days of infection, CNS virus was not finally resolved until around day 200 (Fig. 1, Table 1). However, coincident with the clearance of clone 13 from the periphery around day 60 was a marked shift in the distribution of virus within the brain parenchyma. Between day 60 and 150, clone 13 was purged to a large degree from the brain parenchyma. In fact, the choroid plexus, meninges, subventricular zone, and, most notably, the olfactory bulb, served as the last bastions of virus (see day 150, Fig. 1) before the pathogen was finally purged at day 200 (Fig. 1). These data demonstrate that despite the establishment of long term persistence within the CNS, clone 13 can ultimately be eliminated from this compartment; however, the kinetics of clearance differ significantly from most peripheral tissues.
Pattern and tropism of LCMV clone 13 in the CNS
Because the virus was introduced into the blood supply, it is no surprise that brain infection was initiated around blood vessels at early time points post-infection. This gave rise to a punctate pattern of viral antigen staining on sagittal brain reconstructions at day 10 p.i. (Fig. 1). At these early time points, clone 13 antigen could also be found in choroid plexus, meninges, and ependymal cells – the traditional targets of LCMV introduced intracerebrally . From the vascular seeds, it is likely that the astrocyte, whose foot processes line the blood brain barrier, served as the portal of clone 13 entry into the brain parenchyma. When the tropism of the virus was examined at one month post-infection by co-staining for LCMV and GFAP (astrocytes) or NeuN (neurons), it was revealed that all of the parenchymal LCMV staining overlapped with GFAP (Fig. 2) not NeuN (data not shown), supporting the notion that astrocytes are the preferred parenchymal target for clone 13 introduced intravenously. By day 20 post-infection, clusters of antigen could be observed throughout the parenchyma (Fig. 1), and the virus appeared to be moving from cell-to-cell (Fig. 2). This finally progressed to near complete inundation of the parenchyma at day 30 p.i. – a state that remained until day 60. Interestingly, during this progression the corpus callosum and neocortex were never infected to the same degree as the remainder of the brain parenchyma.
Following day 60 a dramatic change in the distribution of clone 13 was noted in the CNS parenchyma. By day 150 p.i., a time point when spleen was completely purged of clone 13, viral antigen was substantially reduced in the brain parenchyma, but could still be found in the choroid plexus, meninges, subventricular zone, and olfactory bulb (Fig. 1). Interestingly, at this late phase of persistence, clone 13 appeared to have acquired a new target. Co-staining analyses revealed that in addition to ependymal cells, meningeal cells, and cells comprising the choroid plexus, clone 13 had spread to olfactory bulb neurons (Fig. 2). These data demonstrate that for the first two months of persistence, clone 13 primarily infects astrocytes within the brain parenchyma, but establishes late phase persistence in olfactory bulb neurons before it is finally cleared at day 200 post-infection.
Neurotropic Armstrong is not selected for over time in the CNS of clone 13 infected mice
Dynamics of LCMV specific CTL responses
The delayed clearance kinetics in the CNS compared to periphery (e.g., the spleen and liver) led us to examine the LCMV-specific CD8 T cell response during both the acute and chronic phases of persistence. As a positive control for these studies, we simultaneously examined the CTL response to LCMV Armstrong, which following intravenous inoculation is readily cleared from all tissues within 10 days. Because LCMV clone 13 differs by only two amino acids from the parental Armstrong strain [22, 24], all known T cell epitopes are preserved, rendering these two viruses particularly amenable to study. In order to monitor the generation and maintenance of virus-specific CTL over time, we opted to study a traceable population of LCMV-specific T cell receptor (TCR) transgenic (tg) cells specific to amino acids 33–41 of the LCMV glycoprotein (GP) (DbGP33–41) . These cells have been used routinely in the field to provide a traceable representative of the endogenous CTL response [29–31]. The advantage of using TCR-tg cells is that the fate of a single LCMV-specific T cell population with a known TCR can be followed from the initial infection to the late phase of persistence without the contaminating influence of new thymic emigrants that emerge throughout infection .
Differential preservation of CTL function in clone 13 infected mice
The "functional reanimation" phase is associated with diversification in the CNS immune repertoire
The time course of sagittal brain reconstructions revealed that clone 13 established widespread infection of the brain parenchyma predominantly in astrocytes and that the virus was finally eliminated from this compartment following a transient state persistence in olfactory bulb neurons (Fig. 1, 2). We define the time period following day 60 as the "functional reanimation" phase because CTL cytokine-producing ability returns to normal levels both in the periphery and CNS. During this period, viral titers in serum (not shown), liver (not shown), and spleen (Fig. 1) are reduced to background levels, and CNS virus begins a steady descent that requires >100 additional days before complete clearance is achieved. We became particularly interested in this time period because the adaptive immune system, despite passing through a state of functional exhaustion, ultimately gains the upper hand in the clone 13 system and purges virus from the immunologically specialized CNS. Therefore, we next examined the immunological factors associated with CNS viral clearance. Our CTL functional data demonstrate quite clearly that immune exhaustion in the CNS was never as severe as that observed in the spleen and liver (Fig. 5C), and at the time point when functional reanimation begins (~ day 60), a significant increase in P14 number and a coinciding decrease in viral titers was noted (Fig. 4E).
The shift in the CD8:CD4 ratio during the reanimation phase prompted us to further investigate the entire immune repertoire in the CNS. For these complex analyses, we selected day 8 and 70 p.i. as time points representative of early functional exhaustion and reanimation, respectively. These were also the time points when we observed the most pronounced mononuclear infiltration into the CNS (Fig. 4), which facilitated analyses of CNS immune repertoires in individual mice. Using multi-parameter digital flow cytometry, we quantified seven distinct cell populations in single samples extracted from the CNS of individual mice: CD8 T cells (CD45hiThy1.2+CD8+CD4-), CD4 T cells (CD45hiThy1.2+CD4+CD8-), B cells (CD45hiNK1.1-Thy1.2-CD19+), NK cells (CD45hiCD4-CD8-CD11b-NK1.1+), dendritic cells (CD45hiNK1.1-Thy1.2-CD11c+), macrophages (CD45hiNK1.1-Thy1.2-CD11c-CD11b+), and microglia (CD45lowNK1.1-Thy1.2-CD11b+). Most of the denoted cell populations were elevated both in frequency (Fig. 6B) and absolute number (Fig. 6C) at day 70 p.i. Only macrophages and microglia were found at lower frequencies (Fig. 6B), which did not affect absolute numbers (Fig. 6C). Dendritic cells and NK cells increased only slightly. The most dramatic changes occurred in the lymphocyte compartment, specifically CD4 T and B cells. The absolute number of CD4 T cell numbers increased more than 22-fold, and B cell numbers, 7-fold (Fig. 6C). Importantly, to demonstrate specificity in the bulk CD4 compartment at day 70 p.i., we utilized an I-AbGP61–80 MHC tetramer as described previously [21, 37]. At day 70, 4.5% ± 2.6% of the CD4 T cells were specific for the immunodominant GP61–80 peptide presented in I-Ab. CD8 T cells still represented the most predominant leukocyte population in the CNS at day 70, with their numbers increasing 4-fold from day 8. In addition, 11.7 ± 2.6% of the CD8 cells were determined to be GP33–41 specific by DbGP33–41 MHC tetramer staining. Importantly, all of the aforementioned changes were unique to the CNS at day 70 and not noted in the spleen or liver (data not shown). These data demonstrate collectively that at day 70 p.i., a time point when peripheral tissues are largely devoid of virus, the adaptive immune response in the CNS not only regains functionality (Fig. 5) but also diversifies its cellular repertoire (Fig. 6). This coincides with a decline in CNS viral titers (Fig. 4E).
The immunosuppressive variant of LCMV, clone 13, was first isolated over two decades ago from spleens of persistently infected carrier mice , and since that time infection with this isolate has provided a highly relevant paradigm to identify host factors that facilitate the establishment of systemic viral persistence [15, 18, 20, 21, 38, 39]. Importantly, many of the lessons learned in the clone 13 system have direct correlates to immunosuppressive states induced during persistent infection of humans. As case in point is the recent identification of the PD-1  and IL-10 pathways  as being involved in the immunosuppression observed during persistent infections of both mouse [38, 39] and humans [40–42]. Another advantage of the clone 13 system that has not been exploited to any appreciable degree stems from the fact that the virus is purged almost entirely from the host over an extended time frame. Following a period of functional exhaustion [17, 19], the adaptive immune system appears to reengage in clone 13 infected mice and purge virus systemically. The latter period, which we define as the "functional reanimation" phase, provides a desirable experimental paradigm, because the immune system, despite suffering through a state of immunosuppression, eventually achieves the upper hand without therapeutic intervention. Given that functional reanimation of the immune system is a coveted therapeutic aim in persistently infected humans, we propose that there is much to be learned by studying the natural progression and evolution of adaptive immunity in clone 13 infected mice. In the clone 13 system, nature provides instruction regarding how to control a systemically distributed persistent viral infection that simultaneously engages several immunosuppressive pathways [15, 38, 39].
At the outset of our studies, little was known about the progression of clone 13 infection within the CNS – a compartment of particular interest given its immunologically specialized status [6, 25] and its unique susceptibility to irreparable consequences during viral persistence . In this model it was known that most peripheral tissues were purged of clone 13 within 50 to 60 days, whereas the CNS remained replete with infectious virus at this time , suggesting the possibility that the adaptive immune system might not be equipped to cleanse the CNS of a persistent virus after progressing through an immunosuppressive state. Therefore, we initiated a series of studies to investigate the relationship between clone 13 and the adaptive immune response in the CNS over time. The results of these studies have led to four important findings that we believe advance our understanding of this model system. First, following introduction into the blood supply, we noted that clone 13 inundated the brain parenchyma more slowly than peripheral tissues, such as the spleen and liver. Second, within the brain parenchyma, we observed the clone 13 replicated initially in astrocytes and was later found in olfactory bulb neurons (one of the last bastions of viral persistence); however, despite this tropism shift, clone 13 was eventually purged from the CNS, albeit with delayed kinetics when compared to the periphery. Third, analyses of clone 13-specific CTL revealed their presence in the CNS early after infection, but their numbers were reduced when compared to an acute Armstrong infection. When CTL functionality was examined, we observed an intermediate state of functional impairment in anti-viral cytokine production during the exhaustion phase when clone 13 established a strong presence in the brain parenchyma. Fourth, during the reanimation phase, a time period when virus-specific CTL regained functionality and increased in number within the CNS, diversification of the CNS immune repertoire was observed, most notably an increase in the number of CD4+ T cells and B lymphocytes. This diversification coincided with a dramatic reduction in the parenchymal virus load and the eventual eradication of the pathogen from the CNS over the ensuing months. These data suggest collectively that temporal diversification of the immune repertoire is nature's solution to the problem of removing immunosuppressive clone 13 from the murine CNS – a supposition that requires further experimentation to prove definitively.
To gain insights into clone 13 infection kinetics, we assembled temporal sequences of tissue reconstructions (periphery versus brain) to illustrate the expression of viral antigen over time. After an intravenous injection, clone 13 distributes systemically [12, 23, 24]. Following systemic distribution, the representative peripheral tissues we examined (i.e., spleen and liver) were fully inundated with virus by day 10, whereas complete infection of the brain parenchyma was not achieved until day 30 (Fig. 1). This delay is likely explained by the presence of a non-fenestrated blood-brain-barrier (BBB) in the CNS, which has an essential role in maintaining a highly regulated microenvironment for the proper neuronal functioning. The BBB is composed of astrocytic foot processes, endothelial cells, and their associated basement membranes . Importantly, the receptor for LCMV clone 13, α-dystroglycan , is highly expressed on the astrocyte foot processes [46–48]. In fact, we propose that this explains the early targeting of astrocytes by clone 13. We also postulate that astrocytes likely serve as the portal for clone 13 entry into the CNS following intravenous inoculation. This is supported by our confocal analyses (Fig. 2) and the punctate pattern of viral antigen expression we observed around blood vessels on brain reconstructions at day 20 p.i. (Fig. 1). Astrocytes have also been described as an intermediary following neonatal infection of rats with the LCMV Armstrong-4 strain , and glial tumor cells can be transduced with LCMV-GP-pseudotyped lentiviral vectors . Interestingly, the pattern of CNS infection in adult mice infected intravenously with clone 13 differs considerably from that observed following infection at birth or in utero [51, 52]. When LCMV is injected into neonates, the resultant carrier mice reach adulthood with virus persisting solely in parenchymal neurons [52, 53]. These adult carrier mice harbor the clone 13 variant of LCMV in the periphery , yet astrocytes remain devoid of virus. The precise variables that dictate the patterns of LCMV CNS tropism remain to be determined and are an active area of investigation within the laboratory.
Another interesting observation regarding clone 13 tropism relates to how the virus gains access to olfactory bulb neurons over time. We originally surmised that following an intravenous clone 13 infection, the CNS would select for the more neutropic Armstrong strain of LCMV, which differs from clone 13 by only two amino acids. Indeed, there is precedence in the literature to support that Armstrong can out compete clone 13 within the CNS , and reacquisition of the two amino acids required to revert clone 13 back to Armstrong was not inconceivable over the lengthy 6 month period of CNS persistence. However, examination of viral clones from the CNS at early and late time points revealed quite conclusively that clone 13 did not lose its Mnl I restriction enzyme site, evidence of conversion into the Armstrong strain [13, 16]. While these data demonstrate that the Armstrong strain of LCMV was not generated, it remains possible that other variants of LCMV were selected for in the CNS of clone 13 infected mice. Sequence analyses of clones are required to address this possibility.
A second possibility to explain the transition to olfactory bulb neurons during the late phase of persistence could be the targeting of neural stem cells. Interestingly, lentiviral vectors pseudotyped with LCMV (WE54)-GP have been shown to transduce neural stem cells/progenitors in vivo . Studies have demonstrated that GFAP-expressing type B astrocytes residing in the subventricular zone (SVZ) are the in vivo precursors of newly generated neurons in the adult mammalian brain . Type B astrocytes give rise to rapidly dividing transit-amplifying cells, which further develop into migratory neuroblasts (reviewed in ). Forming tangential chains, these neuroblasts migrate along the rostral migratory stream (RMS) from the SVZ into the olfactory bulb, where they differentiate into two kinds of inhibitory neurons . Given that lentiviral vectors pseudotyped with LCMV GP have been shown to target neural stem cells, it conceivable that clone 13 accesses olfactory bulb neurons in part through this pathway. Studies are underway to address this hypothesis.
Because clone 13 persisted in the CNS of mice for roughly 6 months before eradication, we considered analyses of the responding immune repertoire to be of great importance. We began by first examining a traceable representative of the virus-specific CTL response, namely P14 cells (or DbGP33–41 specific CTL). Approximately, 5-fold more P14 cells were recruited into the CNS of Armstrong versus clone 13 infected mice at day 8 p.i. Confirming results from previous studies [18, 20], we also observed early evidence of CTL functional exhaustion around this time point. However, it should be noted that the severity of CTL exhaustion in the CNS of clone 13 infected mice was not as severe as that observed in peripheral tissues. Moreover, P14 cells in the CNS never lost the ability to produce the antiviral cytokine IFN-γ. The relative functional preservation of CTL in the CNS could be attributed to the low number of DCs in this compartment during the acute phase of clone 13 persistence (Fig. 7C). DCs in clone 13 infected mice were recently shown to be a major source of the immunosuppressive cytokine, IL-10, responsible for T cell inactivation and subsequent viral persistence in this model system . A reduced number of CNS DCs could potentially expose CTL to a less immunosuppressive milieu.
An alternative possibility is that the lower level of CNS CTL exhaustion stems from the long time period required by clone 13 to inundate the brain parenchyma with antigen. However, it is important to note that despite this better preservation of function, CTL still failed to prevent clone 13 from establishing widespread persistence throughout the brain parenchyma. In fact, the duration of clone 13 persistence in the CNS was considerably longer than that observed in peripheral tissues containing heavily exhausted T cells. Therefore, the degree of functional exhaustion cannot be used to explain the pattern of persistence in the CNS following an intravenous clone 13 infection.
One of the most important features of the clone 13 model is the ability of dysfunctional antiviral CTL to regain their cytokine-producing abilities starting around day 60 p.i. This progresses to a state of complete functional recovery in all tissues examined by day 90 p.i. (Fig. 5). During this "reanimation phase" clone 13 is purged from most of the periphery [19, 20], and we noted a marked elevation in the number of CTL in the CNS. Associated with CTL reactivation was a dramatic shift in the immune repertoire found in the CNS, but not the periphery (Fig. 6). Most notably, a substantial increase in CD4+ T cells (which included the dominant I-AbGP61–80 specific response) and B cells were observed in the CNS. B cells and antiviral antibodies have been implicated in the control of certain strains of LCMV [58, 59] as well as the CNS-tropic mouse hepatitis virus (JHMV) [60, 61]. In addition, studies have shown that passive administration of anti-LCMV antibodies (IgG2a isotype) can partially protect mice from the fatal choriomeningitis induced by LCMV . Collectively, these data suggest that diversification of the adaptive immune repertoire, which includes the mobilization of CD4+ T cells and B cells, is responsible for the eventual clearance of clone 13 from the CNS, and, quite possibly, the periphery. Immune cell depletion studies are currently underway to evaluate this hypothesis.
In conclusion, our studies provide the first comprehensive profile of clone 13 replication and the responding adaptive immune response in the highly specialized CNS. These studies provide a framework for understanding how a host successfully purges a persistent infection from the CNS after immune defenses are hampered for several months by an immunosuppressive milieu. Given that this scenario is the desired outcome in persistently infected humans, we propose that a detailed examination of the natural instruction provided in the clone 13 system should reveal novel therapeutic strategies to eradicate persistent viruses. Finally, it is important to note that the clone 13 model, which is widely used to study peripheral modes of immunosuppression, also provides an excellent paradigm to examine viral-immune interactions within the CNS. The reanimation phase observed late in this model should be of particular use to those intending to examine the impact of immune repertoire diversification on CNS viral persistence.
This work was by National Institutes of Health grants NS048866-01 (to D.B. McGavern), AI070967-01 (to D.B. McGavern), and MH062261-06 (pilot grant to D.B. McGavern), a grant from The Dana Foundation (to D.B. McGavern), and a grant from The Ray Thomas Edwards Foundation (to D.B. McGavern). H. Lauterbach is supported by a fellowship from Deutsche Forschungsgemeinschaft (DFG).
- van den Pol AN: Viral infections in the developing and mature brain. Trends Neurosci 2006,29(7):398-406. 10.1016/j.tins.2006.06.002PubMedView ArticleGoogle Scholar
- Doherty PC, Zinkernagel RM: T-cell-mediated immunopathology in viral infections. Transplant Rev 1974,19(0):89-120.PubMedGoogle Scholar
- McGavern DB, Homann D, Oldstone MB: T cells in the central nervous system: the delicate balance between viral clearance and disease. J Infect Dis 2002,186(Suppl 2):S145-51. 10.1086/344264PubMedView ArticleGoogle Scholar
- Kagi D, Ledermann B, Burki K, Zinkernagel RM, Hengartner H: Molecular mechanisms of lymphocyte-mediated cytotoxicity and their role in immunological protection and pathogenesis in vivo. Ann Rev Immunol 1996, 14: 207-232. 10.1146/annurev.immunol.14.1.207View ArticleGoogle Scholar
- Bechmann I, Galea I, Perry VH: What is the blood-brain barrier (not)? Trends Immunol 2007,28(1):5-11. 10.1016/j.it.2006.11.007PubMedView ArticleGoogle Scholar
- Galea I, Bechmann I, Perry VH: What is immune privilege (not)? Trends Immunol 2007,28(1):12-8. 10.1016/j.it.2006.11.004PubMedView ArticleGoogle Scholar
- Barton LL, Hyndman NJ: Lymphocytic choriomeningitis virus: reemerging central nervous system pathogen. Pediatrics 2000,105(3):E35. 10.1542/peds.105.3.e35PubMedView ArticleGoogle Scholar
- Fazakerley JK, Southern P, Bloom F, Buchmeier MJ: High resolution in situ hybridization to determine the cellular distribution of lymphocytic choriomeningitis virus RNA in the tissues of persistently infected mice: relevance to arenavirus disease and mechanisms of viral persistence. J Gen Virol 1991,72(Pt 7):1611-25.PubMedView ArticleGoogle Scholar
- Fung-Leung WP, Kundig TM, Zinkernagel RM, Mak TW: Immune response against lymphocytic choriomeningitis virus infection in mice without CD8 expression. J Exp Med 1991,174(6):1425-9. 10.1084/jem.174.6.1425PubMedView ArticleGoogle Scholar
- Ahmed R, Hahn CS, Somasundaram T, Villarete L, Matloubian M, Strauss JH: Molecular basis of organ-specific selection of viral variants during chronic infection. J Virol 1991,65(8):4242-7.PubMedPubMed CentralGoogle Scholar
- Ahmed R, Oldstone MB: Organ-specific selection of viral variants during chronic infection. J Exp Med 1988,167(5):1719-24. 10.1084/jem.167.5.1719PubMedView ArticleGoogle Scholar
- Ahmed R, Salmi A, Butler LD, Chiller JM, Oldstone MB: Selection of genetic variants of lymphocytic choriomeningitis virus in spleens of persistently infected mice. Role in suppression of cytotoxic T lymphocyte response and viral persistence. J Exp Med 1984,160(2):521-40. 10.1084/jem.160.2.521PubMedView ArticleGoogle Scholar
- Evans CF, Borrow P, de la Torre JC, Oldstone MB: Virus-induced immunosuppression: kinetic analysis of the selection of a mutation associated with viral persistence. J Virol 1994,68(11):7367-73.PubMedPubMed CentralGoogle Scholar
- Matloubian M, Kolhekar SR, Somasundaram T, Ahmed R: Molecular determinants of macrophage tropism and viral persistence: importance of single amino acid changes in the polymerase and glycoprotein of lymphocytic choriomeningitis virus. J Virol 1993,67(12):7340-9.PubMedPubMed CentralGoogle Scholar
- Sevilla N, Kunz S, Holz A, Lewicki H, Homann D, Yamada H, Campbell KP, de La Torre JC, Oldstone MB: Immunosuppression and resultant viral persistence by specific viral targeting of dendritic cells. J Exp Med 2000,192(9):1249-60. 10.1084/jem.192.9.1249PubMedPubMed CentralView ArticleGoogle Scholar
- Villarete L, Somasundaram T, Ahmed R: Tissue-mediated selection of viral variants: correlation between glycoprotein mutation and growth in neuronal cells. J Virol 1994,68(11):7490-6.PubMedPubMed CentralGoogle Scholar
- Moskophidis D, Lechner F, Pircher H, Zinkernagel RM: Virus persistence in acutely infected immunocompetent mice by exhaustion of antiviral cytotoxic effector T cells. Nature 1993,362(6422):758-61. 10.1038/362758a0PubMedView ArticleGoogle Scholar
- Zajac AJ, Blattman JN, Murali-Krishna K, Sourdive DJ, Suresh M, Altman JD, Ahmed R: Viral immune evasion due to persistence of activated T cells without effector function. J Exp Med 1998,188(12):2205-13. 10.1084/jem.188.12.2205PubMedPubMed CentralView ArticleGoogle Scholar
- Ou R, Zhou S, Huang L, Moskophidis D: Critical role for alpha/beta and gamma interferons in persistence of lymphocytic choriomeningitis virus by clonal exhaustion of cytotoxic T cells. J Virol 2001,75(18):8407-23. 10.1128/JVI.75.18.8407-8423.2001PubMedPubMed CentralView ArticleGoogle Scholar
- Wherry EJ, Blattman JN, Murali-Krishna K, van der Most R, Ahmed R: Viral persistence alters CD8 T-cell immunodominance and tissue distribution and results in distinct stages of functional impairment. J Virol 2003,77(8):4911-27. 10.1128/JVI.77.8.4911-4927.2003PubMedPubMed CentralView ArticleGoogle Scholar
- Brooks DG, Teyton L, Oldstone MB, McGavern DB: Intrinsic functional dysregulation of CD4 T cells occurs rapidly following persistent viral infection. J Virol 2005,79(16):10514-27. 10.1128/JVI.79.16.10514-10527.2005PubMedPubMed CentralView ArticleGoogle Scholar
- Salvato M, Borrow P, Shimomaye E, Oldstone MB: Molecular basis of viral persistence: a single amino acid change in the glycoprotein of lymphocytic choriomeningitis virus is associated with suppression of the antiviral cytotoxic T-lymphocyte response and establishment of persistence. J Virol 1991,65(4):1863-9.PubMedPubMed CentralGoogle Scholar
- Ahmed R, Simon RS, Matloubian M, Kolhekar SR, Southern PJ, Freedman DM: Genetic analysis of in vivo-selected viral variants causing chronic infection: importance of mutation in the L RNA segment of lymphocytic choriomeningitis virus. J Virol 1988,62(9):3301-8.PubMedPubMed CentralGoogle Scholar
- Matloubian M, Somasundaram T, Kolhekar SR, Selvakumar R, Ahmed R: Genetic basis of viral persistence: single amino acid change in the viral glycoprotein affects ability of lymphocytic choriomeningitis virus to persist in adult mice. J Exp Med 1990,172(4):1043-8. 10.1084/jem.172.4.1043PubMedView ArticleGoogle Scholar
- Ransohoff RM, KivisAkk P, Kidd G: Three or more routes for leukocyte migration into the central nervous system. Nat Rev Immunol 2003,3(7):569-81. 10.1038/nri1130PubMedView ArticleGoogle Scholar
- Walker DH, Murphy FA, Whitfield SG, Bauer SP: Lymphocytic choriomeningitis: ultrastructural pathology. Exp Mol Pathol 1975,23(2):245-65. 10.1016/0014-4800(75)90022-2PubMedView ArticleGoogle Scholar
- Dockter J, Evans CF, Tishon A, Oldstone MB: Competitive selection in vivo by a cell for one variant over another: implications for RNA virus quasispecies in vivo. J Virol 1996,70(3):1799-803.PubMedPubMed CentralGoogle Scholar
- Pircher H, Burki K, Lang R, Hengartner H, Zinkernagel RM: Tolerance induction in double specific T-cell receptor transgenic mice varies with antigen. Nature 1989,342(6249):559-61. 10.1038/342559a0PubMedView ArticleGoogle Scholar
- Zimmermann C, Pircher H: A novel approach to visualize polyclonal virus-specific CD8 T cells in vivo. J Immunol 1999,162(9):5178-5182.PubMedGoogle Scholar
- McGavern DB, Christen U, Oldstone MB: Molecular anatomy of antigen-specific CD8(+) T cell engagement and synapse formation in vivo. Nat Immunol 2002,3(10):918-25. 10.1038/ni843PubMedPubMed CentralView ArticleGoogle Scholar
- McGavern DB, Truong P: Rebuilding an immune-mediated central nervous system disease: weighing the pathogenicity of antigen-specific versus bystander T cells. J Immunol 2004,173(8):4779-90.PubMedView ArticleGoogle Scholar
- Vezys V, Masopust D, Kemball CC, Barber DL, O'Mara LA, Larsen CP, Pearson TC, Ahmed R, Lukacher AE: Continuous recruitment of naive T cells contributes to heterogeneity of antiviral CD8 T cells during persistent infection. J Exp Med 2006,203(10):2263-9. 10.1084/jem.20060995PubMedPubMed CentralView ArticleGoogle Scholar
- Blattman JN, Antia R, Sourdive DJ, Wang X, Kaech SM, Murali-Krishna K, Altman JD, Ahmed R: Estimating the precursor frequency of naive antigen-specific CD8 T cells. J Exp Med 2002,195(5):657-64. 10.1084/jem.20001021PubMedPubMed CentralView ArticleGoogle Scholar
- Hawke S, Stevenson PG, Freeman S, Bangham CR: Long-term persistence of activated cytotoxic T lymphocytes after viral infection of the central nervous system. J Exp Med 1998,187(10):1575-82. 10.1084/jem.187.10.1575PubMedPubMed CentralView ArticleGoogle Scholar
- van der Most RG, Murali-Krishna K, Ahmed R: Prolonged presence of effector-memory CD8 T cells in the central nervous system after dengue virus encephalitis. Int Immunol 2003,15(1):119-25. 10.1093/intimm/dxg009PubMedView ArticleGoogle Scholar
- Fuller MJ, Khanolkar A, Tebo AE, Zajac AJ: Maintenance, loss, and resurgence of T cell responses during acute, protracted, and chronic viral infections. J Immunol 2004,172(7):4204-14.PubMedView ArticleGoogle Scholar
- Homann D, Teyton L, Oldstone MB: Differential regulation of antiviral T-cell immunity results in stable CD8+ but declining CD4+ T-cell memory. Nat Med 2001,7(8):913-9. 10.1038/90950PubMedView ArticleGoogle Scholar
- Barber DL, Wherry EJ, Masopust D, Zhu B, Allison JP, Sharpe AH, Freeman GJ, Ahmed R: Restoring function in exhausted CD8 T cells during chronic viral infection. Nature 2006,439(7077):682-7. 10.1038/nature04444PubMedView ArticleGoogle Scholar
- Brooks DG, Trifilo MJ, Edelmann KH, Teyton L, McGavern DB, Oldstone MB: Interleukin-10 determines viral clearance or persistence in vivo. Nat Med 2006,12(11):1301-9. 10.1038/nm1492PubMedPubMed CentralView ArticleGoogle Scholar
- Day CL, Kaufmann DE, Kiepiela P, Brown JA, Moodley ES, Reddy S, Mackey EW, Miller JD, Leslie AJ, DePierres C, Mncube Z, Duraiswamy J, Zhu B, Eichbaum Q, Altfeld M, Wherry EJ, Coovadia HM, Goulder PJ, Klenerman P, Ahmed R, Freeman GJ, Walker BD: PD-1 expression on HIV-specific T cells is associated with T-cell exhaustion and disease progression. Nature 2006,443(7109):350-4. 10.1038/nature05115PubMedView ArticleGoogle Scholar
- Petrovas C, Casazza JP, Brenchley JM, Price DA, Gostick E, Adams WC, Precopio ML, Schacker T, Roederer M, Douek DC, Koup RA: PD-1 is a regulator of virus-specific CD8+ T cell survival in HIV infection. J Exp Med 2006,203(10):2281-92. 10.1084/jem.20061496PubMedPubMed CentralView ArticleGoogle Scholar
- Trautmann L, Janbazian L, Chomont N, Said EA, Gimmig S, Bessette B, Boulassel MR, Delwart E, Sepulveda H, Balderas RS, Routy JP, Haddad EK, Sekaly RP: Upregulation of PD-1 expression on HIV-specific CD8+ T cells leads to reversible immune dysfunction. Nat Med 2006,12(10):1198-202. 10.1038/nm1482PubMedView ArticleGoogle Scholar
- Wherry EJ, Barber DL, Kaech SM, Blattman JN, Ahmed R: Antigen-independent memory CD8 T cells do not develop during chronic viral infection. Proc Natl Acad Sci USA 2004,101(45):16004-9. 10.1073/pnas.0407192101PubMedPubMed CentralView ArticleGoogle Scholar
- Abbott NJ, Ronnback L, Hansson E: Astrocyte-endothelial interactions at the blood-brain barrier. Nat Rev Neurosci 2006,7(1):41-53. 10.1038/nrn1824PubMedView ArticleGoogle Scholar
- Cao W, Henry MD, Borrow P, Yamada H, Elder JH, Ravkov EV, Nichol ST, Compans RW, Campbell KP, Oldstone MB: Identification of alpha-dystroglycan as a receptor for lymphocytic choriomeningitis virus and Lassa fever virus. Science 1998,282(5396):2079-81. 10.1126/science.282.5396.2079PubMedView ArticleGoogle Scholar
- Sixt M, Engelhardt B, Pausch F, Hallmann R, Wendler O, Sorokin LM: Endothelial cell laminin isoforms, laminins 8 and 10, play decisive roles in T cell recruitment across the blood-brain barrier in experimental autoimmune encephalomyelitis. J Cell Biol 2001,153(5):933-46. 10.1083/jcb.153.5.933PubMedPubMed CentralView ArticleGoogle Scholar
- Tian M, Jacobson C, Gee SH, Campbell KP, Carbonetto S, Jucker M: Dystroglycan in the cerebellum is a laminin alpha 2-chain binding protein at the glial-vascular interface and is expressed in Purkinje cells. Eur J Neurosci 1996,8(12):2739-47. 10.1111/j.1460-9568.1996.tb01568.xPubMedView ArticleGoogle Scholar
- Zaccaria ML, Di Tommaso F, Brancaccio A, Paggi P, Petrucci TC: Dystroglycan distribution in adult mouse brain: a light and electron microscopy study. Neuroscience 2001,104(2):311-24. 10.1016/S0306-4522(01)00092-6PubMedView ArticleGoogle Scholar
- Bonthius DJ, Mahoney J, Buchmeier MJ, Karacay B, Taggard D: Critical role for glial cells in the propagation and spread of lymphocytic choriomeningitis virus in the developing rat brain. J Virol 2002,76(13):6618-35. 10.1128/JVI.76.13.6618-6635.2002PubMedPubMed CentralView ArticleGoogle Scholar
- Miletic H, Fischer YH, Neumann H, Hans V, Stenzel W, Giroglou T, Hermann M, Deckert M, Von Laer D: Selective transduction of malignant glioma by lentiviral vectors pseudotyped with lymphocytic choriomeningitis virus glycoproteins. Hum Gene Ther 2004,15(11):1091-100. 10.1089/hum.2004.15.1091PubMedView ArticleGoogle Scholar
- Oldstone MB: Immunotherapy for virus infection. Curr Top Microbiol Immunol 1987, 134: 211-29.PubMedGoogle Scholar
- Oldstone MB, Blount P, Southern PJ, Lampert PW: Cytoimmunotherapy for persistent virus infection reveals a unique clearance pattern from the central nervous system. Nature 1986,321(6067):239-43. 10.1038/321239a0PubMedView ArticleGoogle Scholar
- Lauterbach H, Zuniga EI, Truong P, Oldstone MB, McGavern DB: Adoptive immunotherapy induces CNS dendritic cell recruitment and antigen presentation during clearance of a persistent viral infection. J Exp Med 2006,203(8):1963-75. 10.1084/jem.20060039PubMedPubMed CentralView ArticleGoogle Scholar
- Stein CS, Martins I, Davidson BL: The lymphocytic choriomeningitis virus envelope glycoprotein targets lentiviral gene transfer vector to neural progenitors in the murine brain. Mol Ther 2005,11(3):382-9. 10.1016/j.ymthe.2004.11.008PubMedView ArticleGoogle Scholar
- Doetsch F, Caille I, Lim DA, Garcia-Verdugo JM, Alvarez-Buylla A: Subventricular zone astrocytes are neural stem cells in the adult mammalian brain. Cell 1999,97(6):703-16. 10.1016/S0092-8674(00)80783-7PubMedView ArticleGoogle Scholar
- Doetsch F: The glial identity of neural stem cells. Nat Neurosci 2003,6(11):1127-34. 10.1038/nn1144PubMedView ArticleGoogle Scholar
- Doetsch F, Scharff C: Challenges for brain repair: insights from adult neurogenesis in birds and mammals. Brain Behav Evol 2001,58(5):306-22. 10.1159/000057572PubMedView ArticleGoogle Scholar
- Hunziker L, Klenerman P, Zinkernagel RM, Ehl S: Exhaustion of cytotoxic T cells during adoptive immunotherapy of virus carrier mice can be prevented by B cells or CD4+ T cells. Eur J Immunol 2002,32(2):374-82. 10.1002/1521-4141(200202)32:2<374::AID-IMMU374>3.0.CO;2-9PubMedView ArticleGoogle Scholar
- Planz O, Ehl S, Furrer E, Horvath E, Brundler MA, Hengartner H, Zinkernagel RM: A critical role for neutralizing-antibody-producing B cells, CD4(+) T cells, and interferons in persistent and acute infections of mice with lymphocytic choriomeningitis virus: implications for adoptive immunotherapy of virus carriers. Proc Natl Acad Sci USA 1997,94(13):6874-9. 10.1073/pnas.94.13.6874PubMedPubMed CentralView ArticleGoogle Scholar
- Ramakrishna C, Bergmann CC, Atkinson R, Stohlman SA: Control of central nervous system viral persistence by neutralizing antibody. J Virol 2003,77(8):4670-8. 10.1128/JVI.77.8.4670-4678.2003PubMedPubMed CentralView ArticleGoogle Scholar
- Ramakrishna C, Stohlman SA, Atkinson RD, Shlomchik MJ, Bergmann CC: Mechanisms of central nervous system viral persistence: the critical role of antibody and B cells. J Immunol 2002,168(3):1204-11.PubMedView ArticleGoogle Scholar
- Baldridge JR, Buchmeier MJ: Mechanisms of antibody-mediated protection against lymphocytic choriomeningitis virus infection: mother-to-baby transfer of humoral protection. J Virol 1992,66(7):4252-7.PubMedPubMed CentralGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.