Identification and classification of human cytomegalovirus capsids in textured electron micrographs using deformed template matching
 Martin Ryner^{1, 2},
 JanOlov Strömberg^{2},
 Cecilia SöderbergNauclér^{1} and
 Mohammed HommanLoudiyi^{1}Email author
DOI: 10.1186/1743422X357
© Ryner et al; licensee BioMed Central Ltd. 2006
Received: 03 May 2006
Accepted: 18 August 2006
Published: 18 August 2006
Abstract
Background
Characterization of the structural morphology of virus particles in electron micrographs is a complex task, but desirable in connection with investigation of the maturation process and detection of changes in viral particle morphology in response to the effect of a mutation or antiviral drugs being applied. Therefore, we have here developed a procedure for describing and classifying virus particle forms in electron micrographs, based on determination of the invariant characteristics of the projection of a given virus structure. The template for the virus particle is created on the basis of information obtained from a small training set of electron micrographs and is then employed to classify and quantify similar structures of interest in an unlimited number of electron micrographs by a process of correlation.
Results
Practical application of the method is demonstrated by the ability to locate three diverse classes of virus particles in transmission electron micrographs of fibroblasts infected with human cytomegalovirus. These results show that fast screening of the total number of viral structures at different stages of maturation in a large set of electron micrographs, a task that is otherwise both timeconsuming and tedious for the expert, can be accomplished rapidly and reliably with our automated procedure. Using linear deformation analysis, this novel algorithm described here can handle capsid variations such as ellipticity and furthermore allows evaluation of properties such as the size and orientation of a virus particle.
Conclusion
Our methodological procedure represents a promising objective tool for comparative studies of the intracellular assembly processes of virus particles using electron microscopy in combination with our digitized image analysis tool. An automated method for sorting and classifying virus particles at different stages of maturation will enable us to quantify virus production in all stages of the virus maturation process, not only count the number of infectious particles released from un infected cell.
Background
Virus assembly is an intricate process and a subject of intensive research[1]. Viruses utilize a host cell to produce their progeny virus particles by undergoing a complex process of maturation and intracellular transport. This process can be monitored at high magnification and resolution utilizing electron microscopy, which allows visual identification of different types of virus particles in different cellular compartments. Important issues that remain to be resolved include the identity of the viral proteins that are involved in each step of this virus assembly process, as well as the mechanism of the underlying intracellular translocation. Localization of different types of virus particles during virus maturation is currently made by hand. Structural aspects of the virus maturation are generally hard to address although visualisation techniques such as tomography and cryoElectron Microscopy (cryoEM) have contributed tremendously to the vast information on virus structures. These techniques provide information on stable, often mature virus particles. Genetic tools are available to produce mutants of key viral protein components, and the structural effects can be visualized by electron microscopy (EM). However there is a lack of proper tools to characterize the structural effects, especially intermediate and obscure particle forms and to quantify virus particles properly in an objective way. Image analysis tools to characterize and quantify virus particle maturation and intracellular transport would facilitate objective studies of different virus assembly states employing electron microscopy. A lot of information is acquired when studying virus production by EM, but the data need to be summarized and statistics produced from it in order to evaluate the structural effects and be able to draw conclusions from the study. Extraction of data from images by image analysis will be a valuable tool in virus assembly studies.
Here we describe development of an automated system to assist in the identification of virus particles in electron micrographs. As a model, we have used fibroblasts infected with human cytomegalovirus (HCMV), a virus of the βherpes class. During infection with human cytomegalovirus, many different intermediate forms of the virus particle are produced[2]. During assembly of the herpesvirus, the host cell is forced to make copies of the viral genetic material and to produce capsids, a shell of viral proteins, which encase and protect the genetic material. Capsids are spherical structures that can vary with respect to size and symmetry and may, when mature be enveloped by a bilayer membrane. The maturation of virus capsids is an important stage in virus particle production, and one that is frequently studied. However, their appearance in electron micrographs varies considerably; making analysis of the virus assembly a challenge. A unique feature of herpesviruses is the tegument, a layer of viral proteins that surround the capsid prior to final envelopment. The envelope is acquired by budding of tegumented capsids into secretory vesicles in the cytoplasm [3]. Thereafter, infectious virus particles exit the host cell by fusion of these virus containing vesicles with the plasma membrane.
Results
Experimental setup
The standardization and testing were carried out on separate sets of images, two for training and 12 for testing. The number of samples used for standardization was 4, 7 and 10 for the A, B, and C test functions, respectively. The test images contained a total of 53 A capsids (14%), 239 B capsids (64%) and 83 C capsids (22%), and the boundaries of deformation were set at (φ_{ R }, $\overline{r}$, d, φ_{ D }) ∈ ([0,2π], [0.83,1.2], [0.83,1.2], [0,2π]).
The false negative and false positive ratios
Quantification of structures in electron micrographs
Discussion
During the development of this method, several mathematical aspects were examined in more detail. Singular value decomposition (SVD) adds orthogonal dimensions to the test function used here, but resulted in additional information leading to improved segmentation. Use of the actual pixel values at each point of the support can be extended to localized functions, which opens the way for multiresolution analysis involving wavelets[8] in a sparse and deformable manner. This possibility was explored with the generic Haar wavelet and Daubechies orthogonal wavelets of length 4, 6, and 8. However, since the images employed contain spurious structures at stochastic positions and of various sizes, the use of wavelets did not result in improvement either.
Our procedure described here opens the way for nonuniform deformations, such as independent translation of the points associated with the DNA core inside the capsid. Due to the large computational costs involved, this approach was not tested here, but it could represent an improvement. Methods of deformation analysis that do not employ nonlinear programming techniques would be of interest to evaluate in this context. Continuous amplification and suppression of invariant and variant parameters could also be substituted for truncation, thereby allowing weighting of the norms and inner products.
Conclusion
Monitoring the incell structural morphology of virus assembly helps the virologist find novel insights on how to combat the virus infection and develop antiviral strategies. When investigating the process of virus assembly information concerning the structural topology in relationship to the stage of maturation is usually not available or vaguely defined. For this purpose, we have developed a method for the benefit of electron microscopy users, to help gather and quantify structural information on virus assembly from textured electron micrographs. An effective algorithm, as described in this article, has been developed for recognizing profiles of virus particles. Once a few starting points have been obtained by classifying a set of obvious structures, these can be used to expand the set of classified structures by identifying similar structures with the matching function employed. This approach helps make the mapping of virus maturation in electron micrographs rapid, objective, reliable and easy to describe. In this article we describe the method and give an example of how deformable templates can be made and used for matching in micrographs to quantify the existence of intracellular virus particles.
Methods
Cell cultures
Human embryonic lung fibroblasts (HF) were maintained in bicarbonatefree minimal essential medium with Hank's salts (GIBCO BRL) supplemented with 25 mM HEPES [4(2 hydroxyethyl)1piperazine ethanesulfonic acid], 10% heatinactivated fetal calf serum, Lglutamine (2 mM), penicillin (100 U/ml) and streptomycin (100 mg/ml) (GIBCO BRL, Grand Island, NY, USA). The cells were cultured in 175 cm^{2} tissue culture flasks (Corning, New York, USA) for a maximum of 17 passages.
Viral infection
The HF cells were infected with HCMV strain AD169 employing a multiplicity of infection (MOI) of 1. The virus containing supernatants were collected 7 or 10 days postinfection (dpi), cleared of cell debris by lowspeed centrifugation and frozen at 70°C until used for inoculation.
Electron microscopy
In order to examine virusinfected cells by electron microscopy, uninfected and HCMVinfected cells were harvested at 1, 3, 5, and 7 dpi and thereafter fixed in 2% glutaraldehyde in 0.1 M sodium cacodylate buffer containing 0.1 M sucrose and 3 mM CaCl_{2}, pH 7.4 at room temperature for 30 min. The cells were then scraped off with a wooden stick and transferred to an Eppendorftube for continued fixation overnight at 4°C. Following this procedure the cells were rinsed in 0.15 M sodium cacodylate buffer containing 3 mM CaCl_{2}, pH 7.4 and pelleted by centrifugation. These pellets were then postfixed in 2% osmium tetroxide dissolved in 0.07 M sodium cacodylate buffer containing 1.5 mM CaCl_{2}, pH 7.4, at 4°C for 2 hours; dehydrated sequentially in ethanol and acetone; and embedded in LX112 (Ladd, Burlington, VT, USA). Contrast on the sections was obtained by uranyl acetate followed by lead citrate and examination performed in a Philips 420 or a Tecnai 10 (FEI Company, Oregon, USA.) transmission electron microscope at 80 kV.
Image acquisition, discretization and analysis
Electron micrographs of HCMVinfected HF cells were digitalized employing an 8bit gray scale at a resolution of 5.5 nm/pixel in a HP Scanjet 3970. The implementation was performed with Matlab 7.0.1 (The Mathworks Inc., Natick, MA, USA) and Sun Java 1.4.2 software on a Dell Optiplex GX260 personal computer. This analysis involved an easytouse graphical interface and automation of the parameters described below for rapid and convenient use.
Mathematical outline
Our aim was to develop a user friendly and reliable tool for studies of intracellular virus assembly. Our approach was based on finding a compact set of points in R^{2}, the field of the micrograph, for each of which a point has a corresponding function value. This set of points and their function values are collectively referred to as a test function or template and can be described by a sequence {(x_{ k }, c_{ k })}_{ k }where x is the point and c is the function value. The test function is produced in such a fashion that the sequence of function value is correlated to the values on the gray scale of the corresponding points. Accordingly, a defined set of virus particles of the same type is required in order to train and design the sequence to provide a template for this specific particle structure. This sparse representation allows facile deformation and adjustments of the template to individual virus particles whose shape in the micrograph is moreorless elliptical.
Deformation preprocessing
The positions of the substructures within the same type of viral particles vary in the different images, i.e., the virus particles are sometimes deformed in such manner as to appear in different elliptical forms. In order to create the test functions we utilized linear vector spaces [4], which demands that the vector space positions analyzed are relatively fixed. Uniform linear transformation was chosen to approximate the deformations, since it covers the most prominent deformations seen in micrographs. The computational cost of these calculations is fairly low and simplifies the management of boundaries. This approach requires the use of a 4dimensional transformation operator, i.e., a 2 × 2 matrix. These variables involved can be expressed as the rotation of the structure prior to deformation (ϕ_{ R }), the primary radial deformation ($\overline{r}$), the rate of the deformation giving rise to the elliptical structure (d) and the rotation following the deformation (ϕ_{ D }). Together these form the transformation shown below:
$T={R}_{D}D{R}_{R}=\left(\begin{array}{cc}\mathrm{cos}{\varphi}_{D}& \mathrm{sin}{\varphi}_{D}\\ \mathrm{sin}{\varphi}_{D}& \mathrm{cos}{\varphi}_{D}\end{array}\right)\left(\begin{array}{cc}\overline{r}d& 0\\ 0& \overline{r}/d\end{array}\right)\left(\begin{array}{cc}\mathrm{cos}{\varphi}_{R}& \mathrm{sin}{\varphi}_{R}\\ \mathrm{sin}{\varphi}_{R}& \mathrm{cos}{\varphi}_{R}\end{array}\right)\left(\text{eq}\text{.1}\right)$
f(x, y) = f(x, y)(1  x_{ m })(1  y_{ m }) + f($\overline{x}$, y)x_{ m }(1  y_{ m }) + f(x, $\overline{y}$)(1  x_{ m })y_{ m }+ f($\overline{x}$, $\overline{y}$)x_{ m }y_{ m }
where x is the nearest smaller integer value of x, $\overline{x}$ is the closest higher integer value and x_{ m }= x  x. Integration was performed using the same interpolation. The measurements obtained from this processing step provide indications of the range of the deformation properties, i.e., the main radii (primary radius) and deformation rate, but these parameters should be determined on the basis of additional experience. Since all types of rotation and all directions of deformation of the viral structures are expected to be present in the electron micrographs, these variables were not fixed.
Identification of points and local function values (parameters) for the virus particle templates
Once the deformed samples are aligned with the partial structure at the same positions, this approach can be used to find the values of the invariant function. In order to describe this procedure more clearly, a deformed sample f can be converted into a graph of this function by enumerating (list individually) the pixel positions x and their corresponding function values c as f = {(x_{ k }, c_{ k })}_{ k }. The degree of matching between two sequences of function values y_{ i }and y_{ j }(referred to below as vectors) containing the same sequence of pixel positions was determined using the standard estimated statistical correlation:
$M({y}_{i},{y}_{j})=\frac{\u3008{y}_{i}{\overline{y}}_{i},{y}_{j}{\overline{y}}_{j}\u3009}{\Vert {y}_{i}{\overline{y}}_{i}\Vert \Vert {y}_{j}{\overline{y}}_{j}\Vert}\left(\text{eq}\text{.2a}\right)$
Where $\overline{y}$ is the mean value of the vector and the matching of all coefficients to [1,1] is mapped. The justification for using this approach is that it indicates the degree of similarity between the two structures. After placing the sample vectors normalized around their mean ${\widehat{y}}_{i}=\frac{{y}_{i}{\overline{y}}_{i}}{\Vert {y}_{i}{\overline{y}}_{i}\Vert}$ into columns in a matrix A, the test function sequence f_{ C }(f_{ C } = 1) that makes A^{ T }f_{ C } as large as possible is determined, thus providing the best match to the samples used for training. Singular value decomposition (SVD) [10] A^{ T }f_{ C } = V ΣU^{ T }f_{ C } = (V is square and orthonormal) = ΣU^{ T }f_{ C } = Σw is applied to A where w = 1 if f_{ C }∈ span(U) which would be expected. This last expression is maximal when w is the eigenvector corresponding to the largest eigenvalue of Σ (which is the largest singular value) and f_{ C }should thus be the corresponding column of U. Since this function is a linear combination of the columns in A, the matching (eq. 2a) reduces to
$M({f}_{C},y)=\frac{\u3008{f}_{C},y\u3009}{\Vert y\overline{y}\Vert}\left(\text{eq}\text{.2b}\right)$
The test function in this initial SVD utilizes the coefficients of all points associated with the first support assumed. Some of these points are located somewhat outside of the viral structures in the images, and in addition, there are points in the structures whose coefficients can vary considerably. Thus, in order to rank the significance of each coefficient and thereby eliminate the worst of the variance, the value of
$VA{R}_{j}={\displaystyle \sum _{n=\mathrm{1..}N}{\left({\left[{\widehat{y}}_{n}\u3008{f}_{C},{\widehat{y}}_{n}\u3009{f}_{C}\right]}_{j}\right)}^{2}}$
was calculated for each coefficient. A certain percentage of the points could then be retained in the test function. Since these operations change on the basis of the test function, a new SVD was subsequently calculated. Figure 8 illustrates the test functions obtained using all coefficients or only those 80% of the varying coefficients identified exhibiting least variance according to the variance ranking. Clearly the size of the DNA core varies in the test function for the C capsid and hence the most uncertain points have been eliminated in the right hand image. Accordingly the test functions obtained by reducing the number of coefficients in this manner were employed routinely.
Synthesis of the deformations
Since the structures analyzed were assumed to be both oriented in any direction and linearly deformed in any direction, these features must be automatically applied to the test function when analyzing an image. The information provided by the behavior of the matching function when deforming the test function is also of interest for and has been exploited in a similar situation described by Berger et al[11]. While maintaining image B and the test function f_{ C }fixed and varying the deformation T, analysis of the matching function g(T) = M (f_{ C }, {B (Tx_{ k })}_{ k }) (where the sequence {x_{ k }}_{ k }is obtained from the production of the test functions performed. In order to describe T in terms of the parameters (φ_{ R }, $\overline{r}$, d, φ_{ D }) ∈ ([0,2π], [$\overline{r}$_{0}, $\overline{r}$_{1}], [d_{0}, d_{1}], [0,2π]) = T_{ bound }, the following assumptions are made:
(i) For certain T ∈ T_{ bound }, the deformed test function represents the structure most similar to the object in the image. It is assumed that this T is the one that maximizes g.
(ii) The T associated with the maximal deformation should be localized within the interior of the deformation set, and not on the boundary. Under these conditions, even if g is maximized outside the set (i.e. the structure is too large, too small or too badly deformed), matching with the nearest boundary points could still be high.
To be considered identified, a structure should match these criteria. Maximization of the matching function was performed with a reversed steepest descent scheme[12], using the nondeformed test function as a starting point and approximating the derivative as an eightpoint, centered difference scheme (i.e. two points for each variable in the deformation).
Viral capsids exit the nucleus by budding through the membrane of this organelle. In connection with this process it is difficult to discriminate between viral and other structures, as shown in Figure 10. In this figure a blue cross indicates a point in the image where the match between the test function and the capsid structure match is better than 0.8 and the degree of deformation is acceptable. A red circle indicates a point at which this match is better than 0.8, but where the degree of deformation is not admissible. The structure marked as a match has a matching of 0.94, which is very high.
Identification of virus particle structures in an electron microscopic image
In order to search for structures in an image B similar to the test function f_{ C }, eq 2b is expanded to convolutions. The matching of the test function at a point m can thus be expressed as
${M}_{B,{f}_{C}}(m)=\underset{T\in {T}_{bound}}{\mathrm{sup}}M({f}_{C},{\{B(m+T{x}_{k})\}}_{k})$
However, this procedure is highly timeconsuming. It can be accelerated by making a few observations and assumptions:
(i) The deformed variants of the test functions are not orthogonal to one another, and because these structures are essentially independent of rotation, the match of the nondeformed test function is better than that of a certain value to any admissible deformed structure of the same kind.
(ii) Since translation deforms a structure further, matching to the nondeformed test function is assumed to be higher at the actual position of a virus particle than at locations at least one diameter of the test function distant from this position.
Implementing these criteria, one can identify a subset of potentially interesting points within the larger image. Thereafter further analysis of this set employing the optimization described in the preceding section can be performed. This approach provides a final set of points in the image that are associated with matching values of P = {M_{ j }}_{ j }. In order to ensure inclusion of all interesting positions in an image the threshold value connected with assumption (i) above was set to 0.5.
Postprocessing of the final set: counting virus particles
There is no threshold value t that can distinguish between authentic and false structures in all images, i.e., the assignment of structures employing this procedure does not agree completely with that done by an experienced virologist. Setting a threshold level is therefore not an option. Instead, a positive probability function PPF : [1,1] → [0,1] can be used to determine the probability that a given point associated with a certain matching value is actually associated with the virus particle. This extension of the positive predictive value (PPV) is obtained by calculating the ratio between the number of correctly identified structures and the total number of structures identified with a certain matching value. Thus, for a set P of structures identified by this procedure containing the subset P_{ correct }of points associated with virus particles of a given kind,
$PPF(M)=\frac{\#\{{M}_{k}\in {P}_{correct};M\le {M}_{k}<M+\epsilon \}}{\#\{{M}_{k}\in P;M\le {M}_{k}<M+\epsilon \}}.$
In order to obtain a smooth and monotonically increasing function 0.05 was chosen as the value for ε. The probability function indicating the expected number N of structures in the image is $E(N)={\displaystyle \sum _{M\in P}PPF(M)}$.
Accuracy of the method
In order to organize viral particles seen in electron micrographs according to their stage of maturation, a model such as that described here, is required to portray each particular stage. Furthermore, for this model to be useful for the detection and quantization of virus particles in such images it must also be able to reject spurious structures. Thus, an ideal model should detect all possible images of virus particles of different kinds, but nothing else located in the same space, i.e., in the background. In order to characterize our model in this respect the commonly false negative (FNR) and false positive (FPR) ratios were utilized. The FNR is defined as the ratio between the number of authentic virus particles rejected incorrectly by the method and the actual number of authentic particles, while The FPR is the ratio between the number of spurious structures identified as being authentic and the total number of structures considered to be authentic by this approach. Thus, both of these ratios lie between 0 and 1, with 0 being ideal.
In order to determine the number of virus particles on the basis of the information provided by the set of matching values acquired by searching through an image, the positive probability function PPF described under the Materials and Methods section was utilized. The expected number of particles identified was compared with the true number of particles present in the image to obtain a mean and standard deviation of the counting error. In addition, to evaluate whether there was a systematic mean difference, i.e., whether the procedure identifies on the average too many or too few particle, the H_{0} hypothesis that: "The mean difference = 0" was tested.
Abbreviations
 FNR:

FNR – false negative ratio
 FPR:

FPR – false positive ratio
 HCMV:

HCMV – Human Cytomegalovirus
 PPF:

PPF – positive probability function
 PPV:

PPV – positive predictive value
 SVD:

SVD – Singular value decomposition
Declarations
Acknowledgements
This work was supported by grants from Vironova AB, ALMI Företagspartner AB, the Swedish Agency for Innovation Systems, Traction Foundation for Science and Innovation, Brita and Otto Larsson Commemoration Fund and the Swedish Research Council (K200416X1261507A.VR. We thank Janet Holmen and Joe DePierre for carefully editing the text. The authors thank Professor Erna Möller for feedback and encouragement during the method development process.
Authors’ Affiliations
References
 Mettenleiter TC: Herpesvirus assembly and egress. J Virol 2002, 76: 15371547. 10.1128/JVI.76.4.15371547.2002PubMed CentralView ArticlePubMedGoogle Scholar
 Landolfo S, Gariglio M, Gribaudo G, Lembo D: The human cytomegalovirus. Pharmacol Ther 2003, 98: 269297. 10.1016/S01637258(03)000342View ArticlePubMedGoogle Scholar
 HommanLoudiyi M, Hultenby K, Britt W, SoderbergNaucler C: Envelopment of human cytomegalovirus occurs by budding into Golgiderived vacuole compartments positive for gB, Rab 3, transgolgi network 46, and mannosidase II. [erratum appears in J Virol. Arch. 2003 Jul;77(14):8179]. Journal of Virology 2003, 77: 31913203. 10.1128/JVI.77.5.31913203.2003PubMed CentralView ArticlePubMedGoogle Scholar
 Sintorn IM, HommanLoudiyi M, SoderbergNaucler C, Borgefors G: A refined circular template matching method for classification of human cytomegalovirus capsids in TEM images. Comput Methods Programs Biomed 2004, 76: 95102. 10.1016/j.cmpb.2004.03.006View ArticlePubMedGoogle Scholar
 Zhu Y, Carragher B, Glaeser RM, Fellmann D, Bajaj C, Bern M, Mouche F, de Haas F, Hall RJ, Kriegman DJ, et al.: Automatic particle selection: results of a comparative study. J Struct Biol 2004, 145: 314. 10.1016/j.jsb.2003.09.033View ArticlePubMedGoogle Scholar
 Roseman AM: FindEM – a fast, efficient program for automatic selection of particles from electron micrographs. J Struct Biol 2004, 145: 9199. 10.1016/j.jsb.2003.11.007View ArticlePubMedGoogle Scholar
 Yu Z, Bajaj C: Detecting circular and rectangular particles based on geometric feature detection in electron micrographs. J Struct Biol 2004, 145: 168180. 10.1016/j.jsb.2003.10.027View ArticlePubMedGoogle Scholar
 Daubechies I: Ten lectures on wavelets. Philadelphia: Society for Industrial and Applied Mathematics; 1992.View ArticleGoogle Scholar
 Friedman A: Foundations of modern analysis. New York: Dover; 1982.Google Scholar
 Nicholson WK: Elementary linear algebra. 1st edition. Toronto: McGrawHill Ryerson; 2001.Google Scholar
 Berger T, Strömberg JO, Olsen JB: Detection of Microcalcifications in Mammograms. The Wavelet Transform: Numerical Algorithms and Applications to Object Detection and Image Restoration. Thesis by Tor Berger 1996.Google Scholar
 Nash SG, Sofer A: Linear and nonlinear programming. New York: McGrawHill; 1996.Google Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.