Determinación de parámetros para amplificación de imágenes mediante interpolación de pulsos
Morera-Delfín Leandro
Telecommunications' Department, Electrical Engineering Faculty, Higher Polytechnic Institute Jose Antonio Echeverria. E-mail: leandro@electrica.cujae.edu.cu.
Information on the article: received: June 2013 ]]>
Reevaluated: June, August, and September 2013
Accepted: January 2014
Abstract
This paper presents the implementation of a method for image samples interpolation based on a physical scanning model. It uses the theory to take digital image samples and to perform an implementation of such mechanism through software. This allows us to get the appropriate parameters for the images amplification using a truncated sampler arrangement. The shown process copies the physical model of image acquisition in order to incorporate the required samples for the amplification. This process is useful in the reconstruction of details in low resolution images and for images compression. The proposed method studies the conservation of high frequency in the high resolution plane for the generation of the amplification kernel. A new way of direct application of the physical model for scanning images in analytic mode is presented.
Key words: interpolation, image reconstruction, expansion, sampling, scanning.
Resumen
Este trabajo muestra la aplicación de un método para la interpolación de muestras sobre una imagen basado en un modelo físico de digitalización de las mismas. Se utiliza la fundamentación teórica de muestreo de la imagen digital y se realiza una implementación de dicho mecanismo a través de un software. Esto permite obtener los parámetros adecuados para amplificar las imágenes utilizando el arreglo de muestreo truncado. Se imita el procedimiento físico de obtención de la imagen y se incorporan las muestras requeridas para la amplificación. Este proceso es útil en la reconstrucción de detalles de imágenes de baja resolución y para la compresión de las mismas. El método propuesto estudia la conservación de las altas frecuencias en el plano de mayor resolución para la generación del núcleo de amplificación y presenta una nueva forma de aplicar directamente el modelo físico de escaneo de la imagen en modo analítico.
Descriptores: interpolación, reconstrucción de imágenes, ampliación, muestreo, digitalización.
]]>Introduction
This paper proposes a method for the construction of a pulse interpolation filter with maximum response amplitude at high spatial frequencies. This allows a better reconstruction of the details including the use of the characteristics of this type of amplification in order to achieve linear phase response in the edge transitions of the high resolution image. The preservation of edge information in an accurate frequency range gives a harmonious visual effect to the image and prevents the formation of blocks. This type of filter is used in the amplification, image reconstruction and simultaneously facilitates the compression process.
In some applications, as an imaging amplifier for Space-Multiplexed Optical Transmission (Ozdur et al., 2012) it is necessary to focus/collimate the light beam to the center of the bulk amplifier from the imaging systems (IS 1 and IS 2) of Figure 1 and then to couple back to the output fiber. The amplification effect of the bulk could be seeing as the electrical output of a more dense and sensible photo detector zone integrated over a period of time. During this period the light beam activates the resolution cells, and then the simulation of a photo detector sampling zone is useful to simulate the amplification effects.
The medical-image analysis requires an understanding of sophisticated scanning modalities, constructing geometric models, building meshes to represent domains, and downstreaming biological applications. These four steps form an image-to-mesh pipeline (Levine et al., 2012).
The proposed method could be used as an edge-preserving interpolation method after the denoise process for noisy images. In some cases the image is first decomposed using the bilateral filter into the detail and base layers which represent the small and large scale features, respectively. The detail layer is adaptively smoothed to suppress the noise before interpolation and an edge-preserving interpolation method is applied to both layers, it is effective to employ denoising prior to the interpolation (Jong et al., 2010).
Some methods of interpolation, like the curvature interpolation method (CIM), study the edge composition of the low resolution image to interpolate the curvature to the high-resolution image domain. The CIM constructs the high-resolution image by solving a linearized curvature equation, incorporating the interpolated curvature as an explicit driving force (Hakran et al., 2011). Other regression-based image interpolation algorithms have been proposed in the literature, in which the objective functions are optimized by ordinary least squares (OLS). However, it has been shown that interpolation with OLS may have some undesirable properties from a robustness point of view: even small amounts of atypical values can dramatically affect the estimates (Liu et al., 2011).
This investigation tries to find the limits of quality in the high resolution image. The curvature content in the high-resolution image domain is studied using classical theory resources. A restricted interpolation system is made with spatial and window filters in order to increase the high frequency content. The proposed method constructs an interpolation kernel using the high frequency content at high-resolution image domain as an explicit driving force for the variation of the amplification kernel parameters. With this process, the optimal low-high resolution pair is found using the amplification kernel given by the Fourier transform of the truncated sampling arrangement (Papoulis, 1966). In the process filters as Butterworth (Pratt, 2001) and Canny (1986) are used in order to guide the construction of the interpolation kernel and to raise the high frequency content in the high resolution image.
]]>Image sampling system
In a physical image sampling system the sampling arrangement should be of finite extent. The sampling pulses are of finite width and the image can be sub sampled with spectral overlap. Because of these, spurious spatial frequency components will be introduced into the reconstruction. This effect is called aliasing error(Brown, 1969; Helms and Thomas, 1962) and therefore it is necessary to explore the consequences of the non-ideal sampling.
In the example of Figure 2, a thin beam of light goes through a photographic transparency of an ideal image. Passing light is collected in a condenser lens and is sent directly to a photo detector. The electrical output from the photo detector is integrated over a period of time during which the light beam activates a resolution cell. In this type of system is considered that even lens with perfect focus produces some blurring because of the diffraction limit of its opening (O'Neill, 1963).
The sampled image is
where the arrangement of samples is
For purposes of analysis it is assumed that the sampling function is generated by a finite array of Dirac deltas DT(x, y) passing through a linear filter with impulse response P(x, y) then
Taking Equations 1 and 2 yields
The spectrum of the sampled image is given by
where P(wx, wy) is the Fourier transform of P(x, y).
The Fourier transform of the truncated sampling arrangement (Papoulis, 1966) is
]]>
This function, evaluated at the limit for large values of J and K, is converted into an array of Dirac deltas.
In an image reconstruction system, an image is reconstructed by interpolation of their samples. The interpolation waveforms selected as Sine function or Bessel generally extend over the entire field of the image (Pratt, 2001). If the arrangement is a discontinuous sampling, the reconstructed image will fail near their edges. However, the distance error is negligible in about 8 to 10 samples of Nyquist (Abramatic and Faugeras, 1982).
Modeling the interpolation system
In modeling the system a test image is taken for amplification by pulses interpolation. The aim is to achieve a new higher resolution image containing the highest fidelity with the original image. The process does not cause pixels block effect and maintains the continuity of phase in the Fourier transform of the result. This allows a smooth visual path. It contains the details in low-frequency areas and facilitates the compression. A convolution kernel (Abramatic and Faugeras, 1978; Pratt et al., 1982; Abramatic and Faugeras, 1982) is generated by the Fourier transform of the truncated sampling arrangement (8).
The space of the band limited functions in the frequency range ω ∈ [–π, π] is spanned by the infinite (yet countable) set of sine functions shifted by integers. Thus any such band limited function g(t) can be reconstructed from its samples at integer spacing.
Equations (7) and (9) yield
The term O{δ(t1, t2} for ti = mi – ni + 1 is the response, at the output coordinate, to an input of one unit amplitude at coordinate (n1, n2). It is called the impulse response function array of the linear operator and is written as
The impulse response array can change form for each point (m1, m2) in the processed array Q(m1, m2). Following this notation, the finite area superposition operation is defined as
This expresses the finite-area superposition operation in the left-justified form in which the input and output arrays are aligned at their upper left corners. It is often notation-wise convenient to utilize a definition in which the output array is centered with respect to the input array. This definition of centered superposition is given by
The limits of the summation are
In the interpolation system, the input array F is the low resolution image of (Nx, Ny). Then, using (7), (8) and (13), the output data array Qc(j1, j2) is obtained. Using (10), the samples of DT(ωx, ωy) for the interval in which ω ∈ [–π, π] are inserted. Figure 3 shows how for Δx = 1 and Δy = 1, Ly = 2 • K and Lx = 2 • J.
where J' and K' are the dimensions of the low resolution image, this is, the input array F.
Obtaining the impulse response function array in function of the exploration parameters inc and co.
Evaluating the expression for ωx ∈ [–π, π], ωy ∈ [–π, π] and using (19) we obtain the output array Qc(j1, j2), which has dimensions (Mx, My), where
Then the inverse transformation of the output array gives the high resolution image
In order to define the parameters inc and co of equations (15) and (16), the high frequency estimate over QS(x, y) is applied. Applying a Butterworth high pass filter (Pratt, 2001) to less than 5 pixel elements
Spatial filters for the edge detection over the high resolution image are used in another case. A Canny type filter is applied (Canny, 1986) in order to estimate the amount of edge content and to restrict the parameters Amp, inc and co of equations (15) and (16). In this case the implementation of the Canny operator gives
]]>
Then the appropriate values of Ly and Lx can be found in both cases by
Due to the complexity of the formulation, no analytic solution has been found, but a variational approach has been developed. Defining a fixed value for the large resolution modifier Amp = 1.1, the maximum responses of high frequencies are found by the output of the filter only for some combination values of the scan parameters inc and co. The high frequencies response of the high resolution image using the Butterworth filter of the equation (20) is shown in Figure 5.
Figures 6 or 8 show how a periodicity exists in each row; for example, if inc = 0.4 the best result appears every 5 figures and the resolution of the output image increases according to equation (22). For a good result, if inc = 0.4 then co = co0 + n • 5 when co0 = 4, equations (15) and (16) get the exact dimensions. But the best result for the Butterworth guide comes from Table 1, co = 19, inc = 0.4 where this pattern combination gives us the maxim conservation value of the frequency range of the filter (Figure 9).
In order to obtain a new vertical resolution, from 182 to 1800 pixels
Figures 7 and 10 show how a loss of the high frequency content occurs. The application of the interpolation kernel with the Butterworth filter guide produces this effect. This filter does not give the maximum values of frequency of contour information.
The Canny method finds edges by looking for the local maximum of the image gradient. The gradient is calculated using the derivative of a Gaussian filter. The method uses two thresholds to detect strong and weak edges, and includes the weak edges in the output only if they are connected to strong edges. This method is therefore less likely than the others to be deceived by noise, and more likely to detect true weak edges.
The classical separable sine impulse response function array (Pratt, 2001) is
Compare, in Figure 13, the results of the sine separable interpolation (30) and the application of the impulse response function array (20) restricted by the Canny filter over the first column of the high resolution image. Figure 11 shows the periodicity and the peaks useful for the amplification. The map of figure 12 has localized a zone where exist a maximum value obtained from the Table 2, with co = 10 and inc = 0.5. Figure 14 shows how the high resolution image maintains the original contrast. This figure has better conserved contour information than the one obtained with the classic interpolation using the impulse response function array (30).
In Figure 15, an integer number multiplier is used in order to construct a more dense mesh of the interpolation kernel (20). The parameters in Table 2 for the maximum high frequency response in the high resolution image are used.
]]> In the case of Figure 15, from equation (15)
And from equation (16)
Discussion and analysis of results
The investigation shows the main aspects of the interpolation with restriction for the amplification. For instance, which is the goal in the amplification process? What filter could be the guide for the parameters in the construction of the response impulse function or amplification kernel? The Butterworth filter takes in consideration a range of high frequencies, in the case for Δx = 5 pixels, but the main trouble in the interpolation is the contour conservation or high frequencies, that are just over π. The results of amplification guide by Butterworth give possible combination of parameters for equations (15) and (16) in a range of frequencies. In order to have better results it is necessary to use a filter directly related with the contour information of the image. The edge detectors are developed with a robust capacity for the detection. One famous detector is the Canny filter (Canny, 1986).Then the high frequencies of the interpolation output are related to the impulse response function array using the Canny filter. We found the adequate parameters inc and co in order to make the interpolation kernel, increase the high frequency content in the high resolution image.
Other aspect is the control of the coordinates of amplification of the filter. It is shown in Figures 6 or 8 how periodicities exist in each inc row. The argument of the sine components of the impulse response function array in function (20) are near π/2 with the exploration parameters inc = 0.4 and co = co0 + n • 5 for the contour interpolation. The amplification suited under this condition takes the dimensions desired using (15) and (16). Figure 10 is an exact amplification to the precise coordinates. But this process gives losses with the guide of the Butterworth filter. When controlling the amplification it is preferable, for the conservation of high frequency content in the high resolution plane, to find a local maximum using the Canny filter. A whole number is used as multiplier to increase the interpolation kernel dimensions. Another important topic is the comparison applying the classical separable sine impulse response function array (30) and the interpolation results with the impulse response function array (20) constrained by the neighbor detector filter Canny type. It is shown how the restriction increases the range of the pixels values doing a contribution to the high frequency conservation in the high resolution plane. In the last case it is analyzed how the guide of Canny is useful to construct an interpolation kernel in order to obtain a very high resolution image taking only maximum local values in a range. The parameters, when the high frequency content increases, represent the adequate amount of sampler components in the impulse response array S(x, y) of equation (1) for the interpolation. The sampler components are more numerous than the samples of the original image for the interpolation, but the position of these are in the active zone of the resolution cell of the physical scan model and consequently over the valid values of the pixels in the original image and not between. Then the interpolation kernel increases by a whole number multiplier for the adequate parameters Amp, inc and co giving a high frequency maximum in an initial range. Using this mode we obtained a very high resolution image. The high frequency content in the high resolution plane was retained. Figure 15 shows how this effect occurs over an amplification of the 1550% in each coordinate.
Conclusions
]]> This paper shows an effective way for optimizing a pulse interpolation filter in order to obtain the best visual result for the required amplification rate. The proposed amplification method retains the high frequency content and does not produce pixels block effect. A new way of relationship between the constructions of the interpolation kernel and the guide of classic filters is shown in order to increase the high frequency content in the high resolution image. The restriction of the interpolation process using high pass filters increases the range of the pixels values doing a contribution to the high frequency conservation in the high resolution plane. A Canny detector is more effective than the Butterworth high pass filter for the high frequency conservation in the amplification. The characterization of the filter is necessary for the efficient application in different processes of restoration and reconstruction, preserving the characteristics of the primary image. The proposed method makes adequate amplification filters for specific purposes in the field of digital photo restoration and image and video compression.
References
Abramatic J.F. and Faugeras O.D. Correction to Sequential Convolution Techniques for Image Filtering. IEEE Trans. Acoustics, Speech, and Signal Processing, ASSP-30, 2, April 1982, 346. [ Links ] Simple-Cell Receptive Field Properties by Learning a Sparse Code for Natural Images. Nature, volume 381, 1996: 607-609. [ Links ]
Abramatic J.F. and Faugeras O.D. Sequential Convolution Techniques for Image Filtering, IEEE Trans. Acoustics, Speech, and Signal Processing, ASSP-30, 1, February 1982, pp. 1-10. [ Links ]
Abramatic J.F. and Faugeras O.D. Design of Two-Dimensional FIR Filters from Small Generating Kernels, Proc. IEEE Conference on Pattern Recognition and Image Processing, Chicago, May 1978. [ Links ]
]]>Brown J.L., Jr. Bounds for Truncation Error in Sampling Expansions of Band-Limited Signals. IEEE Trans. Information Theory, IT-15, volume 4 (July issue), 1969: 440-444. [ Links ]
Canny J. A Computational Approach to Edge Detection, IEEE Trans. Pattern Analysis and Machine Intelligence, PAMI-8, volume 6 (November issue), 1986: 679-698. [ Links ]
Jong-Woo H., Jun-Hyung K., Sung-Hyun C., Jong-Ok K. A Novel Image Interpolation method Using the Bilateral Filter, Consumer Electronics. IEEE Transactions, volume 56 (issue 1), 2010. [ Links ]
Helms H.D. and Thomas J.B. Truncation Error of Sampling Theory Expansions. Proc. IRE, 50, volume 2 (February issue), 1962: 179-184. [ Links ]
Hakran K., Youngjoon C., Seongjai K. Curvature Interpolation Method for Image Zooming, Image Processing. IEEE Transactions, volume 20 (issue: 7), 2011. [ Links ]
]]>Levine J.A, Paulsen R.R., Zhang-Yongjie. Scanning Modalities and Medical-Image Analysis. Computer Graphics and Applications, IEEE, volume 32, 2012. [ Links ]
Liu Xianming, Zhao Debin , Xiong Ruiqin, Siwei Ma. Image Interpolation Via Regularized Local Linear Regression, Image Processing. IEEE Transactions, volume 20 (issue 12), 2011. [ Links ]
O'Neill E.L. Introduction to Statistical Optics, Addison-Wesley, Reading, MA, 1963, pp. 83. [ Links ]
Ozdur-Ibrahim, Shu-Hong, Bass M.,Guifang L. Think Outside the Fiber: Imaging Amplifier for Space-Multiplexed Optical Transmission. IEEE Photonics Journal Imaging Amplifier for Optical Transmission, volume 4 (issue 5), October 2012. [ Links ]
Papoulis A. Systems and Transforms with Applications in Optics, McGraw-Hill, New York, 1966, p. 105. [ Links ]
]]>Pratt-William K. Digital Image Processing: PIKS Inside, 3rd ed., Copyright © 2001, John Wiley & Sons, Inc. ISBNs: 0-471-37407-5 (Hardback); 0-471-22132-5 (Electronic). [ Links ]
Pratt W.K., Abramatic J.F., Faugeras O.D. Method and Apparatus for Improved Digital Image Processing, U.S. patent 4,330,833, May 18, 1982. [ Links ]
Citation for this article:
Chicago citation style
Morera-Delfín, Leandro. Determining Parameters for Images Amplification by Pulses Interpolation. Ingeniería Investigación y Tecnología, XVI, 01 (2015): 71-82.
ISO 690 citation style
Morera-Delfín L. Determining Parameters for Images Amplification by Pulses Interpolation. Ingeniería Investigación y Tecnología, volume XVI (issue 1), January-March 2015: 71-82.
About the author
Leandro Morera-Delfin. Graduated in Telecommunications and Electronics Engineering and Master in Biomedical Sciences. He is actually a Professor of Communications Theory and Digital Images and Signals Processing at the Higher Polytechnic Institute Jose Antonio Echeverria, Havana, Cuba. He has job experience in network administration and software development for surveillance and investigations about compressing and pattern recognitions over images and video.
]]>