Introduction
Computational ghost imaging (CGI), which is less expensive than traditional γ-ray imaging, can reduce the scientific costs.[1] By replacing the traditional detectors with bucket detectors and spatial modulators, CGI has attracted much attention as a new type of imaging.[2] Moreover, the crosstalk noise between the detectors and the radiation intensity significantly affects the image quality. CGI can effectively avoid crosstalk noise between detectors and reduce the radiation intensity required by imaging. In particular, it avoids the limitation of the size of detectors on image spatial resolution, which offers a new possibility for more precise radiation imaging.
However, designing and manufacturing a suitable spatial modulator has always been a challenge for achieving CGI. The earliest breakthrough is visible light. A spatial light modulator (SLM)[3] or digital micromirror (DMD)[4, 5] has been used to modulate the light field. However, neither the SLM nor the DMD can modulate ray particles with certain penetration ability. In the field of rays, the only way to achieve this is to take advantage of the attenuation of rays by coding plates.
The difficulty of fabricating coding plates significantly delays the realization of X-ray and neutron ghost imaging. In 2020, He et al.[6, 7] used electroplating to fabricate Hadamard coding plates made of Au and photochemical etching to fabricate Hadamard coding plates made of Cu. Their pixel sizes were 10 × 10 and 150 × 150 μm, and their thicknesses were 10 and 150 μm, respectively. Using the two coding plates as spatial modulators, they achieved X-ray CGI with resolutions of 10 and 150 μm. In a subsequent study of neutron CGI, He et al.[8] used the Bosch process for deep silicon etching and Gd2O3 powder filling to produce a thermal neutron coding plate with a thickness of 300 μm. They also conducted the first thermal neutron CGI experiment on the Dongguan spallation neutron source device.
However, few studies on γ-ray CGI are available at this moment. This is because the penetration ability of γ-rays is generally higher than that of X-rays and thermal neutrons. For example, if the energy of γ-rays is above 100 keV, the thickness required for high Z-encoding plates must be more than 1 mm, which is currently impossible to achieve using etching processes. Similar devices are also needed in γ cameras to correct γ rays, such as those in the uniformly redundant arrays coding plate (URA) and modified uniformly redundant arrays coding plate (MURA). [9] These coding plates are divided into N small blocks. Each small metal block is then placed into a coding plate according to the numerical distribution of the respective correction matrices. However, to achieve the same imaging resolution, N2 pixels are required in the CGI coding plate. It is difficult to employ this method to create coding plates with many pixels.
In addition, to achieve a higher imaging resolution, the number of required measurements has increased dramatically, and the number of subcoding plates required has also increased significantly, resulting in a very large number of pixels on the coding plate. This eliminates the cost advantage of a single-pixel imaging system, and the cost savings from detectors are wasted on coding plate manufacturing. For a high-quality γ-ray imaging system, it is difficult to create coding plates with a large number of pixels. Therefore, the development of coding plates with fewer pixels is essential to achieve γ-ray CGI.
To date, few good solutions to this problem have been reported. The reasons for this are as follows: (1) relevant research is insufficient because of the short history of ray CGI; (2) in the optical field, it is easy to change the distribution of modulated light fields because of the widespread use of SLM and DMD. The study of light-field modulation mainly focuses on achieving high-quality imaging with undersampling.
If the undersampling method is used in γ-ray CGI, the number of required coding plate pixels can also be reduced. Nevertheless, this is still excessive for γ-ray CGI. It will be easier to fabricate coding plates that are suitable for γ-rays if the number of pixels is reduced further.
Compressed sensing (CS) theory provides an excellent theoretical framework for image reconstruction in CGI with undersampling. It often uses some special measured patterns, such as the Hadamard mask and random mask, and iterative optimization methods, such as the L1-magic algorithm, orthogonal matching pursuit (OMP) algorithm, and TVAL3 algorithm, for image reconstruction.[10] The undersampling method can reduce the number of pixels required by the coding plates, but this also means a higher standard in the design of coding plates.[11-13] That is to say, in the limited number of measurements, the coding plate should maximize the degree of "fluctuation" of the measurement data so that valid information can be retained as much as possible.[14-16] Random masks have the advantage of being easy to manufacture. One effective method to reduce the sampling rate further is to use orthogonal basis types of masks, such as Hadamard coding plates, to remove the redundancy in random measurements.
Currently, Hadamard coding plates are widely used in CGI. Hadamard coding plates are adopted because the Hadamard matrix has some interesting features, such as good orthogonality and the ability to remove redundant information in natural scenes.[17] Then, the question arises, which subcoding plates should be selected to form a new plate as small as possible and able to maintain high-quality imaging? Researchers have proposed various undersampling measurement sequences based on the Hadamard matrix. They hope that the careful design of multiplexing matrices will result in potential performance improvements in CGI.
Sun et al.[16] proposed a Russian doll measurement sequence in 2017. This sequence was designed according to both the characteristics of the numerical distributions and the total number of subcoding plate blocks. This sequence can achieve good recovery results, with a sampling rate of only 16%. In 2019, Yu et al.[18] found that rearrangement of the measurement sequence of Hadamard coding plates might change the coherent area of each imaging point, which might in turn lead to a change in the quality of imaging. If the measurement sequence of the subcoding plates is arranged in ascending order in terms of the number of blocks, the coherent region of each imaging point will naturally become smaller, resulting in a high-quality imaging recovery at smaller sampling rates. This measurement sequence, known as the "cake-cutting" sequence, has a better effect than the Russian dolls and random Hadamard measurement sequences in undersampling. In addition, because the image reconstruction effect of the compressed sensing algorithm is closely related to the selected sparse matrix, some researchers have proposed measurement sequences based on different sparse matrices, such as the Harr sequence.[19, 20] At a sampling rate of 25%, this Harr sequence can better restore the image characteristics.
In 2020, Xiao proposed two new measurement sequences from the perspective of graph decomposition: the total variation (TV) method and the total wavelet transformed coefficients (TW) method.[21] The subcoding plates are reordered through their TV and TW in ascending order to achieve the best performance. The numerical simulation and experimental results show that the TV, CC, and TW orders can provide almost the same reconstruction at deep compressive sampling, and even better performance at a sampling ratio above 30%.
Yu proposed a concept called selection history, which can record the Hadamard spatial folding process, and built a model based on it to reveal the formation mechanisms of different orderings and deduce the mutual conversion relationship among them.[17] Based on this, a weight ordering of the Hadamard basis was proposed. Both the numerical simulation and experimental results have shown better reconstruction quality with a lower sampling rate than traditional sorting methods.
Many orderings have emerged, but their relations remain unclear and lack a unified theory to explain the inherent math and physical mechanisms. In particular, there is a lack of mathematical explanation as to why good imaging quality can be obtained for each undersampling sequence.. In addition, most researchers have concentrated on how to compose a multiplexing matrix in the undersampling method to reduce the number of pixels of the coding plates (mask). However, the method that directly reduces the number of pixels of the coding plates by changing the connection between the subcoding plates is ignored.
In this study, on the premise that the size of coding plates cannot be reduced on a large scale owing to the unification of interpretation theories at present, the internal correlation of the subcoding plates is studied from another perspective, and the new connection mode between subcoding plates is studied to reduce the number of pixels of coding plates.
The specific approach is as follows: we propose an optimization algorithm that can create “compressed coding plates.” A compressed coding plate is generated by compressing a traditional coding plate. The algorithms satisfy the requirements of both full sampling and undersampling. This study consisted of three parts.
(1) The characteristics of Hadamard coding plates were studied, and a moving distance matrix was obtained to quantify the regional similarity between the subcoding plates.
(2) Two ant colony optimization arrangement algorithms were designed to reuse pixels of the same region to the largest degree between the subcoding plates.
(3) The optimum method was tested, and its outcomes were discussed in terms of full sampling and undersampling.
Methods
Computational ghost imaging
The schematic of a common γ-ray CGI device is shown in Fig. 1.
-202301/1001-8042-34-01-012/alternativeImage/1001-8042-34-01-012-F001.jpg)
In CGI, it is necessary to move the coding plate after each measurement to change the shape of the mask in the imaging area and thus, the distribution of the ray field. In this study, the mask of the corresponding part of each measurement is called a subcoding plate. The measurement process can be expressed using Eq. 1:
In CGI, the measured value
Traditional ghost imaging is a well-known imaging technique. Its definitions are as follows. An object image
With the development of ghost imaging technology, some researchers have reconstructed images from the perspective of solving equations. For example, Zhang proposed pseudo-inverse ghost imaging[21] and Xue proposed singular value decomposition ghost imaging.[22] Then, optimization algorithms based on compressed sensing (CS) have been employed to reconstruct images under undersampling, such as the orthogonal matching pursuit (OMP) and TVAL3 algorithms.
In addition, some patterns, such as the Gaussian, Bernoulli, DCT, and Hadamard matrices, have been used in CGI. The Hadamard matrix can generate better-quality images compared to other measurement matrices.[17] Therefore, the Hadamard coding plate is widely used in CGI.
Regional similarity
Because of the uncorrelated character of any two columns or rows, the Hadamard matrix, as a modulation orthogonal matrix, can effectively avoid correlation noise among the pixels, and the reconstructed image quality can be greatly improved at the same sampling rate.[14] The Hadamard matrix is generally constructed recursively from low to high order, as shown below:
The traditional Hadamard coding plate comprises K × K-block subcoding plates. The molding method of the subcoding plates converts the 1D code elements into 2D patterns, as shown in Fig. 2(a–c).
-202301/1001-8042-34-01-012/alternativeImage/1001-8042-34-01-012-F002.jpg)
Owing to the recursive property of the Hadamard matrix, it can be observed that the front part of a row in the matrix is the same as the back part of another row (Fig. 2(a)). This rule causes the left area (Fig. 2(b)) of one subcoding plate to be completely consistent (Fig. 2(d)) with the right area (Fig. 2(c)) of another subcoding plate. This phenomenon is known as regional similarity between two subcoding plates.
If we want to use regional similarity to compress the coding plate, it is necessary to calculate the degree of regional similarity between subcoding plates quantitatively. To achieve this goal, a moving distance matrix M is employed to describe the regional similarity. The moving distance matrix
According to the matrix in Table 1, the regional similarity between the subcoding plates has the following characteristics.
(1) Approximately 90% of the elements in the moving distance matrix take the value of 8, which indicates that there is no regional similarity between most subcoding plates. However, there are 320 pairs of subcoding plates with regional similarities, which indicates that the aim of reducing the number of pixels of the coding plates can be achieved by adjusting the order of the subcoding plates.
(2) In the matrix, there is a sporadic continuous oblique distribution of low-value elements, which indicates that there are interrelated characteristics between subcoding plates with regional similarities. This makes it possible to use continuous subcoding plates with regional similarities.
Therefore, based on the moving distance matrix, we reuse the same region between the subcoding plates to reconstruct a new coding plate with fewer pixels, as shown in Fig. 2(d). The new coding plate can compress a traditional coding plate and is called a compressed coding plate.
Ant colony optimization arrangement algorithms
Ant colony algorithms
To maximize the use of regional similarity between the subcoding plates and thus minimize the pixels of the compressed coding plate, it was necessary to redesign a measurement sequence of the subcoding plates according to the moving distance matrix obtained in the previous section. The problem is modeled as follows.
In the model, the goal is to find a path that minimizes S; the constraints are as follows: 1) each point can only pass once; and 2) all points need to be passed. This problem is similar to the travelling salesman problem (TSP). It is a mathematical combinatorial optimization problem and an N-P problem. The ant colony algorithm is a mature and effective algorithm for solving the TSP and other combinatorial optimization problems.[23] In this study, each subcoding plate was used as the node of the ant colony path space, and the moving distance matrix was used as the node spacing. The path of an ant passing through all nodes is a feasible solution to the problem, and all the paths of the entire ant population constitute a feasible solution space.
Affected by the communication mechanism of ants, their release of pheromones, and the volatilization mechanism of pheromones, more pheromones will be released on the shortest path (the optimal solution), whereas the pheromones on other solutions will volatilize slowly with iterations. Ants prefer paths with high pheromone concentrations. As the number of iterations increases, more pheromones remain on a shorter path and more ants choose this path. Eventually, under the action of positive feedback, ants choose the best path, and the corresponding subcoding plate sequence is the optimal solution to this problem.
In addition, when ant k is at point t, the probability (
After obtaining the path of the generation ant, the path is used to update the pheromones. The updated formula is as follows:.
Method for optimum coding plate
According to the algorithm described in Sect. 2.3.1, the measurement sequence of the subcoding plates under the maximum use of regional similarity can be calculated. However, the coding plate manufactured according to the sequence is very long. Considering the actual production and usage, we need to optimize the coding plate further. A compressed coding plate should be designed, which should have a rectangular shape. Thus, it is called a rectangular compressed coding plate. This means that there should be no significant difference in terms of the length of each segment of the coding plate, and the total number of pixels of the compressed coding plate should be minimized. To solve the above problems, two methods can be employed for obtaining the optimum coding plate: the one-objective ant colony segmentation algorithm (OACSA) and the multi-objective ant colony reconstruction optimization algorithm (MACRA).
One-objective ant colony segmentation algorithm
The core idea of this method is that the long measurement sequence obtained by the ant colony algorithm is divided into multiple short measurement sequences by selecting the appropriate segmentation points, and the long measurement sequence does not need to be changed. These short measurement sequences are reconstructed to obtain the corresponding rectangular compressed coding plates (supplemental pixels and parallel combinations). The reconstruction process may cause an increase in the total number of pixels in the coding plate. After the analysis, the position of the segmentation point should meet the following three criteria:
(1) The length of each segment is approximately equal.
(2) The segmentation points should be carefully selected to preserve the completed subcoding plate to avoid unnecessary pixel supplementation.
(3) The segmentation points should be selected between the subcoding plates with low regional similarity to ensure that the number of supplemental pixels involved in the reconstruction process is small.
Based on these three criteria, this study proposes a segmentation-point selection method for a single-sequence coding plate, and its flowchart is shown in Fig. 3. According to the segmentation point selected by the algorithm, the single-sequence coding plate is divided to obtain multiple coding plate segments. Then, multiple segments are reconstructed to obtain the corresponding compressed coding plate (supplemental pixels and parallel combination).
-202301/1001-8042-34-01-012/alternativeImage/1001-8042-34-01-012-F003.jpg)
Multi-objective ant colony reconstruction optimization algorithm
The reconstruction of a rectangular compressed coding plate is a problem of reconstructing multiple independent segments and is an optimization problem with constraints. To solve this problem, we included the constraint (each segment is essentially of the same length) as the penalty part in the objective function, as shown in Eq. 7.
The MACRA was employed to solve the model. Through continuous iterative optimization, the total distance was gradually reduced, and the gaps between the lengths of all segments were bridged in the multi-objective colony algorithm.
Evaluation index
For a quantitative measurement of the degree of reduction in the number of pixels of the coding plate with ant colony optimization arrangement algorithms, this study defined a quantitative index-compression ratio, α. It represents the ratio of the number of pixels between the compressed and traditional coding plates. The smaller the value, the better the compression effect. Its formulas are as follows:
Results and discussions
We applied the ant colony optimization arrangement algorithms described in Section 2 to reconstruct the full sampling traditional Hadamard coding plate and obtain a compressed coding plate.
Subsequently, to demonstrate the feasibility of undersampling, we obtained the compression ratios of compressed coding plates corresponding to the Harr, cake-cutting, and Russian dolls sequences at different sampling rates. The compression effects were compared and analyzed.
Compressed coding plate in full sampling
For all the subcoding plates corresponding to the 1024-order Hadamard matrix, the regional similarity between the subcoding plates was quantified using the moving distance modeling method to obtain the moving distance matrix. The OACSA and MACRA (the main parameters of the two algorithms are listed in Table 2) were used to reconstruct the rectangular Hadamard compressed coding plates, which are shown in Fig. 4. The compression results are shown in Fig. 5.
Parameter name | Colony size | Iteration number | Importance of pheromones | Pheromone evaporation rate | Heuristic factor coefficients | Segment number |
---|---|---|---|---|---|---|
Value | 10,240 | 10,240 | 1 | 0.5 | 1 | 16 |
-202301/1001-8042-34-01-012/alternativeImage/1001-8042-34-01-012-F004.jpg)
-202301/1001-8042-34-01-012/alternativeImage/1001-8042-34-01-012-F005.jpg)
As shown in Fig. 5(a), both the OACSA and MACRA can significantly reduce the number of pixels, and their corresponding compression rates α are 54.2% and 58.9%, respectively. Moreover, the OACSA has a better compression effect. The reasons for this are as follows:
With constraints, the MACRA is the basic solution to this optimization problem of combination, but it is more complicated than the OACSA. The MACRA requires a long time to obtain an answer. The answers are easily affected by the original figures. We believe that the OACSA may be a better solution to this challenging problem. The OACSA was applied in two phases:
Phase 1: Without constraints (to make the coding plates rectangular), the one-way ant colony algorithm in the OACSA can solve the optimization problem. It is relatively simple and single-sequence coding plates with very few pixels can be made.
Phase 2: When constraints are involved, single-sequence coding plates are segmented and combined to create rectangular compressed coding plates. If appropriate segmentation points are selected through the segmentation point selection method, the entire process results in only a minor increase in the number of pixels.
The minimum distances of movement between adjacent subcoding plates in the single-sequence coding plate generated from the OACSA are shown in Fig. 5(b). It can be observed that the points with a maximum value of 32 and minimum moving distance account for 59.9%, and their distribution is wide. This phenomenon is favorable for the segmentation point selection method; thus, only a small number of pixels are added. This means that there is no significant difference between the number of pixels in the rectangular compressed coding plate and the single-segment arrangement scheme. Thus, we conclude that the OACSA is better than the MACRA.
Compressed coding plate in undersampling
In the previous section, it was proven that both optimum algorithms have good compression effects for the Hadamard coding plate in full sampling; however, the undersampling compression effects of the algorithm are unknown. Therefore, in this section, for the Harr, Russian dolls, and cake-cutting sequences, the OACSA, which has a better compression effect, is applied to reconstruct compressed coding plates at sampling rates of 5%–40%. The α values of the compressed coding plates are shown in Figure 6(a).
-202301/1001-8042-34-01-012/alternativeImage/1001-8042-34-01-012-F006.jpg)
As shown in Fig. 6(a), the ant colony optimization arrangement algorithm has a certain compression effect on the three sequences at different sampling rates, especially the Russian dolls and cake-cutting sequences. The reduction in the number of pixels in the two sequences can reach 40%.
According to relevant literature[16, 18], the Russian dolls sequence can achieve a good imaging result at a sampling rate of 25%, that is, the number of pixels required for the coding plate is 25% of the number of pixels of the traditional Hadamard encoding plate. If the coding plate is compressed using the optimization arrangement algorithm, the number of pixels can be further reduced and the same imaging effect can be achieved without changing the modulation matrix. Therefore, the use of both the undersampling method and the ant colony optimization arrangement algorithm will significantly reduce the number of pixels in the coding plate. This will help lower the difficulty and cost of manufacturing the encoding plate and consequently build the foundation for the realization of γ-ray CGI.
In addition, the compression effect of the cake cutting sequence is the greatest, followed by the effect of the Russian dolls sequence, whereas that of the Harr sequence is not obvious. This result shows that the ant colony optimization arrangement algorithm has different compression effects on different types of sequences. The main reasons for this are as follows:
A large area of the same pixel values is likely to appear between the subcoding plates with a small or similar number of blocks, that is, regional similarities can be easily found between such subcoding plates.
The cake-cutting sequence is arranged in ascending order of the number of blocks. Russian dolls sequences are designed to take advantage of the fact that higher-order Hadamard matrices (
Conclusion
In this study, optimum ant colony algorithms based on regional similarity are proposed to reduce the number of pixels and reconstruct a rectangular compressed coding plate. Without sacrificing the imaging quality, their compression rates can reach 60% in full sampling. In undersampling, the proposed algorithm has a certain compression effect on each of the three sequences at different sampling rates, and the effects are obvious on the Russian dolls and cake-cutting sequences. The use of both undersampling and the proposed algorithm significantly reduces the number of pixels in the coding plate. This will help reduce the difficulty and cost of manufacturing the encoding plate and build the foundation for the realization of γ-ray CGI. Finally, in addition to γ-ray CGI, the proposed algorithms can also be applied to other types of CGI that require modulation by mechanical movement of the coding plate.
Ghost imaging with a single detector
. Phys. Rev. A. 79, 053840 (2009). doi: 10.1103/PHYSREVA.79.053840Single-pixel imaging 12 years on: a review
. Optics express, 28, 28190-28208 (2020). doi: 10.1364/OE.403195Computational ghost imaging
.A new compressive imaging camera architecture using optical-domain compression
.Application of multi-correlation-scale measurement matrices in ghost imaging via sparsity constraints
. Applied Optics 53, 2924-2928 (2014). doi: 10.1364/AO.53.002924Energy-selective x-ray ghost imaging
. Chinese Phys. Lett. 37, 044208 (2020). doi: 10.1088/0256-307X/37/4/044208High-resolution sub-sampling incoherent x-ray imaging with a single-pixel detector
. APL Photonics 5, 5 (2020). doi: 10.1063/1.5140322Single-pixel imaging with neutrons
. Science Bulletin 66, 133-138 (2021). doi: 10.1016/j.scib.2020.09.030Simulation of an imaging system for internal contamination of lungs using MPA-MURA coded-aperture collimator
. Nucl. Sci. Tech. 32, 2 (2021). doi: 10.1007/S41365-021-00849-3Compressed sensing and Otsu’s method based binary CT image reconstruction technique in non-destructive detection
. Nucl. Sci. Tech. 26, 5 (2015). doi: 10.13538/j.1001-8042/nst.26.050403Single-pixel imaging via compressive sampling
. IEEE Signal Processing Magazine 25, 83-91 (2008). doi: 10.1109/MSP.2007.914730Characterization of a compressive imaging system using laboratory and natural light scenes
. Applied optics, 52, 4515-4526 (2013). doi: 10.1364/AO.52.004515Image quality of compressive single-pixel imaging using different Hadamard orderings
. Optics express, 28, 11666-11681 (2020). doi: 10.1364/OE.387612Hadamard transform image coding
. Proceedings of the IEEE, 57, 58-68 (1969). doi: 10.1109/PROC.1969.6869Single-pixel infrared and visible microscope
. Optica 1, 285-289 (2014). doi: 10.1364/OPTICA.1.000285A Russian Dolls ordering of the Hadamard basis for compressive single-pixel imaging
. Scientific Reports 7, 3464 (2017). doi: 10.1038/S41598-017-03725-6Super sub-Nyquist single-pixel imaging by means of Cake-Cutting Hadamard basis sort
. Sensors 19, 4122 (2019). doi: 10.3390/s19194122Single-pixel remote imaging based on Walsh-Hadamard transform
. Acta Physica Sinica 65, 064201 (2016). doi: 10.7498/aps.65.064201Fast single-pixel imaging based on optimized reordering Hadamard basis
. Acta Phys. Sin. 68, 064202 (2019). doi: 10.7498/aps.68.20181886Object reconstitution using pseudo-inverse for ghost imaging
. Optics Express 22, 30063-30073 (2014). doi: 10.1364/OE.22.030063Singular value decomposition ghost imaging
. Optics Express 26, 12948-12958 (2018). doi: 10.1364/oe.26.012948Ant algorithms for discrete optimization
. Artificial Life 5, 137-172 (1999) doi: 10.1162/106454699568728