Ultrasound 2d Fetal Developing Brain Image Classification and Disease Prediction

Sridharan K, Gokul N^*, Giridharan L and Akashdeep V
^*Correspondence: Gokul N, Department of Information Technology, Panimalar Engineering College, India, Email:

Keywords

Fetal; Google net; Image classification; Ultrasound

Introduction

The first use of ultrasound (US) for brain surgery was reported by Chandler et al., describing the surgical results of 21 cases using two-dimensional imaging (2D-US), allowing real-time visualization of the underlying anatomy and pathology throughout the pathology performance. Since then, without being exposed to ionizing radiation, the use of intraoperative ultrasound has allowed surgeons to make better decisions during a surgical procedure. Smaller probes and more seamless integration with neuron navigation systems are examples of how the technology has advanced along with the advancements in neuroimaging modalities and image quality. The development of related developments is another in the context of these advances; we use the 2D-US in comparison to other modalities for fetal brain development. To extract pertinent information from the photos and categorize the fetal into normal or abnormal categories, this field combines sophisticated image processing techniques and machine learning algorithms. Additionally, certain illnesses including cerebral palsy, microcephaly, and Down syndrome can be predicted using the algorithms.

Figure 1 displays actual samples of fetal brain images. This method has the potential to significantly increase the accuracy and early diagnosis of fetal brain abnormalities, enabling earlier interventions and treatments that can significantly enhance the result both for the mother and the fetus. However, as this is a new subject, more study is required to enhance the precision and dependability of the techniques employed in the classifying and prognostication of diseases from unborn baby brain images. Because of the increased prevalence of genetic problems in newborns, the application of ultrasound 2D fetal developing brain picture categorization and illness prediction is becoming more and more crucial. The prognosis for the afflicted children and their families can be considerably improved by early detection and treatment of these diseases.

In this discipline, several machine learning techniques are utilized to evaluate ultrasound pictures and categorize the fetus into normal or pathological categories. These algorithms include like deep-neural networks and decision trees, and lastly support vector machines. Additionally, the likelihood of certain illnesses may be predicted by algorithm. Despite the potential advantages of this strategy, further study is necessary to increase the precision and dependability of the techniques employed because the area is still in its infancy. The lack of high-quality ultrasound pictures for use in algorithm testing and training is one of the difficulties in this subject. The variation in the pictures brought on by the various acquisition methods and the location of the fetus inside the uterus presents another di fficulty [1-3].

Considering these difficulties, the topic of ultrasound 2D fetal developing brain picture categorization and illness prediction has significant promise for enhancing fetal brain problem detection and therapy. Healthcare providers may improve care for pregnant women and their fetuses by developing technologies and improving the algorithms they employ.

Recent developments include the categorization and illness prediction of fetal brain ultrasound imaging in two dimensions. Implementing methods for deep learning such as convolutional neural networks, is one such approach (CNNs), to increase the precision of illness prediction and fetal brain picture categorization.

The time and effort needed by medical professionals to manually examine the pictures would be reduced if automated solutions for ultrasound 2D fetal brain image processing were developed. Additionally, this would enhance the consistency and precision of the analysis, improving patient outcomes [4-6].

The ethical and legal issues associated with the categorization and illness prediction of ultrasound 2D fetal brain images are also significant. This covers concerns about informed consent, confidentiality, and data protection, as well as the precision and dependability of the forecasts produced by these methods.

Additionally, more study is required to confirm the precision and dependability of these methods and to ascertain any potential long-term consequences of ultrasound radiation exposure on the growing fetus. To guarantee consistency and comparability of results across various studies and populations, additional standardization in the acquisition and processing of ultrasound images is also required.

Overall, the field of ultrasound 2D fetal brain image classification and disease prediction holds great promise for enhancing mother and baby health and well-being, but it is crucial to take into account and address the various ethical, legal, and practical issues associated with its creation and application.

Methods

The descriptiveness and discrimination capability of derived features are essential for achieving effective analysis performance in image analysis tasks. Because the features for recognition may be automatically extracted by training, deep learning has the benefit that this sort of method can be extended to difficult situations with very complicated character istics [7].

Convolutional neural network

Artificial neural networks known as deep neural networks (ConvNets or CNNs) are used for natural language processing as well as image and video recognition. They are made to handle data having a grid-like architecture, such as an image while maintaining the spatial link between the pixels by employing convolutional layers to learn local characteristics ( Figure 2).

A ConvNet is composed of an input layer, hidden convolutional layers, pooling layers, fully connected layers, and output layers. The convolutional layers, which apply filters to the incoming data, create the feature map. The pooling layer reduces the spatial size of the feature map, the number of variables in the network, and allows for the detection of features of varying sizes. Figure 2 explains the process of a Convolutional Neural Network.

Google-Net

Google-Net and other the use of Convolutional Neural Networks (CNNs) in analysis of ultrasound images in fetal imaging to improve the accuracy of fetal diagnostics. CNNs have shown promising results in a number of fetal imaging applications, including fetal growth estimation, fetal biometry measurement, and fetal anomaly detection.

In fetal ultrasound imaging, CNNs can be mainly used to the – automation of the extract features from the ultrasound images and make predictions about various aspects of the fetus, such as gestational age, fetal weight, and the presence of anomalies. These predictions can then be used to support or improve clinical decision making.

One of the major benefits of utilizing CNNs for fetal ultrasound analysis is was their ability to learn from large amounts of data, which can improve the accuracy of their predictions. In addition, they can be trained end to end, which means that they can learn to make predictions directly from raw ultrasound images, without the necessity for segmentation algorithm or feature extraction.

Overall, the use of CNNs in fetal ultrasound imaging has the potential to improve the accuracy of fetal diagnostics and make them more accessible to a wider range of healthcare providers.

It's important to keep in mind that the application of CNNs in fetal ultrasound imaging is still an emerging field, and further research is needed to fully evaluate their performance and assess their impact on clinical practice. However, the potential benefits of using CNNs in fetal ultrasound imaging are significant and demonstrate the potential for deep learning to transform healthcare and improve patient outcomes (Figure 3).

Discrete Wavelet Transforms (DWT)

The image quality and reduce noise. The process works by decomposing the image into different frequency components using wavelets, which are mathematical functions that help to analyse and represent signals. The high-frequency components of the image, which contain most of the noise, are then suppressed or thresholder to reduce their impact on the image. The resulting wavelet coefficients are then inverse transformed back into the image domain to produce a denoised and improved version of the original image. This process can enhance the visibility of fine structures and improve the diagnostic accuracy of the ultrasound examination.

• Image acquisition: The original image is acquired using a 2D ultrasound machine.

• Decomposition: The image is decomposed using a wavelet transform, resulting in a set of wavelet coefficients that represent the image's numerous frequency components.

• Thresholding: The In the context of 2D fetal ultrasound, DWT (Discrete Wavelet Transform) is used to improve high-frequency coefficients, which contain most of the noise, the threshold to reduce their impact on the image. This can be done using various thresholding methods, such as hard thresholding or soft thresholding.

• Reconstruction: The threshold coefficients are inverse transformed back to the image domain produce a denoised and updated version of the real image.

• Image display: The resulting image is displayed on the ultrasound machine's screen for interpretation by a trained medical professional.

For the DWT wavelet, the wavelets are sampled at regular intervals. DWT provides data about both the spatial and sensitive attributes of a picture at the same time. To evaluate an image, the discrete wavelet transform method can combine the analyzing filters bank and decimate opera tion.

Each decomposition level's low and high pass filters are included in the analysis filter bank. While a less-level band pulls the necessary details from data, these same higher-level gathers elements like edges. Two distinct 1D transforms are used to create the 2D transform. In a 1-dimensional discrete wavelet transform, the approximate coefficients pattern frequency components whereas the detailed components convey higher frequency components.

We used the reverse biorthogonal family of wavelets as well as wavelets in one and two dimensions for our paper. By implementing edge-tracked scale normalization before the DWT procedure, effective feature extraction was accomplished. The scaled basis function is used by the biorthogonal and reverse biorthogonal wavelets in order to decompose and rebuild an image from one resolution level to the next.

The converted data can be sorted with a resolution that is appropriate for its scale thanks to the usage of DWT as a feature extractor. Small and large characteristics can both be seen since they may be investigated individually thanks to the converted image's multi-level representation.

Since DWT are not similar or match to the Trigonometric function transform, DWT handles data discontinuities better than Discrete Cosine Transform (DCT). As an outcome, DWT is a powerful decoder for complex data such as Color FERT and cmu pie, resulting in higher results

Results and Discussion

Initially, the images are pre-loaded and the data are saved and then it is pre-processed. The images are selected from the database and then the images are started to train. Discrete wavelet transformation is used to make the image more accurate and it changes the low-level and unclear images into clear images. It helps the user to find the normal/abnormalities in that image. Then by using the convolution neural network algorithm Google net, the images are scanned and found whether it is normal or abnormal. If it results in abnormality, it shows the details of that disease and what precautions can be done.

The classification of 2D fetal developing brain pictures and the prediction of linked disorders using CNNs can yield promising results. Anomalies like ventriculomegaly and encephalocele, as well as other anomalies, can be accurately detected in fetal brain scans using CNNs, according to several studies. With some research claiming accuracy rates of over 90%, these results have demonstrated that CNNs can detect these anomalies with a high degree of consistency and precision.

Additionally, by automating laborious and arbitrary processes like manual feature extraction and segmentation, CNNs can increase the effectiveness of fetal brain diagnosis. In particular, in situations with low resources, this can lessen the workload of healthcare professionals and increase the accessibility of prenatal brain diagnostics.

Initially, the images are pre-loaded and the data are saved and then it is pre-processed. The images are selected from the database and then the images are started to train. Discrete wavelet transformation is used to make the image more accurate and it changes the low-level and unclear images into clear images. It helps the user to find the normal/abnormalities in that image. Then by using the convolution neural network algorithm Google net, the images are scanned and found whether it is normal or abnormal. If it results in abnormality, it shows the details of that disease and what precautions can be done.

That's really crucial to remember that a variety of elements, including the caliber of the input images, the choice of CNN architecture, and the availability of annotated training data, might influence the outcomes of utilizing CNNs for fetal brain imaging categorization and disease prediction. As a result, it's crucial to thoroughly assess each study's findings and to take these things into account when interpreting them.

Overall, the results of utilizing CNNs to classify 2D images of the developing brain in fetal and forecast disorders associated with them are encouraging, and also have the ability and knowledge of machine learning to increase the precision and accessibility of fetal brain diagnostics. To thoroughly evaluate their effectiveness and determine their impact on clinical practice, more research is necessary.

Conclusion

In conclusion, the use of CNNs for the classification of 2D fetal developing brain images and the prediction of related diseases has the potential to transform fetal brain diagnostics and improve patient outcomes, but further research and development are needed to fully realize it’s potential.

Acknowledgement

None.

Conflicts of Interest

The authors do not have possible relationships with industrial and financial organizations that could lead to a conflict of interest in connection with the material presented in the manuscript.

References

1. Herrera, CL, Byrne JJ, Clark HR and Twickler DM, et al. “Use of Fetal Magnetic Resonance Imaging after Sonographic Identification of Major Structural Anomalies.” J Ultrasound Med 39(2020): 2053–2058.

   [Crossref] [Google Scholar]

2. Gholipour, A, Estroff JA and Warfield SK. “Robust Super-Resolution Volume Reconstruction from Slice Acquisitions: Application to Fetal Brain MRI.” IEEE Trans Med Imaging 29(2010): 1739–1758.

   [Crossref] [Google Scholar]

3. Murgasova, MG, Quaghebeur G, Rutherford MA and Hajnal JV, et al. “Reconstruction of Fetal Brain MRI with Intensity Matching and Complete Outlier Removal.” Med Image Anal 16(2012): 1550–1564.

   [Crossref] [Google Scholar]

4. Hou, B,  Khanal B, Alansary A and McDonagh S, et al. “3-D Reconstruction in Canonical Co-Ordinate Space from Arbitrarily Oriented 2-D Images.” IEEE Trans Med Imaging 37(2018): 1737–1750.

   [Crossref] [Google Scholar]

5. Salehi, SSM, Khan S, Erdogmus D and Gholipour A. “Real-Time Deep Pose Estimation with Geodesic Loss for Image-To-Template Rigid Registration,” IEEE Trans Med Imaging 38(2019): 470–481.

   [Crossref] [Google Scholar]

6. Ebner, M, Wang G, Li W and Aertsen M, et al. “An Automated Framework for Localization, Segmentation and Super-Resolution Reconstruction of Fetal Brain MRI.” NeuroImage 206(2020): 116324.

   [Crossref] [Google Scholar]

7. Ferrante, E and Paragios N. “Slice to Volume Medical Image Registration: A Survey.” Medical Image Anal 39(2017): 101–123.

   [Crossref] [Google Scholar]