TY - JOUR A1 - Rezaei, Mina A1 - Näppi, Janne J. A1 - Lippert, Christoph A1 - Meinel, Christoph A1 - Yoshida, Hiroyuki T1 - Generative multi-adversarial network for striking the right balance in abdominal image segmentation JF - International journal of computer assisted radiology and surgery N2 - Purpose: The identification of abnormalities that are relatively rare within otherwise normal anatomy is a major challenge for deep learning in the semantic segmentation of medical images. The small number of samples of the minority classes in the training data makes the learning of optimal classification challenging, while the more frequently occurring samples of the majority class hamper the generalization of the classification boundary between infrequently occurring target objects and classes. In this paper, we developed a novel generative multi-adversarial network, called Ensemble-GAN, for mitigating this class imbalance problem in the semantic segmentation of abdominal images. Method: The Ensemble-GAN framework is composed of a single-generator and a multi-discriminator variant for handling the class imbalance problem to provide a better generalization than existing approaches. The ensemble model aggregates the estimates of multiple models by training from different initializations and losses from various subsets of the training data. The single generator network analyzes the input image as a condition to predict a corresponding semantic segmentation image by use of feedback from the ensemble of discriminator networks. To evaluate the framework, we trained our framework on two public datasets, with different imbalance ratios and imaging modalities: the Chaos 2019 and the LiTS 2017. Result: In terms of the F1 score, the accuracies of the semantic segmentation of healthy spleen, liver, and left and right kidneys were 0.93, 0.96, 0.90 and 0.94, respectively. The overall F1 scores for simultaneous segmentation of the lesions and liver were 0.83 and 0.94, respectively. Conclusion: The proposed Ensemble-GAN framework demonstrated outstanding performance in the semantic segmentation of medical images in comparison with other approaches on popular abdominal imaging benchmarks. The Ensemble-GAN has the potential to segment abdominal images more accurately than human experts. KW - imbalanced learning KW - generative multi-discriminative networks KW - semantic KW - segmentation KW - abdominal imaging Y1 - 2020 U6 - https://doi.org/10.1007/s11548-020-02254-4 SN - 1861-6410 SN - 1861-6429 VL - 15 IS - 11 SP - 1847 EP - 1858 PB - Springer CY - Berlin ER - TY - JOUR A1 - Yan, Ming A1 - Zhou, Wei A1 - Shu, Hua A1 - Kliegl, Reinhold T1 - Lexical and sublexical semantic preview benefits in chinese reading JF - Journal of experimental psychology : Learning, memory, and cognition N2 - Semantic processing from parafoveal words is an elusive phenomenon in alphabetic languages, but it has been demonstrated only for a restricted set of noncompound Chinese characters. Using the gaze-contingent boundary paradigm, this experiment examined whether parafoveal lexical and sublexical semantic information was extracted from compound preview characters. Results generalized parafoveal semantic processing to this representative set of Chinese characters and extended the parafoveal processing to radical (sublexical) level semantic information extraction. Implications for notions of parafoveal information extraction during Chinese reading are discussed. KW - semantic KW - preview benefit KW - reading KW - Chinese Y1 - 2012 U6 - https://doi.org/10.1037/a0026935 SN - 0278-7393 VL - 38 IS - 4 SP - 1069 EP - 1075 PB - American Psychological Association CY - Washington ER - TY - JOUR A1 - Zhou, Wei A1 - Kliegl, Reinhold A1 - Yan, Ming T1 - A validation of parafoveal semantic information extraction in reading Chinese JF - Journal of research in reading : a journal of the United Kingdom Reading Association N2 - Parafoveal semantic processing has recently been well documented in reading Chinese sentences, presumably because of language-specific features. However, because of a large variation of fixation landing positions on pretarget words, some preview words actually were located in foveal vision when readers' eyes landed close to the end of the pretarget words. None of the previous studies has completely ruled out a possibility that the semantic preview effects might mainly arise from these foveally processed preview words. This case, whether previously observed positive evidence for parafoveal semantic processing can still hold, has been called into question. Using linear mixed models, we demonstrate in this study that semantic preview benefit from word N+1 decreased if fixation on pretarget word N was close to the preview. We argue that parafoveal semantic processing is not a consequence of foveally processed preview words. KW - semantic KW - preview benefit KW - reading KW - Chinese Y1 - 2013 U6 - https://doi.org/10.1111/j.1467-9817.2013.01556.x SN - 0141-0423 VL - 36 IS - 2 SP - S51 EP - S63 PB - Wiley-Blackwell CY - Hoboken ER -