Skip to main content

Advertisement

SpringerLink
Log in

TA-GAN: transformer-driven addiction-perception generative adversarial network

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

The identification of addiction-related brain connections using functional magnetic resonance imaging (fMRI) is essential for comprehending the mechanisms of addiction. However, it is a challenge to effectively identify addiction-related brain connections using fMRI for traditional methods. In this work, the transformer-driven addiction-perception generative adversarial network (TA-GAN) is proposed to identify brain connectivity associated with nicotine addiction. In particular, the generator of TA-GAN takes into account that the convolutional neural network (CNN) can capture the local spatial features between brain regions, while the transformer specializes in extracting global brain connectivity information. Specifically, the external encoder-decoder structure aims to extract and reconstruct representations of brain region features. The transformer structure is implemented to extract global dependencies between brain region features. The discriminator is frequently overfitting when Generative Adversarial Networks (GANs) are trained with insufficient data. We proposed an adaptive discriminator enhancement mechanism that allows the discriminator to acquire addiction-related brain connections with limited data volume efficiently. Validation results on rat nicotine addiction data show that our proposed method achieves promising results in both qualitative and quantitative measurements.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Data availability

The datasets analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. Acharya UR, Fernandes SL, WeiKoh JE, Ciaccio EJ, Fabell MKM, Tanik UJ, Rajinikanth V, Yeong CH (2019) Automated detection of alzheimer’s disease using brain mri images-a study with various feature extraction techniques. J Med Syst 43(9):1–14

    Article  Google Scholar 

  2. Allen EA, Damaraju E, Plis SM, Erhardt EB, Eichele T, Calhoun VD (2014) Tracking whole-brain connectivity dynamics in the resting state. Cereb Cortex 24(3):663–676

    Article  Google Scholar 

  3. Beaglehole R, Bates C, Youdan B, Bonita R (2019) Nicotine without smoke: fighting the tobacco epidemic with harm reduction. Lancet 394(10200):718–720

    Article  Google Scholar 

  4. Björnholm L, Nikkinen J, Kiviniemi V, Niemelä S, Drakesmith M, Evans J, Pike GB, Richer L, Pausova Z, Veijola J et al (2020) Prenatal exposure to maternal cigarette smoking and structural properties of the human corpus callosum. Neuroimage 209:116477

    Article  Google Scholar 

  5. Bruijnzeel AW, Alexander JC, Perez PD, Bauzo-Rodriguez R, Hall G, Klausner R, Guerra V, Zeng H, Igari M, Febo M (2015) Acute nicotine administration increases bold fmri signal in brain regions involved in reward signaling and compulsive drug intake in rats. Int J Neuropsychopharmacol. https://doi.org/10.1093/ijnp/pyu011

    Article  Google Scholar 

  6. Brynildsen JK, Lee BG, Perron IJ, Jin S, Kim SF, Blendy JA (2018) Activation of ampk by metformin improves withdrawal signs precipitated by nicotine withdrawal. Proc Nat Acad Sci 115(16):4282–4287

    Article  Google Scholar 

  7. Ghasemzadeh Z, Sardari M, Javadi P, Rezayof A (2020) Expression analysis of hippocampal and amygdala creb-bdnf signaling pathway in nicotine-induced reward under stress in rats. Brain Res 1741:146885

    Article  Google Scholar 

  8. Hall BJ, Slade S, Allenby C, Kutlu MG, Levin ED (2015) Neuro-anatomic mapping of dopamine d1 receptor involvement in nicotine self-administration in rats. Neuropharmacology 99:689–695

    Article  Google Scholar 

  9. Hartmann-Boyce J, Chepkin SC, Ye W, Bullen C, Lancaster T (2018) Nicotine replacement therapy versus control for smoking cessation. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD000146.pub5

    Article  Google Scholar 

  10. Haugg A, Manoliu A, Sladky R, Hulka LM, Kirschner M, Brühl AB, Seifritz E, Quednow BB, Herdener M, Scharnowski F (2022) Disentangling craving-and valence-related brain responses to smoking cues in individuals with nicotine use disorder. Addict Biol 27(1):e13083

    Article  Google Scholar 

  11. Heeger DJ, Ress D (2002) What does fmri tell us about neuronal activity? Nat Rev Neurosci 3(2):142–151

    Article  Google Scholar 

  12. Hu S, Lei B, Wang S, Wang Y, Feng Z, Shen Y (2021) Bidirectional mapping generative adversarial networks for brain mr to pet synthesis. IEEE Trans Med Imaging 41(1):145–157

    Article  Google Scholar 

  13. Hu S, Shen Y, Wang S, Lei B (2020) Brain mr to pet synthesis via bidirectional generative adversarial network. International conference on medical image computing and computer-assisted intervention. Springer, Cham, pp 698–707

    Google Scholar 

  14. Hu S, Yu W, Chen Z, Wang S (2020) Medical image reconstruction using generative adversarial network for alzheimer disease assessment with class-imbalance problem. In: 2020 IEEE 6th international conference on computer and communications (ICCC), pp 1323–1327

  15. Hu S, Yuan J, Wang S (2019) Cross-modality synthesis from mri to pet using adversarial u-net with different normalization. In: 2019 international conference on medical imaging physics and engineering (ICMIPE), pp 1–5

  16. Hu Y, Fang Z, Yang Y, Rohlsen-Neal D, Cheng F, Wang J (2018) Analyzing the genes related to nicotine addiction or schizophrenia via a pathway and network based approach. Sci Rep 8(1):1–10

    Google Scholar 

  17. Jiang Y, Chang S, Wang Z (2021) Transgan: two pure transformers can make one strong gan, and that can scale up. Adv Neural Inf Process Syst 34:14745–14758

    Google Scholar 

  18. Karras T, Aittala M, Hellsten J, Laine S, Lehtinen J, Aila T (2020) Training generative adversarial networks with limited data. Adv Neural Inf Process Syst 33:12104–12114

    Google Scholar 

  19. Keeley RJ, Hsu LM, Brynildsen JK, Lu H, Yang Y, Stein EA (2020) Intrinsic differences in insular circuits moderate the negative association between nicotine dependence and cingulate-striatal connectivity strength. Neuropsychopharmacology 45(6):1042–1049

    Article  Google Scholar 

  20. Koob GF (1999) The role of the striatopallidal and extended amygdala systems in drug addiction. Ann NY Acad Sci 877(1):445–460

    Article  Google Scholar 

  21. Koukouli F, Rooy M, Tziotis D, Sailor KA, O’Neill HC, Levenga J, Witte M, Nilges M, Changeux JP, Hoeffer CA et al (2017) Nicotine reverses hypofrontality in animal models of addiction and schizophrenia. Nat Med 23(3):347–354

    Article  Google Scholar 

  22. Levin ED, Hall BJ, Rezvani AH (2015) Heterogeneity across brain regions and neurotransmitter interactions with nicotinic effects on memory function. The Neurobiology and Genetics of Nicotine and Tobacco. Springer, Cham, pp 87–101

    Chapter  Google Scholar 

  23. Lin CH, Yumer E, Wang O, Shechtman E, Lucey S (2018) St-gan: spatial transformer generative adversarial networks for image compositing. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 9455–9464

  24. Luo Y, Wang Y, Zu C, Zhan B, Wu X, Zhou J, Shen D, Zhou L (2021) 3d transformer-gan for high-quality pet reconstruction. In: International conference on medical image computing and computer-assisted intervention, Springer, pp 276–285

  25. Mo LF, Wang SQ (2009) A variational approach to nonlinear two-point boundary value problems. Nonlinear Anal Theory Method Appl 71(12):e834–e838

    Article  MathSciNet  MATH  Google Scholar 

  26. Nega S, Marquez P, Hamid A, Ahmad SM, Lutfy K (2020) The role of pituitary adenylyl cyclase activating polypeptide in affective signs of nicotine withdrawal. J Neurosci Res 98(8):1549–1560

    Article  Google Scholar 

  27. Pan J, Lei B, Shen Y, Liu Y, Feng Z, Wang S (2021) Characterization multimodal connectivity of brain network by hypergraph gan for alzheimer’ s disease analysis. In: Chinese conference on pattern recognition and computer vision (PRCV), Springer, pp 467–478

  28. Pan S, Hu R, Long G, Jiang J, Yao L, Zhang C (2018) Adversarially regularized graph autoencoder for graph embedding. In: IJCAI international joint conference on artificial intelligence

  29. Perry E, Morris C, Court J, Cheng A, Fairbairn A, McKeith I, Irving D, Brown A, Perry R (1995) Alteration in nicotine binding sites in parkinson’s disease, lewy body dementia and alzheimer’s disease: possible index of early neuropathology. Neuroscience 64(2):385–395

    Article  Google Scholar 

  30. Petri G, Expert P, Turkheimer F, Carhart-Harris R, Nutt D, Hellyer PJ, Vaccarino F (2014) Homological scaffolds of brain functional networks. J R Soc Interface 11(101):20140873

    Article  Google Scholar 

  31. Pushparaj A, Kim AS, Musiol M, Trigo JM, Le Foll B (2015) Involvement of the rostral agranular insular cortex in nicotine self-administration in rats. Behav Brain Res 290:77–83

    Article  Google Scholar 

  32. Schulz MA, Yeo B, Vogelstein JT, Mourao-Miranada J, Kather JN, Kording K, Richards B, Bzdok D (2020) Different scaling of linear models and deep learning in ukbiobank brain images versus machine-learning datasets. Nat Commun 11(1):1–15

    Article  Google Scholar 

  33. Smith LC, Kallupi M, Tieu L, Shankar K, Jaquish A, Barr J, Su Y, Velarde N, Sedighim S, Carrette LL et al (2020) Validation of a nicotine vapor self-administration model in rats with relevance to electronic cigarette use. Neuropsychopharmacology 45(11):1909–1919

    Article  Google Scholar 

  34. Smolka MN, Bühler M, Klein S, Zimmermann U, Mann K, Heinz A, Braus DF (2006) Severity of nicotine dependence modulates cue-induced brain activity in regions involved in motor preparation and imagery. Psychopharmacology 184(3):577–588

    Article  Google Scholar 

  35. Stolerman IP, Jarvis M (1995) The scientific case that nicotine is addictive. Psychopharmacology 117(1):2–10

    Article  Google Scholar 

  36. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Ł, Polosukhin I (2017) Attention is all you need. Adv Neural Inf Process Syst 30:1–5

    Google Scholar 

  37. Wang H, Shen Y, Wang S, Xiao T, Deng L, Wang X, Zhao X (2019) Ensemble of 3d densely connected convolutional network for diagnosis of mild cognitive impairment and alzheimer’s disease. Neurocomputing 333:145–156

    Article  Google Scholar 

  38. Wang S, Shen Y, Chen W, Xiao T, Hu J (2017) Automatic recognition of mild cognitive impairment from mri images using expedited convolutional neural networks. International conference on artificial neural networks. Springer, Cham, pp 373–380

    Google Scholar 

  39. Wang S, Shen Y, Zeng D, Hu Y (2018) Bone age assessment using convolutional neural networks. In: 2018 International conference on artificial intelligence and big data (ICAIBD), pp 175–178

  40. Wang S, Wang H, Cheung AC, Shen Y, Gan M (2020) Ensemble of 3d densely connected convolutional network for diagnosis of mild cognitive impairment and alzheimer’ s disease. Deep learning applications. Springer, Singapore, pp 53–73

    Chapter  Google Scholar 

  41. Wang S, Wang H, Shen Y, Wang X (2018) Automatic recognition of mild cognitive impairment and alzheimers disease using ensemble based 3d densely connected convolutional networks. In: 2018 17th IEEE International conference on machine learning and applications (ICMLA), pp 517–523

  42. Wang SQ (2009) A variational approach to nonlinear two-point boundary value problems. Comput Math Appl 58(11–12):2452–2455

    Article  MathSciNet  MATH  Google Scholar 

  43. Wolfman SL, Gill DF, Bogdanic F, Long K, Al-Hasani R, McCall JG, Bruchas MR, McGehee DS (2018) Nicotine aversion is mediated by gabaergic interpeduncular nucleus inputs to laterodorsal tegmentum. Nat Commun 9(1):1–11

    Article  Google Scholar 

  44. Yang S, Zhou D, Cao J, Guo Y (2022) Rethinking low-light enhancement via transformer-gan. IEEE Signal Process Lett 29:1082–1086

    Article  Google Scholar 

  45. You S, Lei B, Wang S, Chui CK, Cheung AC, Liu Y, Gan M, Wu G, Shen Y (2022) Fine perceptive gans for brain mr image super-resolution in wavelet domain. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2022.3153088

    Article  Google Scholar 

  46. Yu S, Wang S, Xiao X, Cao J, Yue G, Liu D, Wang T, Xu Y, Lei B (2020) Multi-scale enhanced graph convolutional network for early mild cognitive impairment detection. In: International conference on medical image computing and computer-assisted intervention, Springer, pp 228–237

  47. Yu W, Lei B, Ng MK, Cheung AC, Shen Y, Wang S (2021) Tensorizing gan with high-order pooling for alzheimer’s disease assessment. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3063516

    Article  Google Scholar 

  48. Yu W, Lei B, Wang S, Liu Y, Feng Z, Hu Y, Shen Y, Ng MK (2022) Morphological feature visualization of alzheimer’s disease via multidirectional perception gan. IEEE Trans Neural Netw Learn Syst. https://doi.org/10.1109/TNNLS.2021.3118369

    Article  Google Scholar 

  49. Zhang B, Gu S, Zhang B, Bao J, Chen D, Wen F, Wang Y, Guo B (2022) Styleswin: transformer-based gan for high-resolution image generation. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11304–11314

  50. Zhang H, Zhang Z, Odena A, Lee H (2019) Consistency regularization for generative adversarial networks. In: International conference on learning representations

  51. Zhao Z, Singh S, Lee H, Zhang Z, Odena A, Zhang H (2021) Improved consistency regularization for gans. In: Proceedings of the AAAI conference on artificial intelligence, pp 11033–11041

  52. Zuo Q, Lei B, Shen Y, Liu Y, Feng Z, Wang S (2021) Multimodal representations learning and adversarial hypergraph fusion for early alzheimer’ s disease prediction. In: Chinese conference on pattern recognition and computer vision (PRCV), Springer, pp 479–490

Download references

Acknowledgements

This work was supported by the National Natural Science Foundations of China under Grant 62172403, 61872351, the Distinguished Young Scholars Fund of Guangdong under Grant 2021B1515020019, the Excellent Young Scholars of Shenzhen under Grant RCYX20200714114641211 and Shenzhen Key Basic Research Project under Grant JCYJ20200109115641762.

Author information

Authors and Affiliations

  1. Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, 518055, China

    Changhong Jing, Changwei Gong, Zuxin Chen & Shuqiang Wang

  2. University of Chinese Academy of Sciences, Beijing, 100049, China

    Changhong Jing & Changwei Gong

  3. School of Biomedical Engineering, Shenzhen University, Shenzhen, 518060, China

    Baiying Lei

Authors
  1. Changhong Jing
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Changwei Gong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zuxin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Baiying Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shuqiang Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shuqiang Wang.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jing, C., Gong, C., Chen, Z. et al. TA-GAN: transformer-driven addiction-perception generative adversarial network. Neural Comput & Applic 35, 9579–9591 (2023). https://doi.org/10.1007/s00521-022-08187-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-08187-0

Keywords

Search

Navigation