Abstract

Real-time rendering of closed-loop visual environments is important for next-generation understanding of brain function and behaviour, but is often prohibitively difficult for non-experts to implement and is limited to few laboratories worldwide. We developed BonVision as an easy-to-use open-source software for the display of virtual or augmented reality, as well as standard visual stimuli. BonVision has been tested on humans and mice, and is capable of supporting new experimental designs in other animal models of vision. As the architecture is based on the open-source Bonsai graphical programming language, BonVision benefits from native integration with experimental hardware. BonVision therefore enables easy implementation of closed-loop experiments, including real-time interaction with deep neural networks, and communication with behavioural and physiological measurement and manipulation devices.

Data availability

BonVision is an open-source software package available to use under the MIT license. It can be downloaded through the Bonsai (bonsai-rx.org) package manager, and the source code is available at: github.com/bonvision/BonVision. All benchmark programs and data are available at https://github.com/bonvision/benchmarks. Installation instructions, demos and learning tools are available at: bonvision.github.io/.

Article and author information

Author details

  1. Gonçalo Lopes

    NeuroGears, London, United Kingdom
    Competing interests
    Gonçalo Lopes, Gonçalo Lopes is affiliated with NeuroGEARS Ltd. The author has no financial interests to declare..
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-0731-4945
  2. Karolina Farrell

    Experimental Psychology, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0707-2838
  3. Edward A B Horrocks

    Experimental Psychology, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
  4. Chi Yu Lee

    Experimental Psychology, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
  5. Mai M Morimoto

    Department of Experimental Psychology, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9654-3960
  6. Tomaso Muzzu

    Institute of Behavioural Neuroscience, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0018-8416
  7. Amalia Papanikolaou

    Institute of Behavioural Neuroscience, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
  8. Fabio R Rodrigues

    Experimental Psychology, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-4848-7167
  9. Thomas Wheatcroft

    Experimental Psychology, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
  10. Stefano Zucca

    Experimental Psychology, University College London, London, United Kingdom
    Competing interests
    No competing interests declared.
  11. Samuel G Solomon

    Experimental Psychology, University College London, London, United Kingdom
    For correspondence
    s.solomon@ucl.ac.uk
    Competing interests
    No competing interests declared.
  12. Aman B Saleem

    Experimental Psychology, University College London, London, United Kingdom
    For correspondence
    aman.saleem@ucl.ac.uk
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-7100-1954

Funding

Wellcome Trust (200501)

  • Aman B Saleem

Human Frontiers in Science Program (RGY0076/2018)

  • Aman B Saleem

Stavros Niarchos Foundation / Research to Prevent Blindness

  • Samuel G Solomon

Medical Research Council (R023808)

  • Samuel G Solomon
  • Aman B Saleem

Biotechnology and Biological Sciences Research Council (R004765)

  • Samuel G Solomon
  • Aman B Saleem

Wellcome Trust: OPen Research (200501/Z/16/A)

  • Aman B Saleem

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: All experiments were performed in accordance with the Animals (Scientific Procedures) Act 1986 (United Kingdom) and Home Office (United Kingdom) approved project and personal licenses. The experiments were approved by the University College London Animal Welfare Ethical Review Board under Project License 70/8637.

Human subjects: All procedures were approved by the Experimental Psychology Ethics Committee at University College London (Ethics Application EP/2019/002). We obtained informed consent, and consent to publish from all participants.

Copyright

© 2021, Lopes et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 3,242
    views
  • 291
    downloads
  • 26
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Gonçalo Lopes
  2. Karolina Farrell
  3. Edward A B Horrocks
  4. Chi Yu Lee
  5. Mai M Morimoto
  6. Tomaso Muzzu
  7. Amalia Papanikolaou
  8. Fabio R Rodrigues
  9. Thomas Wheatcroft
  10. Stefano Zucca
  11. Samuel G Solomon
  12. Aman B Saleem
(2021)
Creating and controlling visual environments using BonVision
eLife 10:e65541.
https://doi.org/10.7554/eLife.65541

Share this article

https://doi.org/10.7554/eLife.65541

Further reading

    1. Neuroscience
    Eun Joo Kim, Mi-Seon Kong ... Jeansok John Kim
    Research Article

    Pavlovian fear conditioning research suggests that the interaction between the dorsal periaqueductal gray (dPAG) and basolateral amygdala (BLA) acts as a prediction error mechanism in the formation of associative fear memories. However, their roles in responding to naturalistic predatory threats, characterized by less explicit cues and the absence of reiterative trial-and-error learning events, remain unexplored. In this study, we conducted single-unit recordings in rats during an ‘approach food-avoid predator’ task, focusing on the responsiveness of dPAG and BLA neurons to a rapidly approaching robot predator. Optogenetic stimulation of the dPAG triggered fleeing behaviors and increased BLA activity in naive rats. Notably, BLA neurons activated by dPAG stimulation displayed immediate responses to the robot, demonstrating heightened synchronous activity compared to BLA neurons that did not respond to dPAG stimulation. Additionally, the use of anterograde and retrograde tracer injections into the dPAG and BLA, respectively, coupled with c-Fos activation in response to predatory threats, indicates that the midline thalamus may play an intermediary role in innate antipredatory-defensive functioning.

    1. Neuroscience
    Yangang Li, Xinyun Zhu ... Yueming Wang
    Research Article

    In motor cortex, behaviorally relevant neural responses are entangled with irrelevant signals, which complicates the study of encoding and decoding mechanisms. It remains unclear whether behaviorally irrelevant signals could conceal some critical truth. One solution is to accurately separate behaviorally relevant and irrelevant signals at both single-neuron and single-trial levels, but this approach remains elusive due to the unknown ground truth of behaviorally relevant signals. Therefore, we propose a framework to define, extract, and validate behaviorally relevant signals. Analyzing separated signals in three monkeys performing different reaching tasks, we found neural responses previously considered to contain little information actually encode rich behavioral information in complex nonlinear ways. These responses are critical for neuronal redundancy and reveal movement behaviors occupy a higher-dimensional neural space than previously expected. Surprisingly, when incorporating often-ignored neural dimensions, behaviorally relevant signals can be decoded linearly with comparable performance to nonlinear decoding, suggesting linear readout may be performed in motor cortex. Our findings prompt that separating behaviorally relevant signals may help uncover more hidden cortical mechanisms.