Scientists increasingly rely on computational tools and techniques to collect, analyse and interpret experimental data and results (Foster, 2006) and they might use dozens of different computational tools in the course of a single project (Anderson et al., 2007). Many of the most useful programs have been developed by other scientists (Hannay et al., 2009; Morin and Sliz, 2013), but these scientists often have little or no time to support the widespread distribution of their software and/or to provide the support needed to install it on a variety of different hardware devices and operating systems. Consequently, as our reliance on software developed by other scientists increases, so do the costs and burdens of supporting this software. However, if these costs and burdens can be shared, they will fall, access to the software will increase, and new computational resources will emerge.

SBGrid (www.sbgrid.org) is a collaboration established in 2000 to provide the structural biology community with support for research computing. Such collaborations have traditionally been supported by public funding agencies (Finholt, 2003). However, SBGrid is unique in that its ongoing operations are funded exclusively by its members. By sharing the costs of research computing support across many research groups, SBGrid achieves efficiencies through economies of scale, the sharing of expertise and cooperation to promote common goals.

The primary service offered by SBGrid is the collection, deployment and maintenance of a comprehensive set of software and computational tools that are useful in structural biology research. The SBGrid software library is effectively a kind of scientific ‘app store’ that allows users to access a wide range of up-to-date applications without having to download, compile, configure, maintain or update software. Moreover, the SBGrid model holds the potential to ease the burdens and costs of providing support for research computing in any area of science that is reliant on computational tools and techniques, thus freeing up more time and resources for actual research.

The benefits of the shared approach

SBGrid began as a collaboration between a handful of structural biology laboratories in the north-eastern US to support software applications used in X-ray crystallography (see Box 1). As more laboratories joined the collaboration, SBGrid began supporting software used in other common structural biology techniques, and today offers a library of over 270 different scientific applications and software suites to more than 245 laboratories and research groups in 16 countries (see Figure 1).

Box 1

The origins and growth of SBGrid

SBGrid was started in 2000 by one of the present authors (Piotr Sliz) as a home-grown solution to the challenge of supporting and maintaining a few dozen X-ray crystallography applications run on SGI IRIX and Linux workstations in the laboratories of Stephen Harrison and the late Don Wiley at Harvard University and Children’s Hospital Boston, and Ya Ha and Karin Reinisch at Yale Medical School. This support included other existing collaborative software projects in X-ray crystallography such as CCP4 (Winn et al., 2011) and later PHENIX (Adams et al., 2010)—both of which are currently contributors to SBGrid.

In 2002, Sliz and Harrison relocated to Harvard Medical School, several additional research groups joined SBGrid and it initiated software support for electron microscopy (EM), nuclear magnetic resonance (NMR) and other structural biology techniques. It also began charging user-fees to recover operational costs. In 2004, in response to demand from Mac users, SBGrid re-compiled the majority of its applications to run under OS X, and today approximately 50% of members use Macs (see Box 2). In 2007, in an effort to support more computationally demanding applications, SBGrid established a Virtual Organization within the Open Science Grid.

2009 was notable as SBGrid established itself as an NIH-compliant non-profit service centre in the Department of Biological Chemistry and Molecular Pharmacology at Harvard Medical School, and developed a unified end-user license agreement (with the help of the Harvard University Office of Technology Development). The first pharmaceutical company laboratories (Genzyme, Novartis and Biogen) also joined. These commercial members are supported with a subset of applications in the SBGrid library suitably licensed for installation in for-profit laboratories. Several synchrotron beam lines also became members in 2009.

SBGrid also makes use of its position as active intermediary between software developers and structural biologists to undertake a variety of activities:

# regular seminars and webinars in which creators of popular programs can teach and interact with SBGrid member users, answer questions and demonstrate use of their applications. These sessions are also broadcast over the web and archived for later viewing.

# policy and advocacy on behalf of the wider research computing community (Morin et al., 2012a, 2012b).

# the organization of schools and workshops. To date there have been three schools/workshops in Boston and one in Heidelberg.

Figure 1

Download asset Open asset

SBGrid actively curates the software library, identifies new and useful software and applications, configures and compiles applications, and automatically installs the collection to computer workstations in member laboratories. SBGrid also continuously updates and upgrades programs in the collection with newer versions and bug fixes as they become available. This entire process is completely automated and transparent, requiring no input or maintenance from end-users. After members join SBGrid, all of the programs in the collection are installed and updated automatically and reside locally on member laboratory computers (see Box 2).

Box 2

Technical details

The SBGrid software deployment and update system, internally referred to as the ‘sync system’, uses a shell script wrapper around a common file synchronization tool called rsync to install and automatically update the UNIX software environment on a large number of internet-connected machines around the world. The system uses a MySQL database to build customized download lists that determine which software titles are available to a particular laboratory. For each application the database contains public information about that software (such as its URL and links to documentation) and information that is specific to SBGrid (such as the installation directory, and information on which groups are licensed to use the software). Each member laboratory is designated as being either non-profit, government, academic or commercial, and the database contains a set of associated download credentials for each research group.

The sync system uses this information to build a default list of applications that a member laboratory can access, and the rsync daemon on the SBGrid distribution server provides authenticated downloads of the software available in these ‘include files’. Client machines that host an installation of the SBGrid software environment run a shell script every 15 min via a cron job that performs a simple check over HTTP to see if updates are available and initiates the rsync download. SBGrid can initiate global updates that are applied to every installation, and it can also initiate a single site update in response to bug reports or requests for new software titles.

The software available on the client machines is organized into a single top-level directory with subdirectories for each operating system and CPU architecture combination (e.g., i386-linux, x86_64-linux, i386-mac, etc). Each application is installed in its own directory in the next level of the file system, and in each application directory each version of the application is installed in a separate subdirectory. This allows multiple versions of a single installed application. The software environment configures a single default version, but a simple user-controlled version switching mechanism is available so that users can, for example, select an older version to check prior results or work around bugs in newer versions.

The user initializes the SBGrid software environment by sourcing a single file into their UNIX shell, using provided configuration scripts for both sh and csh syntax shells. The shell environment does a number of tests to determine system type and then sets up a customized environment for each operating system depending on CPU type and operating system release. The sync system and software environment layout is flexible enough to accommodate the wide variety of IT environments that SBGrid member laboratories operate in and has proven to be robust and scalable.

SBGrid also provides the wider structural biology community with access to supercomputing facilities across the US in collaboration with the Open Science Grid (OSG: Pordes et al., 2007) via the SBGrid Science Portal. Currently, SBGrid provides access to two grid-enabled services: the Wide-Search Molecular Replacement (WSMR; Stokes-Rees and Sliz, 2010) service for determining crystallographic phase using the Phaser program (McCoy et al., 2007), and the Deformable Elastic Network (DEN) service for refining low-resolution electron density data (O’Donovan et al., 2012; Schröder et al., 2010).

SBGrid has also developed a prototype system for storage and transmission of large experimental datasets collected at synchrotron facilities (Stokes-Rees et al., 2012), and completed a pilot project with WeNMR to optimize cyber-infrastructure utilization between European and US computing facilities (Wassenaar et al., 2012).

Finally, to support the development of cutting edge structural biology software, SBGrid operates a Developer Support Program which, among other things, offers software developers letters of support for grant applications, software beta testing in selected member laboratories and access to programming tools and resources.

Collaborations like SBGrid provide benefits for the research community, software developers and institutions alike (see Figure 2). Member laboratories and end-users benefit directly from comprehensive licensing (see Box 3) and support for hundreds of software applications, each of which might otherwise demand significant time, expense and expertise to obtain, install and maintain. This centralized support means that software is maintained and updated on a regular basis, and it also reduces the problems associated with the high turnover of staff that is commonplace in academic environments. By offering access to a consistent and comprehensive set of research software, SBGrid promotes collaboration and reproducibility and, crucially, allows scientists to spend more of their time doing science.

Box 3

Licensing model

As part of its service to members, SBGrid consolidates licensing agreements for all software in the collection into a single end-user license agreement that users agree to when they join SBGrid. This simplifies license administration for software creators and saves end users and their institutional legal counsels from having to complete tens (or possibly hundreds) of individual license agreements.

SBGrid applications are classified into one of four categories, depending on the type of license chosen by the creator or owner of the software: (i) open source software (OSS); (ii) software that is freely available to academic members; (iii) software that is freely available to non-profit groups who are members of SBGrid; (iv) software subject to restrictions. Of the 275 software titles currently in the SBGrid library, 162 are offered under OSS licenses, and the majority of the remaining software is freely available to academic and non-profit members. For the very limited number of programs with restrictions imposed by the author or owner of the software, member laboratories must demonstrate license compliance before the application is installed.

This approach allows SBGrid to accommodate a variety of end-user types while complying with licensing terms of each program. For example, academic and non-profit members can access the entire collection by default (excluding applications with custom restrictions). For-profit members can access all OSS programs and any applications that permit free commercial use; however, they must provide SBGrid with proof of a valid license to access programs that have separate for-profit licensing agreements. Members with shared or mixed-use research environments, such as synchrotron beamlines, who often host both non-profit and for-profit users, are provided with multiple program trees each containing the appropriate subset of applications. These mixed-use facilities are then required to implement procedures for assuring that each category of user only has access to the appropriate program tree.

Figure 2

Download asset Open asset

The discovery of new applications is enhanced within SBGrid by comprehensive inclusion and continuous addition of new software based on aggregated community knowledge. The formation of a community of active and involved researchers and scientist software developers around the collaboration also makes possible the collective exploitation of research computing resources that might otherwise be beyond the means of any single member or institution (such as the US cyber-infrastructure for large-scale computing: see Box 2).

For developers, distributing software through collaborations like SBGrid relieves the significant burdens associated with the distribution of their programs and the provision of end-user support, thereby freeing them to focus on new research and scientific communication with end-users rather than on technical support issues. Program creators are assured that updates, improvements, bug-fixes and other development-side maintenance modifications are rapidly deployed, and developers are apprised of which research groups have access to their software, giving them information to more easily track citations and assess scientific impact for grant and funding purposes. Furthermore, popular scientific programs that the original creator may no longer be able and/or willing to actively support or distribute may be offered and supported by the collaboration, thereby extending the lifetime of useful research software and maximizing return on research investment.

For institutions, collaborations like SBGrid offer a simple and cost-effective solution to providing domain-specific, up-to-date research computing resources for specialized scientific fields independent of in-house IT and research computing expertise. Thus, in an era of shrinking IT budgets, difficulty hiring and retaining experienced staff and continually expanding demands on IT resources, initiatives like SBGrid extend the range and quality of software support while allowing local research computing departments to focus on core competencies and delivering common, foundational IT services (see Figure 2).

1. 1. Adams PD
   2. Afonine PV
   3. Bunkoczi G
   4. Chen VB
   5. Davis IW
   6. Echols N

   et al. (2010) PHENIX: a comprehensive Python-based system for macromolecular structure solution

   Acta Crystallogr D Biol Crystallogr 66:213–221.

   https://doi.org/10.1107/S0907444909052925

   • Google Scholar
2. 1. Anderson NR
   2. Ash JS
   3. Tarczy-Hornoch P

   (2007) A qualitative study of the implementation of a bioinformatics tool in a biological research laboratory

   Intl J Med Inform 76:821–828.

   https://doi.org/10.1016/j.ijmedinf.2006.09.022

   • Google Scholar
3. 1. Finholt TA

   (2003) Collaboratories as a new form of scientific organization

   Econ Innov New Technol 12:5–25.

   https://doi.org/10.1080/10438590303119

   • Google Scholar
4. 1. Foster I

   (2006) A two-way street to science’s future

   Nature 440:419.

   https://doi.org/10.1038/440419a

   • Google Scholar
5. 1. Hannay JE
   2. Langtangen HP
   3. MacLeod C
   4. Pfahl D
   5. Singer J
   6. Wilson G

   (2009) How do scientists develop and use scientific software?

   Software Eng Comput Sci Eng pp. 1–8.

   https://doi.org/10.1109/SECSE.2009.5069155

   • Google Scholar
6. 1. McCoy AJ
   2. Grosse-Kuntsleve RW
   3. Adams PD
   4. Winn MD
   5. Storoni LC
   6. Read RJ

   (2007) Phaser crystallographic software

   J Appl Cryst 40:658–674.

   https://doi.org/10.1107/S0021889807021206

   • Google Scholar
7. 1. Morin A
   2. Sliz P

   (2013) Structural biology computing: Lessons for the biomedical research sciences

   Biopolymers 99:809–816.

   https://doi.org/10.1002/bip.22343

   • Google Scholar
8. 1. Morin A
   2. Urban J
   3. Adams PD
   4. Foster I
   5. Sali A
   6. Baker D

   et al. (2012a) Shining light into black boxes

   Science 336:159–160.

   https://doi.org/10.1126/science.1218263

   • Google Scholar
9. 1. Morin A
   2. Urban J
   3. Sliz P

   (2012b) A quick guide to software licensing for the scientist-programmer

   PLoS Comput Biol 8:e1002598.

   https://doi.org/10.1371/journal.pcbi.1002598

   • Google Scholar
10. 1. O’Donovan DJ
    2. Stokes-Rees I
    3. Nam Y
    4. Blacklow SC
    5. Schröder GF
    6. Brunger AT

    et al. (2012) A grid-enabled web service for low-resolution crystal structure refinement

    Acta Crystallogr D Biol Crystallogr 68:261–267.

    https://doi.org/10.1107/S0907444912001163

    • Google Scholar
11. 1. Pordes R
    2. Petravick D
    3. Kramer B
    4. Olson D
    5. Livny M
    6. Roy A

    et al. (2007) The open science grid

    J Phys: Conf Ser 78:012057.

    https://doi.org/10.1088/1742-6596/78/1/012057

    • Google Scholar
12. 1. Schröder GF
    2. Levitt M
    3. Brunger AT

    (2010) Super-resolution biomolecular crystallography with low-resolution data

    Nature 464:1218–1222.

    https://doi.org/10.1038/nature08892

    • Google Scholar
13. 1. Stokes-Rees I
    2. Levesque I
    3. Murphy FV
    4. Yang W
    5. Deacon A
    6. Sliz P

    (2012) Adapting federated cyberinfrastructure for shared data collection facilities in structural biology

    J Synchrotron Radiat 19:462–467.

    https://doi.org/10.1107/S0909049512009776

    • Google Scholar
14. 1. Stokes-Rees I
    2. Sliz P

    (2010) Protein structure determination by exhaustive search of Protein Data Bank derived databases

    Proc Natl Acad Sci USA 107:21476–21481.

    https://doi.org/10.1073/pnas.1012095107

    • Google Scholar
15. 1. Wassenaar TA
    2. van Dijk M
    3. Lourerio-Ferreira N
    4. van der Schot G
    5. de Vries SJ
    6. Schmitz C

    et al. (2012) WeNMR: structural biology on the grid

    J Grid Computing 10:743–767.

    https://doi.org/10.1007/s10723-012-9246-z

    • Google Scholar
16. 1. Winn MD
    2. Ballard CC
    3. Cowtan KD
    4. Dodson EJ
    5. Emsley P
    6. Evans PR

    et al. (2011) Overview of the CCP4 suite and current developments

    Acta Crystallogr D Biol Crystallogr 67:235–242.

    https://doi.org/10.1107/S0907444910045749

    • Google Scholar

Author details

1. Andrew Morin

   SBGrid Consortium and the Department of Biological Chemistry and Molecular Pharmacology, Harvard Medical School, Boston, United States

   Competing interests

   The authors declare that no competing interests exist.

2. Ben Eisenbraun

   SBGrid Consortium and the Department of Biological Chemistry and Molecular Pharmacology, Harvard Medical School, Boston, United States

   Competing interests

   The authors declare that no competing interests exist.

3. Jason Key

   SBGrid Consortium and the Department of Biological Chemistry and Molecular Pharmacology, Harvard Medical School, Boston, United States

   Competing interests

   The authors declare that no competing interests exist.

4. Paul C Sanschagrin

   SBGrid Consortium and the Department of Biological Chemistry and Molecular Pharmacology, Harvard Medical School, Boston, United States

   Competing interests

   The authors declare that no competing interests exist.

5. Michael A Timony

   SBGrid Consortium and the Department of Biological Chemistry and Molecular Pharmacology, Harvard Medical School, Boston, United States

   Competing interests

   The authors declare that no competing interests exist.

6. Michelle Ottaviano

   SBGrid Consortium and the Department of Biological Chemistry and Molecular Pharmacology, Harvard Medical School, Boston, United States

   Competing interests

   The authors declare that no competing interests exist.

7. Piotr Sliz

   SBGrid Consortium and the Department of Biological Chemistry and Molecular Pharmacology, Harvard Medical School, Boston, United States

   For correspondence

   piotr_sliz@hms.harvard.edu

   Competing interests

   The authors declare that no competing interests exist.

• 3,414

  views

• 348

  downloads

• 948

  citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.