Data Submission Special Requirements

When preparing a submission, check to see if the data type is in the list below. Certain types of SeaBASS data submissions have special requirements. For example, some data files need conditionally required metadata headers, and some submissions require extra "checklist" documents. These requirements and several examples are listed below, sorted by data types. This list is growing and evolving and more data types will be added in the future.

Check if your submission type lists any required extra documents. These checklists are designed to standardize and preserve critical methods and analysis details that are needed for intercomparison, reprocessing, to make it easier for data users to assess the data quality and to consider them for satellite validation or inclusion in algorithm development datasets. We prefer you submit a plain text (.txt) document, but if multiple format versions are offered (e.g., rich text and plain text), pick your preference and fill out the necessary sections. Rename the file in a relevant way to make it unique (e.g., add the cruise name to the end of the file name), and add it to the other documents and calibration files that are part of your submission.

The special notes section for each data type highlights any necessary measurement-specific metadata (e.g., conditionally required headers), fields, or formatting.

This page also provides example submission sections containing model data files and documentation bundles to help you format different types of submissions. These files were picked from the archive or created to serve as references. Your files might look a bit different, but hopefully the examples are helpful as a starting place from which to further adapt or improve as needed.

Submission Instructions

This page provides instructions on how to submit data to SeaBASS as well as information about the SeaBASS File Format. If you are new to this process, please scroll down the page to the "How to Submit" section and review the steps involved. More details can be found in the other sections on this page and beneath the other topics under "Contribute Data" found in the main menu of the SeaBASS website.
 
The SeaBASS data format and structure were designed with the following in mind: To account for the continuous growth of the bio-optical data set and the wide variety of supported data types, the NASA Ocean Biology Processing Group felt it essential to develop efficient data ingestion and storage techniques. While this requires a specific data file format, the data protocols were designed to be as straightforward and effortless as possible on the part of the contributor, while still offering a useful format for internal efforts. The system was intended to meet the following conditions: simple data format, easily expandable and flexible enough to accommodate large data sets; global portability across multiple computer platforms; and web-accessible data holdings with sufficient security to limit access to authorized users.

Metadata Headers

This page provides an overview of the standardized metadata headers used in the SeaBASS (.sb) file format. Metadata headers preserve critical metadata and enable data organization and discoverability. Below is a brief general description of header formatting rules, followed by a comprehensive list and definition of standardized metadata keywords.

General Header Formatting Rules:

  • Required Start and End Tags: The block must begin with /begin_header and close with /end_header. The headers between them can be in any order.
  • Keyword-Value Pairs: Most headers consist of a keyword (from the standardized lists below) paired with value(s).
    • Example: /delimiter=comma
  • No Spaces Allowed: Headers must not contain whitespace. Use underscores (_) rather than spaces.
    • Multiple values: If listing multiple values, comma-separate them without spaces (e.g., /investigators=John_Smith,Mary_Miller).
    • Exception: Freeform comments begin with ! and may contain whitespace (e.g., ! This is a comment).
  • Handling Missing Header Values: If a required metadata value is unavailable, use NA (Not Applicable). (Note: Do not use NA in the Data Matrix; use your defined numeric /missing value instead).
  • Bracketed Units: Do not use bracketed units in headers, with the sole exception of time and location headers (e.g., [GMT] and [DEG]). All other units are implied by the SeaBASS standard metadata headers dictionaries.
  • Time and Location Ranges: The date, time, and location headers must reflect the minimum and maximum bounds of the file (e.g., the earliest time, the farthest north latitude).
  • Experiment and Cruise Names: Use consistent names if submitting to an existing project. New names should be selected thoughtfully. These names are very important for data organization and for grouping related datasets. Note: The experiment name is critical as it becomes part of the assigned Digital Object Identifier (DOI).

Header Categories: Many keyword headers are mandatory. However, not all headers are treated equally when creating .sb files:

  • Required: Must be included in every SeaBASS file.
  • Conditionally Required: Must be included for specific types of measurements.
  • Optional: Should be included if relevant, but not required.
  • Comments: Freeform comments may be included as lines beginning with !.

Additional information and a full example can be found below.

FCHECK

To assist with the standardization of SeaBASS data files, the SIMBIOS Project developed feedback software, named FCHECK, to evaluate the format of submitted data files. Since then, it has been rebuilt from the ground up by the SeaBASS development team to make it available to the end-users. There are multiple ways to access this software, as explained further below. Using FCHECK, contributors may evaluate the format of their SeaBASS-compatible files prior to submission.
 
FCHECK scans files for common syntax problems, missing header information, data values outside of typical ranges, nonstandard field names or units, and also detects various other issues. It will report a summary of the types of problems detected (if any) among all the files it scanned, as well as a more detailed breakdown of issues found in each individual file. Problems are classified as either errors or warnings, depending on their severity. Errors are critical problems that must be addressed before files can be archived. Warnings should be fixed if possible, but some of them are subjective or optional and may be disregarded.

Plankton and Particles Flow Cytometry

The guidelines presented below will assist the user in submitting flow cytometry data to SeaBASS. The format described herein allows for Level 2 submissions of flow cytometry data, meaning sums of total abundances of each phytoplankton or bacterial group. Specific metadata headers and field names have been developed for these data. Additionally, detailed instructions are given for the submission of documentation (protocol document, checklist, etc.), images, and additional ancillary files. Greater detail regarding the development and application of these guidelines and requirements can be found in Neeley et al., 2023.

 

Neeley, A.R., Soto-Ramos, I. and Proctor, C. (2023) Standards and Best Practices for Reporting Flow Cytometry Observations: a technical manual, Version 1.1. Greenbelt, MD., NASA Goddard Space Flight Center, 31pp. DOI: http://dx.doi.org/10.25607/OBP-1864.2. 

readsb (Python)

SB_support.py is a Python module containing a set of classes designed to open, read, and manipulate data files that are in SeaBASS file format. While many of Python's built-in functions may be used to read SeaBASS files, this module leverages Python libraries and tools to efficiently read, sort, mask, and return the contained data for easy use without errors or significant intervention. Using this function, data outputs will be returned as data structures containing the file's header information (metadata) as an array of strings, the file's comments as an array of strings, the file's missing data, above detection limit, and below detection limit values (if present), the file's variable and unit lists as an Ordered Dictionary indexed by variable name, and the file's data as an Ordered Dictionary indexed by variabile name. Additionally, optional arguments flags that may be toggled are mask_missing, mask_above_detection_limit, and mask_below_detection_limit (all set true by default), which remove the relevant header-defined fill values, replacing them with NaN.

SeaBASS Software Tools

A number of custom tools have been developed to work with SeaBASS formatted files in a few programming languages, including Perl, Python, MATLAB, etc.

Standardized Fields and Units

Below is a table of the standard field names and associated units for use in submitting data to the SeaBASS bio-optical archive. The field names are not case sensitive. Use the search bar or the find function in your browser to search the table for words or patterns found in the field names, units or descriptions. Please contact SeaBASS staff if you want to discuss adding new fields.

 

Special notes regarding wavelength-specific measurements: There are two different ways to indicate wavelengths (nm) in a SeaBASS file. If metadata such as date, location, or depth vary within the data, then append the wavelength number to the field name for every measurement combination. For example, downwelling irradiance ('Ed') measured at 412.3 nm is 'Ed412.3' (listed as separate columns alongside other Ed measurements, like Ed416.2, Ed419, etc.) Alternately, if date, location, and depth are assumed to be approximately constant for all measurements in the file, then use the field 'wavelength' to provide a column of the measured wavelengths and don't include them as part of the field names (this pivoted layout is commonly used for reporting spectrophotometric measurements or other measurements that use the data_type=scan keyword).

 

Two additional tables are provided below (Field Name Suffixes & Modifiers). The reusable naming conventions in those tables are used to create new field names without having to add dozens or hundreds of variations to the Table of Field Names and Units. For example, "_sd" (for standard deviation) appears in the table of suffixes and may be appended to any existing SeaBASS field name (e.g., "chl_sd" or "Rrs510_sd".) Similarly, field-specific names can be created ad infinitum using _bincount (i.e., number of averaged samples), and _quality. The table of modifiers allows extra information to be part of field names, typically to indicate versions of measurements that are either more specific or modified. For example, modifiers are used to denote size-fractionated measurements (see _#umfilt and _#umprefilt), specific excitation or emission wavelengths, or polarized measurements. Field names may be constructing by combing entries from multiple tables, with any applicable wavelength first, followed by "Modifiers", followed by a "Suffix".

 

Notes on HPLC pigment field names

Plankton and particles imagery (IFCB, UVP)

The guidelines presented below will assist the user in submitting imaging-in-flow or submersible microscopic data to SeaBASS. Specific metadata headers and field names have been developed for plankton and other particle data. Additionally, detailed instructions are given for the submission of documentation (protocol document, checklist, etc.), images, and additional ancillary files. The submitter must indicate in the checklist whether all ROIs in a sample were annotated. Greater detail regarding the development and application of these guidelines and requirements can be found in Neeley et al., 2021.

 
**Neeley, A., S. Beaulieu, C. Proctor, I. Cetinic, J. Futrelle, I. Soto Ramos, H. Sosik, E. Devred, L. Karp-Boss, M. Picheral, N. Poulton, C. Roesler, and A. Shepherd. (2021) Standards and practices for reporting plankton and other particle observations from images. 38 pp. DOI:10.1575/1912/27377 

NASA Particle Absorption Workshop

This temporary page has been set up for documents and information that will be shared at the NASA Particle Absorption Workshop (June 2014).