ESS-DIVE Data Package Structure To Do

[stephpenn1]

Note: Deadline for ESS-DIVE submission October 15

End Product: ESS-DIVE data package with corrected Level 2 datasets, multiple zip files (one zip per sample type - soil, sediment, water). Multiple files (e.g. pH, TCTN) or folders (e.g. CDOM, FTICR) within each zip

What the data package would like like, separate zip files per Analyte:

Metadata

• Metadata updates #19 Update missing Kit metadata for K041, K001, and K007
• Update IGSN metadata before ESS-DIVE submission #30 in accordance with sample id rep format

The Rest

• Sort datasets by kit_id before exporting #23
• Update EC1 Read Me File  #27 @amyerspigg
• check out flmd format, is this something we want to use?
• generally follow this csv re format
• Change license to CC-BY 4.0 #29
• As data files are completed (to level 2 stage), do thorough check for below criteria

[stephpenn1]

Each data file should meet the following criteria:

• File name: [Campaign]_[Sample Type]_[Analyte]_L2.csv
• Missing values are NA
• Kit IDs are sorted in order least to greatest
• Flag columns state reason for each NA value
• File is in flat CSV format
• No duplicate Kit_IDs

[stephpenn1]

Checklist for SP putting into folders

METADATA

• kit-level metadata
• collection-level metadata
• collection-level data
• igsn metadata

WATER

• Basic Water Quality (conductivity, pH, ORP, Alkalinity)
• Total Suspended Solids
• Major Anions (fluoride, chlorine, nitrate, nitrite, sulfate, bromide, phosphate)
• Major Cations (lithium, sodium, ammonium, potassium, magnesium, calcium)
• Dissolved organic carbon (NPOC/TDN datastream)
• Total dissolved nitrogen (NPOC/TDN datastream)
• High-resolution mass spectrometry (FTICR-MS)
• Colored Dissolved Organic Matter (CDOM)

SEDIMENT

• Oxygen concentration time-series
• GHGs
• Gravimetric water content
• Loss on ignition

SOIL

• pH, conductivity
• Total carbon and nitrogen (TC/TN Dataset To Do (for submission) #33)
• Oxygen concentration time-series
• GHGs
• Bulk density
• Gravimetric water content
• Loss on ignition

[amyerspigg]

ESS DIVE Submission checklist
https://ess-dive.lbl.gov/archive/

• Clean and organize datasets (see original issue post and steps for this)
• Compile submission metadata
• Dataset metadata (required to publish on ESS-DIVE) reporting format https://github.com/ess-dive-community/reporting-format-template-repo
• Dataset Title
• DOIs
• Abstract
• Keywords
• Data Variables
• Publication Date
• Data Usage Rights
• Project Affiliation
• Funding Organizations
• DOE contracts
• Related References
• Dataset Contact
• Dataset Creators
• Dataset Contributors
• Dates (start and end date)
• Location Description
• Bounding Box Coordinates
• Methods ("You may provide a citation for any related methods used that have been previously published, but we strongly recommend still including methods text in your dataset metadata that fully describe data collection and processing steps"

[amyerspigg]

@kaizadp / @peterregier who was doing the LOI check? I see several kits with no data for LOI that I THINK we should have samples for (based on the filtering of collected/not collected script PR wrote). All sediment:
K001
K007
K029
K051
K052
K056
K058

[amyerspigg]

Metadata @stephpenn1
K046 transition
K014 wetland

[amyerspigg]

Ok cool. I can't find the check list assignments since we didnt do them in github