Skip to content

Managing Data

Learning Objectives

After this lesson, you should be able to:

  • Recognize data as the foundation of open science and be able to describe the "life cycle of data"
  • Use self-assessments to evaluate your current data management practices
  • Cite tools and resources to improve your data management practices
  • Know the biggest challenge to effective data management

Why should you care about data management?

Ensuring that data are effectively organized, shared, and preserved is critical to making your science impactful, efficient, and open.

Don't forget about Data Management

The biggest challenge to data management is making it an afterthought.

Unfortunately, poor data management doesn't have a high upfront cost. You can do substantial work before realizing you are in trouble. Like a swimmer in rip current, by the time you realize you are in trouble, you may already be close to drowning.

The solution? Make data management the first thing you consider when starting a research project. It also needs to be a policy you institute right away for your research group.

How would you answer?
  • If you give your data to a colleague who has not been involved with your project, would they be able to make sense of it? Would they be able to use it properly?
  • If you come back to your own data in five years, will you be able to make sense of it? Will you be able to use it properly?
  • When you are ready to publish a paper, is it easy to find all the correct versions of all the data you used and present them in a comprehensible manner?

Well-managed Data Sets:



Data Types

Different types of data require different management practices. What are some data types and sources you might use in your work? (Adapted from DMP Tool Data management general guidance)

Data Types

  • Text: field or laboratory notes, survey responses
  • Numeric: tables, counts, measurements
  • Audiovisual: images, sound recordings, video
  • Models, computer code
  • Discipline-specific: FASTA in biology, FITS in astronomy, CIF in chemistry
  • Instrument-specific: equipment outputs

Data Sources

Observational

  • Captured in real-time, typically outside the lab
  • Usually irreplaceable and therefore the most important to safeguard
  • Examples: Sensor readings, telemetry, survey results, images

Experimental

  • Typically generated in the lab or under controlled conditions
  • Often reproducible, but can be expensive or time-consuming
  • Examples: gene sequences, chromatograms, magnetic field readings

Simulation

  • Machine generated from test models
  • Likely to be reproducible if the model and inputs are preserved
  • Examples: climate models, economic models

Derived / Compiled

  • Generated from existing datasets
  • Reproducible, but can be very expensive and time-consuming
  • Examples: text and data mining, compiled database, 3D models



Data Self-assessment

Activity

In small groups, discuss the following questions. You will be provided with a space for documenting our shared answers.

1. What are the two or three data types that you most frequently work with? - Think about the sources (observational, experimental, simulated, compiled/derived) - Also consider the formats (tabular, sequence, database, image, etc.)

2. What is the scale of your data?

Tip

We often talk about the scale of data using the "Three V's":

  • Volume: Size of the data (MBs, GBs, TBs); can also include how many files (e.g dozens of big files, or millions of small ones)
  • Velocity: How quickly are these data produced and analyzed? A lot coming in a single batch infrequently, or, a constant small amount of data that must be rapidly analyzed?
  • Variety: How many different data types (raw files? databases?) A fourth V (Veracity) captures the need to make decisions about data processing (i.e., separating low- and high-quality data)

3. What is your strategy for storing and backing up your data?

4. What is your strategy for verifying the integrity of your data? (i.e. verifying that your data has not be altered)

5. What is your strategy for searching your data?

6. What is your strategy for sharing (and getting credit for) your data? (i.e. How will do you share with your community/clients? How is that sharing documented? How do you evaluate the impact of data shared? )



The Data Life Cycle

Tip

The Data Life Cycle

Data management is the set of practices that allow researchers to effectively and efficiently handle data throughout the data life cycle. Although typically shown as a circle (below) the actually life cycle of any data item may follow a different path, with branches and internal loops. Being aware of your data's future helps you plan how to best manage them.

lifecycle

Image from Strasser et al.

The summary below is adapted from the excellent DataONE best practices primer.

Plan

  • Describe the data that will be compiled, and how the data will be managed and made accessible throughout its lifetime
  • A good plan considers each of the stages below

Collect

  • Have a plan for data organization in place before collecting data
  • Collect and store observation metadata at the same time you collect the metadata
  • Take advantage of machine generated metadata

Assure

  • Record any conditions during collection that might affect the quality of the data
  • Distinguish estimated values from measured values
  • Double check any data entered by hand
  • Perform statistical and graphical summaries (e.g., max/min, average, range) to check for questionable or impossible values.
  • Mark data quality, outliers, missing values, etc.

Describe

  • Comprehensive data documentation (i.e. metadata) is the key to future understanding of data. Without a thorough description of the context of the data, the context in which they were collected, the measurements that were made, and the quality of the data, it is unlikely that the data can be easily discovered, understood, or effectively used.

  • Thoroughly describe the dataset (e.g., name of dataset, list of files, date(s) created or modified, related datasets) including the people and organizations involved in data collection (e.g., authors, affiliations, sponsor). Also include:

    -   An [ORCID](https://orcid.org/) (obtain one if you don't have one).
-   The scientific context (reason for collecting the data, how they were collected, equipment and software used to generate the data, conditions during data collection, spatial and temporal resolution)
-   The data themselves
-   How each measurement was produced
-   Units
-   Format
-   Quality assurance activities
-   Precision, accuracy, and uncertainty

Some metadata standards you may want to consider:

Ontologies provide standardization for metadata values:

Preserve

In general, data must be preserved in an appropriate long-term archive (i.e. data center). Here are some examples:

  • Sequence data should go to a national repository, frequently NCBI
  • Identify data with value - it may not be necessary to preserve all data from a project
  • The CyVerse Data Commons provides a place to publish and preserve data that was generated on or can be used in CyVerse, where no other repository exists.
  • See lists of repositories at FAIRSharing.org
  • See lists of repositories at Data Dryad
  • Github repos can get DOIs through Zenodo
  • Be aware of licensing and other intellectual property issues
    • Repositories will require some kind of license, often the least restrictive (see for example Creative Commons)
    • Repositories are unlikely to enforce reuse restrictions, even if you apply them.

Discover

Integrate

  • Data integration is a lot of work
  • Standards and ontologies are key to future data integration
  • Know the data before you integrate them
  • Don't trust that two columns with the same header are the same data
  • Properly cite the data you reuse!
  • Use DOIs (Digital Object Identifiers) wherever possible

Analyze

  • Follow open science principles for reproducible analyses (CyVerse, RStudio, notebooks, IDEs)
  • State your hypotheses and analysis workflow before collecting data. Tools like Open Science Framework (OSF) allow you to make this public.
  • Record all software, parameters, inputs, etc.

References and Resources

DataOne best practices

Center for Open Science



The Principles of Open Data Management

Learning Objectives

  • Recall the meanings of FAIR, CARE, and TRUST
  • Understand why FAIR are ideals (rather than hard rules)
  • Use self-assessments to evaluate the FAIR-ness of your data
Why do we have data principles?

FAIR, CARE, and TRUST are collections of principles from different types of communities with different objectives.

Ultimately, different communities within different scientific disciplines must work to interpret and implement these principles. Because technologies change quickly, focusing on the desired end result allows FAIR to be applied to a variety of situations now and in the foreseeable future.

FAIR Principles

In 2016, the FAIR Guiding Principles for scientific data management and stewardship were published in Scientific Data. Read it.

Findable

  • F1. (meta)data are assigned a globally unique and persistent identifier
  • F2. data are described with rich metadata (defined by R1 below)
  • F3. metadata clearly and explicitly include the identifier of the data it describes
  • F4. (meta)data are registered or indexed in a searchable resource

Accessible

  • A1. (meta)data are retrievable by their identifier using a standardized communications protocol
  • A2. the protocol is open, free, and universally implementable
  • A3. the protocol allows for an authentication and authorization procedure, where necessary
  • A4. metadata are accessible, even when the data are no longer available

Interoperable

  • I1. (meta)data use a formal, accessible, shared, and broadly applicable language for knowledge representation.
  • I2. (meta)data use vocabularies that follow FAIR principles
  • I3. (meta)data include qualified references to other (meta)data

Reusable

  • R1. meta(data) are richly described with a plurality of accurate and relevant attributes
  • R2. (meta)data are released with a clear and accessible data usage license
  • R3. (meta)data are associated with detailed provenance
  • R4. (meta)data meet domain-relevant community standard

Open vs. Public vs. FAIR

FAIR does not demand that data be open: See one definition of "Open":

http://opendefinition.org/

How to be more FAIR with your data?

This is a question that only you can answer, that is because it depends on (among other things)

  1. Your datatypes and existing standards for what constitutes acceptable data management will vary.

  2. The extent to which your scientific community has implemented FAIR: Some disciplines have significant guidelines on FAIR, while others have not addressed the subject in any concerted way.

  3. Your level of technical skills: Some approaches to implementing FAIR may require technical skills you may not yet feel comfortable with.

While a lot is up to you, the first step is to evaluate how FAIR you think your data are:

Self Assessment

Thinking about a dataset you work with, complete the ARDC FAIR assessment

What did you learn about yourself and your data?

CARE Principles

The CARE Principles for Indigenous Data Governance were drafted at the International Data Week and Research Data Alliance Plenary co-hosted event "Indigenous Data Sovereignty Principles for the Governance of Indigenous Data Workshop," 8 November 2018, Gaborone, Botswana.

Collective Benefit

  • C1. For inclusive development and innovation
  • C2. For improved governance and citizen engagement
  • C3. For equitable outcomes

Authority to Control

  • A1. Recognizing rights and interests
  • A2. Data for governance
  • A3. Governance of data

Responsibility

  • R1. For positive relationships
  • R2. For expanding capability and capacity
  • R3. For Indigenous languages and worldviews

Ethics

  • E1. For minimizing harm and maximizing benefit
  • E2. For justice
  • E3. For future use

Connecting FOSS and CARE: FOSS Alumnus Dr. Lydia Jennings{target=_blank

Dr. Lydia Jennings was a Data Science Fellow at the University of Arizona who attended FOSS in Fall of 2022.

Lydia graduated from the University of Arizona's Department of Evironemtal Sciences in 2023 and has published a paper on the application of the CARE principles to ecology and biodiversity research.

Appying the 'CARE Principles for Indigenous Data Governance' to ecology and biodiversity Nature Ecology & Evolution, 2023.

More Resources for CARE & Indigenous Rights

TRUST Principles

Lin et al. 2020 The TRUST Principles for digital repositories

Transparency

  • Terms of use, both for the repository and for the data holdings.

  • Minimum digital preservation timeframe for the data holdings.

  • Any pertinent additional features or services, for example the capacity to responsibly steward sensitive data.

Responsibility

  • Adhering to the designated community’s metadata and curation standards, along with providing stewardship of the data holdings e.g. technical validation, documentation, quality control, authenticity protection, and long-term persistence.

  • Providing data services e.g. portal and machine interfaces, data download or server-side processing.

  • Managing the intellectual property rights of data producers, the protection of sensitive information resources, and the security of the system and its content.

User focus

  • Implementing relevant data metrics and making these available to users.

  • Providing (or contributing to) community catalogues to facilitate data discovery.

  • Monitoring and identifying evolving community expectations and responding as required to meet these changing needs.

Sustainability

  • Planning sufficiently for risk mitigation, business continuity, disaster recovery, and succession.

  • Securing funding to enable ongoing usage and to maintain the desirable properties of the data resources that the repository has been entrusted with preserving and disseminating.

  • Providing governance for necessary long-term preservation of data so that data resources remain discoverable, accessible, and usable in the future.

Technology

  • Implementing relevant and appropriate standards, tools, and technologies for data management and curation.

  • Having plans and mechanisms in place to prevent, detect, and respond to cyber or physical security threats.

References and Resources

https://www.nature.com/articles/sdata201618



Data Management Plans

Learning Objectives

  • Describe the purpose of a data management plan
  • Describe the important elements of a data management plan
  • Use a self-assessment to design a data management plan

What is a DMP?

"A data management plan or DMP is a formal document that outlines how data are to be handled both during a research project, and after the project is completed. [1] The goal of a data management plan is to consider the many aspects of data management, metadata generation, data preservation, and analysis before the project begins; this may lead to data being well-managed in the present, and prepared for preservation in the future."(Source: https://en.wikipedia.org/wiki/Data_management_plan)

Example DMPs

Bishop article on DMPs

Why bother with a DMP?

How would you answer?

Do you have a data management plan? If so, how do you use it?

"Those who fail to plan, plan to fail"

Returning to the assertion that data (and its value) is at the foundation of your science, working without a data management plan should be considered scientific misconduct.

Those are strong words. And while we might have an intuition of the boundaries of research ethics - data mismanagement seems more like an annoyance than misconduct. However, if your mismanagement leads to error in your research data, or the inability to make publicly-funded research open to the public, these are serious consequences. Increasingly, funders realize this.

Stick:

Carrot:

  • Make your life easier
  • Planning for you project makes it run more smoothly
  • Avoid surprise costs



DMP Tools

Make your life a little easier by creating DMPs with online tools

Data Stewardship Wizard

DMPTool





Licenses

By default, when you make creative work, that work is under exclusive copyright. This means that you have the right to decide how your work is used, and that others must ask your permission to use your work.

If you want your work to be Open and used by others, you need to specify how others can use your work. This is done by licensing your work.



License Examples

MIT License

GNU General Public License v3.0

FOSS material has been licensed using the Creative Commons Attribution 4.0 International License.



License Options from UArizona Library

open science

License options for University of Arizona Research Data Repository (ReDATA)


Additional Info

General guidance on how to choose a license https://choosealicense.com/

More good guidance on how to choose a license https://opensource.guide/legal/

Licensing options for your Github Repository

References and Resources

Self Assessment

What is a Data Management Plan?

Important: A data management plan (DMP) is now required aspect of publicly funded research.

DMPs are short, formal, documents outlining what types of data will be used, and what will be done with the data both during and after a research project concludes.

True or False: When science project funding ends, the data should end with it

False

Data live on after a project ends.

Ensuring that data have a full lifecycle where they can be (re)hosted and made available after a project ends is critical to open science and reproducible research

Maybe

Sometimes destroying data is part of the life cycle of data - this may be required if data are sensitive and could be used unethically in the future, beyond the control of the original investigator team.

True or False: FAIR and CARE data principles are the same

False

The CARE principles were created in order to help guide and answer when and how applying FAIR data principles to soverign indigenous-controlled data should be done and when it should not.