Glossary

What is a dataset?

What is a dataset, beyond a big file? Records, a schema, metadata, documentation and the rights to use them.

By

Updated

Definition

A dataset is a defined collection of related data, usually records sharing the same fields, kept or published together with a description of what it holds, where it came from and the terms on which others may use it.

A dataset in plain words

NIST's glossary gives the shortest answer: a dataset is a collection of data. The W3C's data catalogue vocabulary, DCAT, adds the parts that matter in practice.

A dataset there is a collection of data published or curated by a single agent and available in one or more formats. Each of those formats is a distribution, such as a downloadable CSV file or an API.

Boundary, curator, distribution

So a dataset has a boundary (what is in and what is out), an owner or curator who answers for it, and at least one way to get hold of it.

A dataset has a boundary, a curator and a way to get it.

Exports versus a dataset

A shared drive full of unrelated exports has none of those. The same exports, scoped to one subject, given consistent columns and a written description, become a dataset someone else can understand without asking the person who made it.

Anatomy of a dataset

The parts of a dataset and the open standard that describes each. The example column follows one fictional dataset: a delivery company's five years of parcel scans.
PartWhat it isExampleWhere it is defined
Records (rows)One entry per thing observed: a transaction, a scan, a sensor readingOne row per parcel scanTable Schema: a primary key is the field or fields that uniquely identify each row
Fields (columns)The attributes every record shares, each with a name and a typescan_time, depot_id, parcel_weight_kg, statusTable Schema: a fields array, one descriptor per field; type defaults to string
SchemaThe rules for the fields: types, keys, which values count as missingdepot_id is an integer; an empty status means unknownTable Schema: fields, primaryKey and missingValues
MetadataFacts about the dataset as a whole: title, description, publisher, dates, coverageTitle, the depots covered, the years covered, update frequencyW3C DCAT: title, description, publisher, licence, spatial and temporal coverage
DocumentationWhy it was made, how it was collected, known gaps and suitable usesScanners changed model in year three; rural depots are under-representedDatasheets for Datasets: motivation, composition, collection process, recommended uses
Licence and sourcesThe terms of use and where the raw data came fromLicensed for route modelling; no resale of raw rowsData Package: licenses and sources properties (the spec notes the licence field is not itself legally binding)
DistributionThe form a user actually receivesMonthly Parquet files plus a sample CSVW3C DCAT: a distribution is an accessible form of a dataset, such as a downloadable file

Why the standards help a seller

None of these standards is compulsory for a private sale. They are useful because they show what a careful buyer expects to find, and they give a seller a ready-made checklist instead of inventing one.

Dataset, database and AI dataset

  • A database is the system that stores and serves data, often for day-to-day operations. A dataset is a defined slice or export with a description, even when it lives inside a database.
  • An AI dataset is a dataset prepared for training, tuning or testing a model, with labels and splits where the task needs them. Every AI dataset is a dataset; most datasets are never used for AI.
  • A data product is a dataset someone maintains and supports over time, with an owner and regular updates, rather than a one-off extract.

What makes a dataset sellable

Plenty of companies hold large datasets that no buyer can safely license. Size is rarely the obstacle. Three questions usually decide whether a dataset can be sold at all.

  • Rights: does the seller own the records or hold a licence that lets it pass them on? Customer contracts, supplier terms and website terms can all forbid it.
  • Provenance: can the seller show where each part came from, when and how it was collected, and what was done to it since? A written provenance record answers the questions a buyer's lawyers will ask anyway.
  • Format: does the data arrive with a schema, consistent fields and metadata, so the buyer can load and test it without weeks of cleaning?

The fourth filter

Personal data is the fourth filter. If records name or describe people, privacy law shapes what can be shared. A first pass with a browser PII scanner shows whether obvious identifiers such as emails, phone numbers or ID numbers sit in a sample; it does not decide whether the remaining data is anonymous.

Where DataBroker fits

We don't sell datasets or data feeds. DataBroker is a paid course and a set of tools for people who broker data between companies: finding businesses that hold a sellable dataset, checking its rights and documentation, and pricing it.

For a first price range, the dataset pricing calculator works from record counts and the buyer's use. For the deeper question of what a specific AI dataset needs, see the sibling entry on that term.

Sources

5 sources · checked Nov 9, 2026

  1. NIST CSRC glossary: datasetDataset as a collection of data (from NIST SP 800-188) · Checked
  2. W3C: Data Catalog Vocabulary (DCAT) Version 3Dataset curated by a single agent and available in one or more formats; distributions; dataset metadata properties · Checked
  3. Frictionless Data: Table SchemaFields, field types, primary keys and missing values · Checked
  4. Data Package standardLicences, sources, contributors and version in a package descriptor · Checked
  5. arXiv: Datasheets for Datasets (Gebru et al.)Documentation of motivation, composition, collection process and recommended uses · Checked

Dataset FAQ

What is an example of a dataset?

A table of every parcel scan a courier recorded over five years, with the same fields on each row and a note on what the fields mean, is a dataset. So are a census table, a set of labelled photos or a log of website visits.

Is a spreadsheet a dataset?

It can be. A single sheet with consistent columns and a clear subject is a small dataset. A workbook mixing notes, totals and unrelated tabs is not, until it is cleaned into one table with a description.

What is the difference between a dataset and a database?

A database is the software and storage that holds data and answers queries. A dataset is a defined collection of data with a description, which may be exported from a database, kept in files or shared through an API.

What format should a dataset be in to sell it?

Whatever the buyer can load easily, usually CSV, Parquet or JSON for tables, plus a schema and metadata. The format matters less than consistency: the same fields, types and meanings across every file delivered.

Related

  • AI dataset

    An AI dataset is the material a model learns from: what it contains, how it is organised, and what buyers check before licensing one.

  • Data valuation

    Data valuation explained for people selling or brokering a dataset: three standard methods, what each misses, and a worksheet to score one.

  • The dataset pricing calculator with 2,500,000 records at a $4 base per 1,000, monthly updates (×1.5) and a fully exclusive licence (×3): a combined multiplier of ×4.5, a suggested asking price of $31,500, a negotiating range of $23,625 to $39,375 and $12.60 per 1,000 records.
    Data pricing calculator

    Data pricing made concrete: start from a base rate, apply volume tiers and multipliers you control, and get an asking price and range.

Free tool

Try the PII scanner

A PII scanner searches text for personally identifiable information, such as email addresses, phone numbers and government ID numbers, so it can be removed or protected before the text is shared.

  • Free
  • No sign-up
  • Runs in your browser