Browse "open data" resources by category:
Results for "open data"
Case studies & examples
Business case for open data
Six reasons why making your agency's data open and accessible is a good business decision.
Source: data.gov
Keywords: open data
Data.gov Metadata Management Services Product-Preliminary Plan
Status summary and preliminary business plan for a potential metadata management product under development by the Data.gov Program Management Office
Source: data.gov
Format: PDF (7 pages)
Keywords: data management, Federal Data Strategy, metadata, open data
U.S. Geological Survey and U.S. Census Bureau collaborate on national roads and boundaries data
It is a well-kept secret that the U.S. Geological Survey and the U.S. Census Bureau were the original two federal agencies to build the first national digital database of roads and boundaries…
Source: U.S. Geological Survey and U.S. Census Bureau
Keywords: data management, data sharing, data standards, data validation, data visualization, Federal Data Strategy, geospatial, open data, quality
See all resources in Case studies & examples >
Communities
Open Data Community of Practice
A community listserv and working group that unites 900 open data leads at federal agencies, data stewards, and all others in government interested in open data, enterprise data inventory, civic tech, and…
Source: Office of Management and Budget / General Services Administration
Keywords: open data
See all resources in Communities >
Data incubator
Big Data Project
The NOAA Big Data Project (BDP) was created to explore the potential benefits of storing copies of key observations and model outputs in the Cloud to allow computing directly on the data…
Source: National Oceanic and Atmospheric Administration
Keywords: public-private partnerships, open data
The Opportunity Project
The Opportunity Project of the U.S. Census Bureau is a collaborative effort between government agencies, technology companies, and nongovernment organizations to translate into user-friendly tools to solve real world problems for families,…
Source: U.S. Census Bureau
Keywords: crowdsourcing, prize competitions, data analysis, data visualization, open data
See all resources in Data incubator >
Data management & governance
Annotated 8 Principles of Open Government Data
Outlines 8 principles for best practices for government open data, formed by open government advocates in 2007 and cross-referenced with principles from OMB Memo M-13-13.
Source: opengovdata.org
Keywords: open data
DCAT-US 3 Implementation Guide
The Federal Chief Data Officers Council (CDOC) is pleased to announce the publication of the DCAT-US v3.0 Schema Implementation Guide, an initial resource to help federal agencies implement the DCAT-US Schema v3.0…
Source: CDO Council
Format: PDF (78 pages)
Keywords: Federal Data Strategy, open data, data inventory, data catalog, data management, DCAT-US, data schema
Data.gov Dashboard
The Data.gov Dashboard is a website enabling Federal agencies, industry, and the general public and other stakeholders to view details on how Federal agencies are progressing on implementing the Federal Open Data…
Source: General Services Administration
Keywords: open data, data inventory
FOIA.gov
The public-facing site for Freedom of Information Act (FOIA) requests.
Source: foia.gov
Keywords: open data, data management
Open Data Engagement Guidance
Many federal agencies have held open data events to engage with the public, the private sector, non-profits, academia and others on open data issues. This guidance outlines best practices for holding open…
Source: data.gov
Keywords: open data
Open Definition 2.1
Defines principles for the term "open" in regards to "open data" and "open content" to ensure quality and encourage compatibility between different pools of open material. The Open Definition, put most succinctly:…
Source: Open Knowledge Foundation
Keywords: open data
Supplemental Guidance on the Implementation of M-13-13 “Open Data Policy – Managing Information as an Asset”
This document focuses on near-term efforts agencies must take to meet the five initial requirements of M-13-13, which were due November 30, 2013.
Source: Office of Management and Budget / General Services Administration
Keywords: open data, data inventory
See all resources in Data management & governance >
Data standards
DCAT-US 3 / M-25-05 Crosswalk
A metadata crosswalk between the statutory metadata requirements of OMB Memorandum M-25-05 and the DCAT-US v3.0 schema.
Source: data.gov
Keywords: open data, data sharing, data inventory
DCAT-US 3 Schedule, Maintenance, and Release Plan
DCAT-US 3 Schedule, Maintenance, and Release Plan
Source: data.gov
Keywords: open data, data sharing, data inventory
DCAT-US Schema v1.1 (Project Open Data Metadata Schema)
How to use Project Open Data Metadata Schema guidelines to document and list agency datasets and application programming interfaces (APIs) for hosting at agency.gov/data and currently in use at data.gov
Source: data.gov
Keywords: data schema, open data, DCAT, Project Open Data Metadata Schema, data standards, data inventory
DCAT-US Schema v3.0
Reference documentation for DCAT-US v3.0, the federal metadata standard for documenting datasets, APIs, and data services. Use this reference to build or validate your agency's data inventory.
Source: data.gov
Keywords: data schema, open data, DCAT, DCAT-US, metadata standard, data inventory, data standards
DCAT-US Schema v3.0 Catalog fields
Field-level reference for the DCAT-US v3.0 Catalog class. A Catalog is the top-level container for an agency's data inventory.
Source: data.gov
Keywords: data schema, open data, DCAT, DCAT-US, metadata standard, data inventory
Documenting APIs
Further guidance on using the Project Open Data Metadata Schema guidelines to document application programming interfaces (APIs) in data.json files for hosting at agency.gov/data.
Source: data.gov
Keywords: API, DCAT, Project Open Data Metadata Schema, open data, data inventory
Geospatial datasets in data.gov
Guidance on how to tag, list, display, and create linkages for geospatial data between Data.gov and GeoPlatform.gov.
Source: data.gov
Keywords: data tagging, API, DCAT, Project Open Data Metadata Schema, open data, data inventory
Implementation Guide
Implementation Guide
Source: data.gov
Keywords: data schema, open data, DCAT, DCAT-US, data inventory, metadata standard
Improving Discoverability, Usability and Governance of Priority Agency Data
To improve the discoverability, usability, and governance of these priority agency data assets agencies shall apply the documenting techniques illustrated below.
Source: data.gov
Keywords: data schema, open data, Project Open Data Metadata Schema, DCAT, DCAT-US, metadata standard, data inventory
Metadata Resources and Field Mappings under the Project Open Data Metadata Schema (DCAT-US Schema v1.1)
Provides further background and resources to assist agencies in implementing the Project Open Data Metadata Schema v1.1. Maps fields from the current version of DCAT-US v1.1 to the previous version of the…
Source: data.gov
Keywords: open data, data standards, data schema, DCAT, Project Open Data Metadata Schema, open data, data inventory
Migrating from DCAT-US v1.1 to v3.0
A step-by-step guide to updating your existing v1.1 data.json file to be valid against the DCAT-US v3.0 schema.
Source: data.gov
Keywords: data schema, open data, DCAT, DCAT-US, metadata standard, data inventory
See all resources in Data standards >
Data tools
CKAN
Comprehensive Knowledge Archive Network (CKAN) is a powerful open source data management system that makes data accessible by providing tools to streamline publishing, sharing, finding, and using data. The Data.gov catalog is…
Source: ckan.org
Keywords: data schema, data management, data inventory, open data
Catalog API
JSON API documentation for searching datasets, accessing harvest records, and retrieving keywords from the Data.gov catalog.
Source: Data.gov
Keywords: API, data catalog, open data
qu
qu is an open source data platform created to serve the public data sets of the Consumer Financial Protection Bureau. The goals of this platform are to import data in a Google-Dataset-inspired…
Source: Consumer Financial Protection Bureau
Keywords: open data, API, data cleaning, data analysis
See all resources in Data tools >
Guidance
Federal Data Strategy
The Federal Data Strategy was established by OMB Memorandum M-19-18 and sets out a mission, 10 Principles, 40 Practices, and annual Action Plans for federal data management. This page collects its documents…
Source: Federal Data Strategy
Keywords: Federal Data Strategy, data governance, open data, Framework
Federal Data Strategy History
How the Federal Data Strategy was created, including the Cross-Agency Priority Goal that started it, the public comment process behind the Principles and Practices, and the development of the 2020 Action Plan.…
Source: Federal Data Strategy
Keywords: Federal Data Strategy, open data, Framework
Federal Data Strategy Practices
The 40 Practices of the Federal Data Strategy, organized into three categories covering data culture, data governance, and data use. Migrated from strategy.data.gov.
Source: Federal Data Strategy
Keywords: Federal Data Strategy, data governance, data management, data practices, open data
Federal Data Strategy Principles
The 10 Principles of the Federal Data Strategy, grouped under Ethical Governance, Conscious Design, and Learning Culture. Migrated from strategy.data.gov.
Source: Federal Data Strategy
Keywords: Federal Data Strategy, data governance, data ethics, Framework, open data
Final Report and Recommendations of the 2016-2018 FOIA Advisory Committee
This report outlines the Freedom of Information Act (FOIA) Advisory Committee's recommendations and best practices for the administration of FOIA. Dated April 17, 2018.
Foundations for Evidence-Based Policymaking Act of 2018 (“Evidence Act”)
The text of H.R.4174 - Foundations for Evidence-Based Policymaking Act of 2018, known as the Evidence Act. Title II of the Evidence Act (OPEN Government Data Act) describes the requirements for CDOs,…
Source: Public law
Keywords: open data, FOIA, data governance
OMB M-11-02: Sharing Data While Protecting Privacy
Office of Management and Budget memo that encourages Federal agencies to engage in coordinated, collaborated data-sharing in a manner that complies with applicable privacy laws, regulations, and polices. Dated November 3, 2010.…
Source: Office of Management and Budget
Format: PDF (4 pages, 70 KB)
Keywords: open data, data sharing, privacy
OMB M-14-06: Guidance for Providing and Using Administrative Data for Statistical Purposes
To encourage the greater use of administrative data for statistical purposes, this Memorandum provides agencies with guidance for addressing the legal, policy, and operational issues that exist with respect to using administrative…
Source: Office of Management and Budget
Format: PDF (38 pages, 755 KB)
Keywords: data sharing, privacy, open data, data standards, access
OMB M-19-23: Phase 1 Implementation of the Foundations for Evidence-Based Policymaking Act of 2018: Learning Agendas, Personnel, and Planning Guidance
Office of Management and Budget memo that outlines action steps to meeting the requirements of the Evidence Act. Dated July 10, 2019.
SUPERSEDED: OMB M-13-13: Open Data Policy – Managing Information as an Asset
Office of Management and Budget memo that established a framework to help institutionalize the principles of effective information management at each stage of the information's life cycle to promote interoperability and openness.…
Source: Office of Management and Budget
Format: PDF (12 pages, 5.84 MB)
Keywords: open data, access, data management, privacy, data inventory
See all resources in Guidance >
Publishing and harvesting help
Harvest error: accrualPeriodicity
How to fix accrualPeriodicity validation errors caused by plain English update frequency descriptions instead of the required ISO 8601 duration codes.
Source: data.gov
Keywords: open data
Harvest error: contactPoint.hasEmail
How to fix harvest validation errors in the contactPoint.hasEmail field caused by malformed email addresses, extra text, multiple addresses, or invisible characters.
Source: data.gov
Keywords: open data
Harvest error: date format
How to identify and fix malformed date values in the modified and issued fields, the most common cause of harvest validation errors.
Source: data.gov
Keywords: open data
Harvest error: keyword format
How to fix harvest validation errors where the keyword field is present but contains a string instead of the required array of strings.
Source: data.gov
Keywords: open data
Harvest error: license field
How to fix license validation errors caused by free text descriptions or CSS strings in a field that requires a URL.
Source: data.gov
Keywords: open data
Harvest error: missing required fields
How to fix harvest validation errors caused by required metadata fields that are absent entirely from a dataset record.
Source: data.gov
Keywords: open data
Harvest error: other error types
How to identify and respond to less common harvest errors including duplicate identifiers, unrecognized record structures, and synchronization failures.
Source: data.gov
Keywords: open data
Harvest error: overview
An overview of the most common harvest errors on harvest.data.gov, based on analysis of errors across 81 harvest sources. Use this page to identify your error type and find the right fix.…
Source: data.gov
Keywords: open data
Harvest error: quick reference
A one-page summary of the most common harvest validation error fixes, including field corrections and ISO 8601 duration codes for accrualPeriodicity.
Source: data.gov
Keywords: open data
Harvest error: transformation
How to identify and fix transformation errors, which occur when harvest.data.gov cannot read or convert a metadata record before validation even begins.
Source: data.gov
Keywords: open data
Harvester Help
A step-by-step guide to understanding harvest errors, reading the harvest job page, and fixing the most common metadata problems.
Source: data.gov
Keywords: open data, data sharing
How to get your Open Data on Data.gov
Learn how Data.gov harvests metadata from agency data sources and how to request a new harvest source or modify an existing one.
Source: data.gov
Keywords: open data, workforce development, data sharing
Inventory.data.gov Guide
Details on how to get started with using inventory.data.gov, from creating a user account to using its features to manage datasets and export data.json.
Source: inventory.data.gov
Keywords: data inventory, data management, inventory.data.gov, open data
What is Harvesting?
A plain-language introduction to how harvest.data.gov works, what it does, and why it matters for federal data publishers.
Source: data.gov
Keywords: open data, data sharing, data inventory