Results for "open data"

Case studies & examples

Business case for open data

Six reasons why making your agency's data open and accessible is a good business decision.

Source: data.gov

Keywords: open data

Data.gov Metadata Management Services Product-Preliminary Plan

Status summary and preliminary business plan for a potential metadata management product under development by the Data.gov Program Management Office

Source: data.gov

Format: PDF (7 pages)

Keywords: data management, Federal Data Strategy, metadata, open data

U.S. Geological Survey and U.S. Census Bureau collaborate on national roads and boundaries data

It is a well-kept secret that the U.S. Geological Survey and the U.S. Census Bureau were the original two federal agencies to build the first national digital database of roads and boundaries…

Source: U.S. Geological Survey and U.S. Census Bureau

Keywords: data management, data sharing, data standards, data validation, data visualization, Federal Data Strategy, geospatial, open data, quality

See all resources in Case studies & examples >

Communities

Open Data Community of Practice

A community listserv and working group that unites 900 open data leads at federal agencies, data stewards, and all others in government interested in open data, enterprise data inventory, civic tech, and…

Source: Office of Management and Budget / General Services Administration

Keywords: open data

See all resources in Communities >

Data incubator

Big Data Project

The NOAA Big Data Project (BDP) was created to explore the potential benefits of storing copies of key observations and model outputs in the Cloud to allow computing directly on the data…

Source: National Oceanic and Atmospheric Administration

Keywords: public-private partnerships, open data

The Opportunity Project

The Opportunity Project of the U.S. Census Bureau is a collaborative effort between government agencies, technology companies, and nongovernment organizations to translate into user-friendly tools to solve real world problems for families,…

See all resources in Data incubator >

Data management & governance

Annotated 8 Principles of Open Government Data

Outlines 8 principles for best practices for government open data, formed by open government advocates in 2007 and cross-referenced with principles from OMB Memo M-13-13.

Source: opengovdata.org

Keywords: open data

DCAT-US 3 Implementation Guide

The Federal Chief Data Officers Council (CDOC) is pleased to announce the publication of the DCAT-US v3.0 Schema Implementation Guide, an initial resource to help federal agencies implement the DCAT-US Schema v3.0…

Source: CDO Council

Format: PDF (78 pages)

Keywords: Federal Data Strategy, open data, data inventory, data catalog, data management, DCAT-US, data schema

Data.gov Dashboard

The Data.gov Dashboard is a website enabling Federal agencies, industry, and the general public and other stakeholders to view details on how Federal agencies are progressing on implementing the Federal Open Data…

Source: General Services Administration

Keywords: open data, data inventory

FOIA.gov

The public-facing site for Freedom of Information Act (FOIA) requests.

Source: foia.gov

Keywords: open data, data management

Open Data Engagement Guidance

Many federal agencies have held open data events to engage with the public, the private sector, non-profits, academia and others on open data issues. This guidance outlines best practices for holding open…

Source: data.gov

Keywords: open data

Open Definition 2.1

Defines principles for the term "open" in regards to "open data" and "open content" to ensure quality and encourage compatibility between different pools of open material. The Open Definition, put most succinctly:…

Source: Open Knowledge Foundation

Keywords: open data

Supplemental Guidance on the Implementation of M-13-13 “Open Data Policy – Managing Information as an Asset”

This document focuses on near-term efforts agencies must take to meet the five initial requirements of M-13-13, which were due November 30, 2013.

Source: Office of Management and Budget / General Services Administration

Keywords: open data, data inventory

See all resources in Data management & governance >

Data standards

DCAT-US 3 / M-25-05 Crosswalk

A metadata crosswalk between the statutory metadata requirements of OMB Memorandum M-25-05 and the DCAT-US v3.0 schema.

Source: data.gov

Keywords: open data, data sharing, data inventory

DCAT-US 3 Schedule, Maintenance, and Release Plan

DCAT-US 3 Schedule, Maintenance, and Release Plan

Source: data.gov

Keywords: open data, data sharing, data inventory

DCAT-US Schema v1.1 (Project Open Data Metadata Schema)

How to use Project Open Data Metadata Schema guidelines to document and list agency datasets and application programming interfaces (APIs) for hosting at agency.gov/data and currently in use at data.gov

DCAT-US Schema v3.0

Reference documentation for DCAT-US v3.0, the federal metadata standard for documenting datasets, APIs, and data services. Use this reference to build or validate your agency's data inventory.

DCAT-US Schema v3.0 Catalog fields

Field-level reference for the DCAT-US v3.0 Catalog class. A Catalog is the top-level container for an agency's data inventory.

Documenting APIs

Further guidance on using the Project Open Data Metadata Schema guidelines to document application programming interfaces (APIs) in data.json files for hosting at agency.gov/data.

Geospatial datasets in data.gov

Guidance on how to tag, list, display, and create linkages for geospatial data between Data.gov and GeoPlatform.gov.

Implementation Guide

Implementation Guide

Improving Discoverability, Usability and Governance of Priority Agency Data

To improve the discoverability, usability, and governance of these priority agency data assets agencies shall apply the documenting techniques illustrated below.

Metadata Resources and Field Mappings under the Project Open Data Metadata Schema (DCAT-US Schema v1.1)

Provides further background and resources to assist agencies in implementing the Project Open Data Metadata Schema v1.1. Maps fields from the current version of DCAT-US v1.1 to the previous version of the…

Migrating from DCAT-US v1.1 to v3.0

A step-by-step guide to updating your existing v1.1 data.json file to be valid against the DCAT-US v3.0 schema.

See all resources in Data standards >

Data tools

CKAN

Comprehensive Knowledge Archive Network (CKAN) is a powerful open source data management system that makes data accessible by providing tools to streamline publishing, sharing, finding, and using data. The Data.gov catalog is…

Source: ckan.org

Keywords: data schema, data management, data inventory, open data

Catalog API

JSON API documentation for searching datasets, accessing harvest records, and retrieving keywords from the Data.gov catalog.

Source: Data.gov

Keywords: API, data catalog, open data

DKAN

DKAN is community-driven, Drupal-based, free, and open source open data platform that gives organizations and individuals ultimate freedom to publish and consume structured information.

Source: drupal.org

Keywords: open data

qu

qu is an open source data platform created to serve the public data sets of the Consumer Financial Protection Bureau. The goals of this platform are to import data in a Google-Dataset-inspired…

Source: Consumer Financial Protection Bureau

Keywords: open data, API, data cleaning, data analysis

See all resources in Data tools >

Guidance

Federal Data Strategy

The Federal Data Strategy was established by OMB Memorandum M-19-18 and sets out a mission, 10 Principles, 40 Practices, and annual Action Plans for federal data management. This page collects its documents…

Source: Federal Data Strategy

Keywords: Federal Data Strategy, data governance, open data, Framework

Federal Data Strategy History

How the Federal Data Strategy was created, including the Cross-Agency Priority Goal that started it, the public comment process behind the Principles and Practices, and the development of the 2020 Action Plan.…

Source: Federal Data Strategy

Keywords: Federal Data Strategy, open data, Framework

Federal Data Strategy Practices

The 40 Practices of the Federal Data Strategy, organized into three categories covering data culture, data governance, and data use. Migrated from strategy.data.gov.

Source: Federal Data Strategy

Keywords: Federal Data Strategy, data governance, data management, data practices, open data

Federal Data Strategy Principles

The 10 Principles of the Federal Data Strategy, grouped under Ethical Governance, Conscious Design, and Learning Culture. Migrated from strategy.data.gov.

Source: Federal Data Strategy

Keywords: Federal Data Strategy, data governance, data ethics, Framework, open data

Final Report and Recommendations of the 2016-2018 FOIA Advisory Committee

This report outlines the Freedom of Information Act (FOIA) Advisory Committee's recommendations and best practices for the administration of FOIA. Dated April 17, 2018.

Source: National Archives and Records Administration

Format: PDF (31 pages)

Keywords: open data, FOIA

Foundations for Evidence-Based Policymaking Act of 2018 (“Evidence Act”)

The text of H.R.4174 - Foundations for Evidence-Based Policymaking Act of 2018, known as the Evidence Act. Title II of the Evidence Act (OPEN Government Data Act) describes the requirements for CDOs,…

Source: Public law

Keywords: open data, FOIA, data governance

OMB M-11-02: Sharing Data While Protecting Privacy

Office of Management and Budget memo that encourages Federal agencies to engage in coordinated, collaborated data-sharing in a manner that complies with applicable privacy laws, regulations, and polices. Dated November 3, 2010.…

Source: Office of Management and Budget

Format: PDF (4 pages, 70 KB)

Keywords: open data, data sharing, privacy

OMB M-14-06: Guidance for Providing and Using Administrative Data for Statistical Purposes

To encourage the greater use of administrative data for statistical purposes, this Memorandum provides agencies with guidance for addressing the legal, policy, and operational issues that exist with respect to using administrative…

Source: Office of Management and Budget

Format: PDF (38 pages, 755 KB)

Keywords: data sharing, privacy, open data, data standards, access

OMB M-19-23: Phase 1 Implementation of the Foundations for Evidence-Based Policymaking Act of 2018: Learning Agendas, Personnel, and Planning Guidance

Office of Management and Budget memo that outlines action steps to meeting the requirements of the Evidence Act. Dated July 10, 2019.

Source: Office of Management and Budget

Format: PDF (37 pages, 3.52 MB)

Keywords: open data

SUPERSEDED: OMB M-13-13: Open Data Policy – Managing Information as an Asset

Office of Management and Budget memo that established a framework to help institutionalize the principles of effective information management at each stage of the information's life cycle to promote interoperability and openness.…

Source: Office of Management and Budget

Format: PDF (12 pages, 5.84 MB)

Keywords: open data, access, data management, privacy, data inventory

See all resources in Guidance >

Publishing and harvesting help

Harvest error: accrualPeriodicity

How to fix accrualPeriodicity validation errors caused by plain English update frequency descriptions instead of the required ISO 8601 duration codes.

Source: data.gov

Keywords: open data

Harvest error: contactPoint.hasEmail

How to fix harvest validation errors in the contactPoint.hasEmail field caused by malformed email addresses, extra text, multiple addresses, or invisible characters.

Source: data.gov

Keywords: open data

Harvest error: date format

How to identify and fix malformed date values in the modified and issued fields, the most common cause of harvest validation errors.

Source: data.gov

Keywords: open data

Harvest error: keyword format

How to fix harvest validation errors where the keyword field is present but contains a string instead of the required array of strings.

Source: data.gov

Keywords: open data

Harvest error: license field

How to fix license validation errors caused by free text descriptions or CSS strings in a field that requires a URL.

Source: data.gov

Keywords: open data

Harvest error: missing required fields

How to fix harvest validation errors caused by required metadata fields that are absent entirely from a dataset record.

Source: data.gov

Keywords: open data

Harvest error: other error types

How to identify and respond to less common harvest errors including duplicate identifiers, unrecognized record structures, and synchronization failures.

Source: data.gov

Keywords: open data

Harvest error: overview

An overview of the most common harvest errors on harvest.data.gov, based on analysis of errors across 81 harvest sources. Use this page to identify your error type and find the right fix.…

Source: data.gov

Keywords: open data

Harvest error: quick reference

A one-page summary of the most common harvest validation error fixes, including field corrections and ISO 8601 duration codes for accrualPeriodicity.

Source: data.gov

Keywords: open data

Harvest error: transformation

How to identify and fix transformation errors, which occur when harvest.data.gov cannot read or convert a metadata record before validation even begins.

Source: data.gov

Keywords: open data

Harvester Help

A step-by-step guide to understanding harvest errors, reading the harvest job page, and fixing the most common metadata problems.

Source: data.gov

Keywords: open data, data sharing

How to get your Open Data on Data.gov

Learn how Data.gov harvests metadata from agency data sources and how to request a new harvest source or modify an existing one.

Source: data.gov

Keywords: open data, workforce development, data sharing

Inventory.data.gov Guide

Details on how to get started with using inventory.data.gov, from creating a user account to using its features to manage datasets and export data.json.

Source: inventory.data.gov

Keywords: data inventory, data management, inventory.data.gov, open data

What is Harvesting?

A plain-language introduction to how harvest.data.gov works, what it does, and why it matters for federal data publishers.

Source: data.gov

Keywords: open data, data sharing, data inventory

See all resources in Publishing and harvesting help >