Australian freight data is fragmented. Often useful open freight data exists, but is difficult to find, and resources are wasted with duplication of tasks with by multiple parties searching and assessing data and fixing data quality issues for the same data. Freight sector stakeholders do not have a central, trusted platform for sharing sensitive data securely.
The freight data catalogue project will build on the initial data catalogue created for the prototype website. It will provide a centralised entry point to a curated selection of high-value datasets, with high quality metadata, across all modes and on a national scale.
The project will build trust and confidence with industry stakeholders by increasing the availability and accessibility of government data. It will enable industry and government stakeholders to find, use, and share open data as well as provide secure, access to sensitive datasets only to trusted partners.
This project addresses all 10 of the National Freight Data Hub's enduring questions.
- The freight data catalogue project will provide central leadership and innovation to increase discoverability of freight data. Allowing data consumers to find data that they may not have known existed, previously couldn't see, or request a dataset they'd like to see.
- The catalogue will provide a single entry-point to enable industry, government, research and other stakeholders to easily and efficiently publish, find, share, and use high-quality freight data both as open data, and securely with trusted partners, on a national scale.
- The catalogue will also provide harmonised, searchable metadata about the freight data so that consumers can understand the meaning, quality, confidence rating, lineage, licensing conditions, business owner and data steward, etc.
- Developing the catalogue will help to clarify data owner and data custodianship roles and responsibilities for high value data sets, which may help to simplify the freight data ecosystem and reduce inefficiencies and unclear or overlapping responsibilities.
Initial planned outputs
- Publication of government owned freight related datasets to data.gov.au and linked to the Hub catalogue in line with the open data policy, as part of each Quarterly release.
- Review and update of metadata fields and data structure of the prototype catalogue against Australian Government policies, then create an enduring template for the data catalogue that can also be used across the Department.
- Options paper - assess the capabilities of the technical platforms available in the market (CKAN, Magda, Azure Purview, data.gov.au) against the requirements for the freight data catalogue and providing a recommended option and migration path should a new platform be required.
- Platform migration - a detailed design and migration of the prototype data catalogue to the enduring technology platform. The platform will provide new functionality to the catalogue, such as the ability to review data quality ratings and more descriptive metadata.
Related data projects: