Version 2

20-12-2017

Version 2 of the Media Suite has new data, bug fixes and new features. Overview:

  • We added datasets/collections from The National Library of The Netherlands (KB), EYE Film Museum, and DANS.
  • In the tools, we fixed a number of bugs. We also added new features that were requested by the main users (researchers).
  • We implemented a “Workspace” so that you can store and retrieve your bookmarks your annotations and track your research in the Media Suite.
  • We did a redesign of the interface and interaction featuring new styling and a more natural flow
  • We set up the Documentation pages and blog in Github pages to facilitate later updates.

See the full list of changes below:

Data integration:

  • KB newspaper collection: The newspaper collection of the National Library of The Netherlands has been harvested and indexed in the Media Suite. We provide access to the data before 1945 in the first import (these data is expected to be completed to cover the entire KB dataset in the subsequent improvements of version 2).
  • EYE Desmet collection: The full metadata from two of the five subsets of the EYE’s Desmet Collection have been added (i.e., the film and poster collections). Access/viewing of some of the films and posters is also possible. The two datasets have been connected when the data was available (e.g., the film records include links to the posters when these are available). Disclaimer: the date fields of the Desmet datasets from EYE include non-normalized data (e.g., 1916 (gewijzigde versie), 1912 (1911 volgens Langman). This is a normal situation in archival metdata. The cleaning of these data will be done for a subsequent release to this version. In version 2, these two datasets cannot be inspected in the Media Suite, but they can be searched and compared.
  • DANS Oral history collections: The metadata from sixty four thematic collections and projects has been automatically harvested from the OAI-PMH endpoint of DANS, and indexed in the Media Suite. This does not include the speech recognition transcripts yet. Access to the content (play-out) is not possible yet.

Major fixes and new features in the tools:

  • General improvements to the query builder: In the search and compare tools, bugs with date selections have been solved, time slider for selecting dates has been changed to date picker, Boolean queries are enabled, field clusters to the Sound and Vision Collection have been added.
  • General improvements to the results and result list: In the search and compare tools issues with display of titles and dates have been solved, basic statistics of results per collection have been added, tooltips have been included, the resource viewer has been splitted into summary view and detailed view.
  • General improvements to the graphics/visualizations: The main bugs and issues with timeline chart and histogram in the Collection Inspector and Search and Compare tools have been solved. The dynamics of the time-line chart has been improved, the histogram is located in a more visible place, absolute values from results in a given point of time have been added to the graphics.
  • Fixes and new features in the Collection inspector tool: Bugs in the calculations have been fixed, statistics presentation has been made more transparent, issues with dates in the date field axis of the timeline chart have been fixed, the syntax and grouping of the metadata fields and their types has been made more user-friendly, a search box for metadata fields has been added for string search.
  • Fixes and new features in the Search tool: Collections can be added directly from this tool.
  • Improvements to the annotation tool: Display of titles for segments has been improved, new option to add custom links.
  • Fixes and new features in the Exploratory browser: The four datasets (Tropenmuseum, KB news bulletins, Amsterdam Museum and OpenImages) in the new version remain unchanged with respect to previous versions of the exploratory browser. Changes include updated event labels for the news bulletins, based on extraction work by Kim Bosman. Additional events have been extracted for the Tropenmuseum data based on work by Victor Kramer. Furthermore, provenance and license information has been added for media objects as well as for metadata triples (named graphs). Filtering in the DIVE browser has been improved. Note: the integration of this browser in the linked data/tools workflow of the Media Suite will be included in Version 3 and 4.

NEW! Workspace

  • Option to create user projects: You can create your own projects and store bookmarks, annotations, and search sessions. These projects can be private or public (other users can see the data stored by the individual users in a project)
  • Bookmarking resources and adding them to projects: Each individual result can be bookmarked and added to a user project from the resource viewer.
  • Saving tool sessions: We are working on a feature that enables you to store a tool session, including its queries and filter settings. The Media Suite is already able to display this data.
  • Implementing this feature in the tools is planned for next year. Currently there is an example DIVE+ tool session, that demonstrates this feature.
  • Viewing user projects: All user projects per user, and public projects can be viewed in a list, opened, and exported.
  • Viewing user bookmarks and annotations: All aggregated bookmarks and annotations added by a user can be viewed in two ways: a list of bookmarks with annotations, or a list of aggregated annotations with links to the items they correspond to.
  • Exporting user projects, bookmarks and annotations: All data in the work space can be exported to a JSON file.

Major styling and design During the last three months of 2017 we worked on improving the styling of the Media Suite user interface and the design of the workspace. This resulted in a new design, that includes:

  • Inclusion of (styled) new features that support scholars in all research phases, including brand new Workspace features!
  • Improved user flow that supports easy navigation between Data, Tools and Workspace.
  • Consistent styling that makes the UI more user friendly and gives it a recognizable and professional look and feel.

A lot of invisible/back-end work: The development team made significant progress in building the Media Suite with an infrastructural approach, this means that there has been a lot of effort put into servers’ maintenance, such as: the semi-automatic process for the deployment of the entire infrastructure (for both a test and production environment), versioning control, backups of data & virtual servers; a scaled up data cluster; security of APIs & video play-out; enhancements of the annotation model & functionalities are amongst many others…

Note : Release of Version 3 is planned for April 2018 with possibly some smaller updates in between.