Copy data
Table of Content
Transfer data option
When the user wants to make a copy of data from one dataspace (or external source) to another for the same dataflow (same Agency/Id/Version), the user selects the option “transfer data” from the hamburger menu of the corresponding dataflow:
This action opens a popup window allowing to select the destination space.
The popup proposes two action buttons:
- “Transfer” launching the transfer with the current option
- “Cancel” cancelling the action.
Partial data transfer
There is an option called “Partial data query” in the popup window allowing the user to customise the data copy request with SDMX query parameters.
When selected, it shows an editable SDMX query field.
At first usage or whenever the user completely empties the field, a default example of a query is displayed: all/?startPeriod=2013endPeriod=2018.
When several dataflows are selected from the list as inputs for transfer, then the partial data query option is not available.
Data validations
Released with October 5, 2021 .Stat Suite JS 10.0.0
Advanced options allow the user to choose the validation process type for data copy. The user is given with three options:
a) Favour speed with basic validations: basic validations are performed upon data copy for SDMX compliance, allowed/complete dimensions values, or representation requirements. It provides simplified error explanations.
b) Apply advanced validations: advanced validations are performed upon data copy for duplicated coordinates, consistent non-observational values, or mandatory attribute values. It provides detailed error explanations.
c) Only run advanced validations without changing data: this option will only perform an “analysis” of the data compliancy without updating the target, and a report by email will be sent with the result.
By default, the basic validations option is selected.
In summary, basic validation allows to:
- report multiple values for group and series attributes;
- report null values to mandatory attributes;
- when there are duplicates in the import, a single error message (about duplicates) will be included in the report. Full validation allows to:
- validate that the outcome of an import will result in consistency of values for group and series attributes;
- validate that the outcome of an import will result in all mandatory attributes to have a value;
- when there are duplicates in the import, every duplicate issue will be included in the report.
The full details of the validation process methods can be found here. The documentation is also available from the DLM UI question mark icon.
Point in Time release
Released with October 5, 2021 .Stat Suite JS 10.0.0
Advanced transfer options allow the user to use the “Embargo (point-in-time) release management” features.
Using a Point-in-Time (PIT) date, the copied data can be kept under embargo in parallel to the previously available data until the embargo date is reached and the embargo data fully replace the previously available data. The following scenarios are supported:
- Source version –> Target version
- Live data –> Live data
- Live data –> Embargo data
- Embargo data –> Live data
- Embargo data –> Embargo data
By default, the “Live data –> Live data” scenario is selected.
When the users select “Embargo” as the Target version, then the “Release date-time” date picker is activated and the user can define a date and time in the future. Note that behind the scene, the users' timezone is automatically taken into account.
If the user doesn’t (yet) define a release date and time, then it is left as undetermined and the user can subsequently update/copy new data targetting the Embargo version.
Note also that the release data and the release date-time can be set or changed subsequently.
Also note that, if there is an existing Embargo of data for a dataflow/DSD, then it is not possible to update the Live version of the data (due to potential conflict when the Embargo version is copied to the Live one).
The optional feature “Allow for later emergency restoration of the current live data” allows to keep a restoration copy of the data in the Target dataspace. Read more about how to restore Live data.
All “point in time” release management (supported by the data API) is fully described in this section.
Notifications
Once the data transfer is launched, the user is made aware by the highlighted transfer icon 
:
- green for a successful transfer,
- red for an unsuccessful transfer.
Hovering the highlighted icon will display the acknowledgment message about the data transfer being processed, along with its request ID.
An email is sent to the end-user once the data request is completed. See Email notifications for data management for more details.