The purpose of this article is to explain how to import data processing in the Data Processing module of Data Galaxy.
To understand more in-depth the concept of property and objects, you can consult this article.
As a reminder: the module data processing defines the data flux between the different data sources of your workspace.
The goal of this feature is to:
- Ease the import of Data Processing type object,
- Accelerate the objects update with the import of data previously exported.
The import option is available:
- from the "Shortcuts" widget on the home page of the clientspace or workspace
- from the Data processing module when it is empty
- from the contextual menu of the Data processing module, to the right of the filtered views.
Import process and flow
A window opens up:
1. Select or drag and drop your file to be imported into the CSV File area available at the top left.
If some options can be set later, the file to be imported must always contain the following columns:
- The object path
- The object type
- + a column for each attribute that is part of the object card that you want to import
Example of a file to import: (only path & type are mandatory)
2. Select Processes in the Precesses module and click on the Next button
The central area allows you to adjust the technical parameters of the file (encoding, separator) and the table gives you an overview of the file content.
3. The next step allows you to map properties and perform functional checks before importing. When possible, an automatic mapping between source and target fields is performed and the verification of your file is launched.
- If the mandatory fields are not mapped, the verification is not launched and the import is not possible.
- if the check is sucess, the import is avaible (the Import button is immediately active).
- if the check is failure, the checking are in the Cheks tab.
By clicking on the check status, the tab opens with the list of failures checking has been detected:
- When a blocking error can be solved, the solution is in the "Action" column.
- These controls are mandatory and must be re-launched when a modification in the Mapping tab is made.
4. Check the accuracy of the fields to be recovered in the Mapping tab
- You have to drag the fields of the left column on the corresponding fields on the right.
- Only the fields type and path, identified in red, are mandatory.
- For files with many attributes: it is possible to search for attributes and hide the fields used by checking the box.
NB : In the case of updating your objects via this import, if you import empty values of the attributes in your file, which are already filled in your object cards, these empty values will be ignored by default and your existing values are saved. But, by checking this option (figure below), they will empty the existing values.
5. The Preview tab allows you to preview the values for each attribute to be imported, for which a match has been defined. 
6. When these steps are completed and the check is successful, the Import button becomes active. Click on Import to launch the import. A confirmation message display with the number of elements impacted by the import or a error message with a table listing the errors found.
7. Click on close to close the import features or new import to map others data process, input & output elements ...
Import input and output elements
To import input or output elements for your processes, the procedure is the same as for process objects.
The file must be constructed as follows:
- For input elements: path and type of the process to be linked, path and type of the input catalog object.
- For the output elements file: path and type of the process to be linked, path and type of the output catalog object.
Please note
- For output and input files, all fields are mandatory
- The catalog objects to be linked must be created upstream.