The purpose of this article is to explain how to use the Data Galaxy Connector.
More information on the connector are available on these articles:
- The concept is explained here
- Supported technologies are listed and updated directly in Datagalaxy platform (more information here)
- DataGalaxy Connector and its plugins can be downloaded Datagalaxy platform (more information here)
Data Galaxy Connector is a metadata extraction wizard, designed to reverse engineer your data tools (database, data flow, data analysis).
It can be used in two ways:
What does it do?
DataGalaxy Connector will allow you to :
- Connect to your data applications
- Extract the metadata
- Format them and publish them in the chosen target (CSV file or API)
- For CSV files, they will then have to be integrated manually into DataGalaxy (more information about the import process is available here)
Data Update will be made in an incremental way:
- The technical name is the key.
- Summary and description will only be updated if the CSV contains a value.
- If the fields are mapped when importing, the other will be loaded (overwrite and replace mode).
Loading can be scheduled through the command line.
Required configuration
DataGalaxy connector is a Java application, version 8 (minimum) of Java must be installed. The connector is available in 32 or 64 bits. The required hardware configuration to execute the connector is :
- 4 CPUs
- 4 GB of RAM minimum, 16 GB recommended
- 2 GB disk space storage
Windows and Linux operating systems are supported (MAC OS is not officially supported).
Please note that RAM can be heavily solicited if the source system has a larger number of objects to import, for example when importing metadata from a large datalake. In such case, we advice you to go for the 64 bits version of the connector, in combination with a computer having at least 16 GB of RAM.
Some technologies require a specific configuration to authorize metadata reading from an external system (using API tokens, client secret, ...). Such configurations are usually documented in the editors documentations or on our online help, don't hesitate to contact us if you are having trouble with such operations.