Roles - Import of data from CSV

1. Prepare the CSV file

Here is an example of a CSV file which can be used for importing (or updating) roles, setting their role attributes, guarantees (by user, or by role) and criticality, for saving them in a created catalogue and for assigning their subordinate role. To use this CSV file, create a new identity with user name "user_login", and a new role with code "role_code" to set guarantees.

roles;code;description;attribute;guarantees;guarantee_type;guarantee_role;guarantee_role_type;criticality;catalogue;subroles;eav_info;system_info
Manager-A;Manager-A;Leader;;;;;;;;role_code;attribute:DSF17;
LAY-SP;LAY-SP;Manager;attr1;user-login;type1;role_code;type2;3;cat4;;;virtual:rights:role.one.value
"CORE-CLOSE
AB-role";;desc;attr1;;;;;2;"cat1
cat3";;;

In Excel, it looks like this:

As you can see roles column can contain single or multiple values (separated by a line; the separator can be specified in the settings of the LRT). For multivalued roles, values from the same row will be added to every role. The only exception here is role criticality which cannot be multivalued. CSV file can have optional number of columns: column names are specified in setup of LRT.

The result of this LRT used with this CSV file should:

  • 4 new roles (Manager-A, LAY-SP, CORE-CLOSE, AB-role).
  • Manager-A will have a description set (Leader),a subrole set (role_code), and an EAV attribute "attribute" set with value "DSF17".
  • LAY-SP will have a description (Manager), attribute (attr1), criticality (3), guarantee by identity (with user-name "user-login" and type of guarantee "type1"), and guarantee by role (with role-code "role_code" and type of guarantee "type2") set. It will be saved in catalogue cat4. It will create account in system "virtual" and fill the attribute "rights" with value "role.one.value".
  • Roles CORE-CLOSE and AB-role will have a description (desc), an attribute (attr1), and criticality (2) set. They will be in catalogues cat1 and cat3.
CzechIdM uses by defaul utf-8 encoding. If your input file is encoded in diferent encoding, or if you experience some issues with non english characters, you may set different encoding in configuration of import long running task. Examples of other used encodings might be windows-1250, utf-8 or windows-1252

Create new LongRunningTask

Now we will create the new LongRunningTask (LRT). As shown in the picture, go to Settings → Task scheduler → Scheduled tasks and hit green "Add" button to add new LRT. Select the task Import roles from CSV.

Fill all attributes

Now we need to create new LRT with these attributes:

General:

  • Upload a CSV file - dropzone to select or drop csv file
  • Column with role names - name of the column with roles in csv file
  • Column with role codes - name of the column with role codes in csv file; if left empty, the role code is based on the role name, only spaces are replaced by underscores
  • Column with description - name of the column with role description, can be also used to update description (if your CSV file doesn't contain descriptions, i.e., you are not setting description for any of your roles, leave this line empty)
  • Column with criticality - name of the column with role criticality, can be also used to update criticality (if your CSV file doesn't contain criticality, i.e., you are not setting criticality for any of your roles, leave this line empty); if no criticality is specified, the default is 0
  • Column with catalogue names - name of the column with catalogue names, can be also used to update catalogue names (if your CSV file doesn't contain catalogue names, i.e., you are not setting catalogues for any of your roles, leave this line empty)
  • Column with subrole codes - name of the column with subordinate roles codes, can be also used to update subordinate roles (if your CSV file doesn't contain subordinate roles codes, i.e., you are not setting subordinate roles for any of your roles, leave this line empty)
  • Column separator - separator of columns in csv file (default ; )
  • Multi value separator - (Char, default: new line) separator of multi valued role names in the csv file, new line separator is default export from excel, but for better clarity of the csv file, it's recommended to use some symbol instead
  • Role environment - the name of the environment to which you want to add the role; only supported during creating, not updating roles!
  • Can be requested - (Boolean) - Roles can be requested, can be also used to update already imported settings; it allows not selecting value when updating (not when creating!) roles which will not change the Can be requested property of roles. When creating roles, either Yes or No must be selected.

Role attributes:

  • Column with role attributes - name of the column with role attributes, can be also used to update attributes (if your CSV file doesn't contain attributes, i.e., you are not setting attributes for any of your roles, leave this line empty)
  • Form definition code - the code for the definition which will contain the added attributes (you only have to fill this if you are setting attributes)

Role EAVs:

  • Column with EAV attribute codes and values: name of the column with role EAVs codes and values, separate the code and the values by ':', e. g. "attributecode:attributevalue". Only attributes from the main role definition can be imported and they must of type SHORTTEXT. Can be multivalued. Supports update (the current value of the attribute will be overwritten if imported). (since Extras 2.5.0)

Guarantees:

  • Column with guarantee - name of the column with role guarantee by identity login, can be also used to update guarantee (if your CSV file doesn't contain guarantees, i.e., you are not setting guarantees for any of your roles, leave this line empty)
  • Column with guarantee types - name of the column with role guarantee by identity type (if your CSV file doesn't contain guarantee types, i.e., you are not setting guarantee types for any of your roles, leave this line empty) (since Extras 2.2.0)
  • Update guarantee types - check if you want to add new guarantee type to an existing guarantee (this will create a new guarantee with the selected type, the original one will still exist) (since Extras 2.2.0)
  • Column with guarantee role - name of the column with role guarantee by role code, can be also used to update role guarantee (if your CSV file doesn't contain role guarantees, i.e., you are not setting role guarantees for any of your roles, leave this line empty)
  • Column with guarantee role types - name of the column with role guarantee by role type (if your CSV file doesn't contain guarantee role types, i.e., you are not setting guarantee role types for any of your roles, leave this line empty) (since Extras 2.2.0)
  • Update guarantee role types - check if you want to add new guarantee type to an existing guarantee role (this will create a new guarantee with the selected type, the original one will still exist) (since Extras 2.2.0)

System:

  • Column with system informations (name of the system, attribute, its value) - name of column with the name of the system, imported attributes and its value is, separate the system name, attribute code and the value by ':', e. g. "AD:ldapGroups:BCV_all". The attribute has to a multivalued attribute with merge strategy set. (since Extras 2.5.0)
If you are updating the roles, make sure to set the same form definition the role already have (if they have any). Also, each role can only have one definition, so if you by mistake set a different definition in the LRT configuration, you will likely get an error. Generally, DO NOT use this LRT to change the definition of a role. You can only change the definition if the role has no attributes set yet. Supports update (the current value of the attribute will be overwritten if imported).
This LRT can be used to update existing values but it does not remove old values. The only overwritten values during update are role criticality, description and MemberOf attribute value. They will be changed only if they are not empty in the CSV file

Run the task

Now we need to hit run.

Now we must go to the "all tasks" panel, select the newly created LRT (check the checkbox), click Operation with selected record and Run selected task.

You can also check the status of the created roles there in the task detail. Here you can find information about roles created, updated, or already existing.

At this point, everything should be set up and when the task ends, roles are imported in IdM with their attributes and other imported values, and placed in the catalogue named by the system name.

Known issues

If you delete or upload new file via dropzone, you should delete old files, created from previous uploads.