Search

Home

Home

DATA CLEANING

DATA CLEANING

The DATA CLEANING operator enables the processing of each record in the stream on the input data bus for selected columns, according to rules defined by the process designer.

OPERATOR CONFIGURATION

Each data bus column can be subject to the actions described below.

image
  • FORMAT → Data formatting for the selected column according to defined rules.
  • image
  • LEADING SPACE REMOVING → removal of leading spaces.
  • INTERNAL SPACE REMOVING → removal of spaces occurring between other characters.
  • REMOVING INDICATED CHARACTERS → removal of a specified character from the column.
  • CHARACTER REPLACING → replacing one character with another.
  • image
  • SUBSTRING ACCORDING TO POSITION → removes a substring starting at a specified position. You configure the start and end positions of the substring to be removed.
  • image
  • SUBSTRING ACCORDING TO CHARACTERS → removes a substring. You configure the starting character and the ending character of the substring to be removed.
  • image
  • UPPERCASE → after the action, all characters in the selected column are uppercase.
  • LOWERCASE → after the action, all characters in the selected column are lowercase.
  • CAPITALIZE → after the action, the first character is capitalized.
  • WARNING → an action that generates a warning. During configuration, you specify the column being checked, the condition that triggers the warning (see the glossary in the illustration below), and the data stream column in which the potential warning should be placed.
  • image