Create and launch a process in DQE One Standalone

Support DQE
Support DQE

A process is how you run a data-quality or deduplication job in DQE One Standalone. Every process is built in the same 4-tab wizard: Data Source, Input Mapping, Data Filter and Results.

Start a new process

Open the "Choose a process kind" screen either from the + icon next to Processes in the left navigation, or from the home page ("Start now and select the process you want to run"). There are 8 process kinds, grouped the same way on both screens:

GroupProcess kindDescription shown on the card
Data PreparationFind & ReplaceFind a word or a pattern and replace it by another one
FormatFormat your fields by using a regex formula
Data Quality CheckCheck EmailCheck the format and/or the existence of your email addresses
Check Postal AddressCheck the format and/or the existence of your postal addresses
Check B2BCheck the format and/or the existence of your B2B account
Check PhoneCheck the format and/or the existence of your phone numbers
DeduplicateUnify ProcessFind duplicate in your database and merge them if needed
Index RecordsIndex records from your database to enable the real time duplicate check APIs

Picking a card takes you straight into the wizard for that kind. One process always runs one kind — to check both email and phone, for example, create two processes (you can chain them, see Advanced Options below).

1. Data Source

Connect or reuse a data source, then pick the object/table or upload a file. See the separate Connect a data source in DQE One Standalone article — this step is the same regardless of process kind.

2. Input Mapping

What you see here depends entirely on the process kind.

Find & Replace and Format

Both kinds share the same screen. Add one or more rows, each with:

  • Field to process
  • Value to find (Find & Replace) or Format to find (Format) — with a checkbox: "Check the box if the value/format to find is a regex formula."
  • Value to replace by / Format to replace by

Click to add further rows for additional fields.

Check Email

Pick the Email field to validate.

Check Phone

Pick the Phone field and Country field, then set:

  • Separator — Space, Point or Dash.
  • Phone output format (required) — choose from: National format without spaces; National format with country-specific digit grouping; International format with country-specific digit grouping; International format with space between country code and subscriber number; International format with trunk prefix and compact subscriber number; International format without spaces; International format with trunk prefix and country-specific digit grouping; International format without spaces and without leading plus sign.

Check Postal Address

Pick Street, Additional Address 1, Additional Address 2, City, State, Postal Code and Country fields, a Field Tag (e.g. "CustomAddress") and a Default country value. Below the mapping, pick which result fields to receive in the RNVP Output Mapping multiselect (a "select all" option is available).

Check B2B

Pick SIRET Field and Company Name Field, plus the same Street/City/State/Postal Code/Country/Field Tag/Default country fields as Check Postal Address. Pick result fields in the B2B Output Mapping multiselect.

Unify Process (duplicate check)

Pick a Primary key field, then attach a Rules Set — see "Attaching a RuleSet" below. If your source is a live connector (Salesforce, Dynamics, Postgres, BigQuery or Snowflake), a further "Select Objects to reparent" step lets you choose which fields on the parent object get updated when a duplicate is merged into it (not shown for CSV/SFTP sources, or for Find & Replace/Format/Index Records).

Index Records

Pick a Primary key field and, optionally, a Parent Id field, then attach a Rules Set (matching rules only — no merge/parenting rules apply here).

Attaching a RuleSet

Unify Process and Index Records both need a Rules Set: select one from the picklist (only already-published RuleSets matching your source object — or, for CSV/SFTP, matching the exact column headers — are offered). Once selected, you'll see read-only previews of its Matching rules, Parent record rules and Merging rules (Merging/Parent only for Unify Process).

A RuleSet must already exist and be published before it shows up here — you can't configure matching/merging rules inline. If you need a new one, click Create new set: this opens the RuleSet editor in a new context already linked to this process, so you can come back and finish once it's published. See Create and configure a RuleSet in DQE One Standalone.

3. Output Source (optional)

Shown for every kind except Find & Replace, Format and Index Records. You can optionally send results to a different destination than where the data came from — click one of Connect to Salesforce, Connect to Dynamics, Connect to Postgres, Connect to SFTP, Connect to BigQuery or Connect to Snowflake (same connection flow as the Data Source step), then pick the target object/warehouse, a Match Records On field to match source and destination records, and map which source field feeds which destination field. For an SFTP output, you instead pick an Output directory.

4. Data Filter and Advanced Options

The Advanced Options section ("Additional options to be set up if needed") holds most behavior settings. Which ones you see depends on the process kind and source:

OptionWhat it doesShown for
Set a data limit for each typeCaps the number of rows processedAll kinds
Auto-start the next step after completionChains another of your processes to run right after this one finishes (sets its "next process")All kinds
Authorized Empty File"If checked, the process will finished even if the file is empty. Else it will failed."Non-CSV sources
Delete Input File"Delete input file after Process is Done."SFTP only
Synchronized results"Synchronize result to {source}" — writes results back to the source (or configured output)Non-CSV/SFTP sources, or when an Output Source was configured
Duplicate CertaintyNumeric threshold (0–100) controlling auto-mergeUnify Process only
RNVP Merge Quality CodePick which address quality codes qualify a record for auto-mergeCheck Postal Address only
B2B Merge Status CodePick which B2B status codes (A+/A/B+/B/C+/C) qualify a record for auto-mergeCheck B2B only
Merge results"Merge result using the Merging Rules defined in the selected Rules set."Unify Process, Check Postal Address, Check B2B — non-CSV/SFTP sources
Update Childs to Inactive"Update all the Childs that have been merge, to Inactive. It will prevent them to be reparent again." (shown once Merge results is on)Unify Process only
Generate relations backup file"Generate backup for reparenting rollback." (shown once Merge results is on)Unify Process on Salesforce/Dynamics only

5. Confirm and launch

At the bottom of the Data Filter tab, you have two different buttons — they are not the same thing:

  • Finish saves your configuration without running it, and takes you back to the process list. Use this if you want to set up a process now and run it later.
  • Start process (shown the first time) or Results (once the process has already run at least once) launches it immediately. A confirmation dialog appears ("Start process — You are about to start the process. Do you want to continue?") — confirm to launch.

What happens after launch

You land on the Results tab, where the run immediately shows status Started. From here it moves through Reading → In Progress → Writing → Finished (or Failed). See Monitor and manage a run in DQE One Standalone for what to do next — viewing progress, syncing, merging, downloading results, or stopping a run in progress.

Related to

Was this article helpful?

0 out of 0 found this helpful