Connect a data source in DQE One Standalone

Support DQE
Support DQE
  • Updated

Before you can create a process, DataPipeline or RuleSet, you need to connect at least one data source. DQE One Standalone supports 7 source types: Salesforce, Microsoft Dynamics 365, PostgreSQL, BigQuery, Snowflake, SFTP and CSV file upload.

Where to connect a data source

You can connect a data source from two places:

  • The Data Source step of the process (or DataPipeline, or RuleSet) creation wizard — heading "Choose your data source", with a "Connect to your software" section reading "Select your software plugin and log in to your software. A system administrator account is required."
  • My Account → Credentials — an accordion section ("Update your credentials here") where you can create a connection ahead of time, independently of any process. Pick a connector from the Select connector list, then click New.

Both places open the exact same connection form, so everything below applies to either entry point.

Reusing an existing connection

If you've already connected a given source before, the connection window shows your saved credentials as cards (with a green or red dot showing whether the connection is currently valid) — click one to reuse it without re-entering anything. Click Use another account to open a blank form instead, or Back to existing account to return to the saved list.

Salesforce

Click Connect to Salesforce, fill in:

  • Username
  • Salesforce Instance Url
  • External Client App Consumer Key
  • External Client App Private Key — upload or paste your PEM-formatted private key (must start with -----BEGIN PRIVATE KEY----- and end with -----END PRIVATE KEY-----), issued by your Salesforce External Client App.

Then click Log In.

This is a direct credentials form, not an interactive Salesforce login popup — there is no consent screen to click through. The Instance Url must be a real Salesforce domain, or the connection is rejected.

Where to find this in Salesforce

  • Username: the Salesforce username of a user with API access (often a dedicated integration user).
  • Salesforce Instance Url: the URL you use to log in to this org (e.g. https://yourcompany.my.salesforce.com), also shown under Setup → Company Information.
  • External Client App Consumer Key / Private Key: create an External Client App in Setup → External Client App Manager → New External Client App, enable OAuth, select the JWT Bearer Flow, and upload a digital certificate. You generate the certificate and its matching private key yourself beforehand (e.g. with OpenSSL) — upload only the certificate to Salesforce and keep the private key to paste here. Once the app is saved, Salesforce shows you its Consumer Key.

Microsoft Dynamics 365

Click Connect to Dynamics, fill in:

  • Tenant
  • Client Id
  • Client Secret
  • Scope — your Dynamics environment URL (e.g. https://yourorg.crm.dynamics.com/.default).

The Migrate Run & Process checkbox is selected by default. Leave it checked the first time you connect a given Dynamics org — after logging in, DQE One Standalone will push Process/Run metadata into Dynamics so it can be tracked there too (a progress loader appears while this runs).

Click Log In. A Microsoft sign-in window opens — sign in and consent, then close the confirmation page it shows you ("Successfully Connected"). DQE One Standalone finishes connecting automatically once you do.

Prerequisite: your IT team needs to create an Azure AD App Registration (giving you the Tenant ID, Client ID and Client Secret above) with a redirect URI of {your DQE One Standalone URL}/dynamics/code.

Where to find this in Azure / Dynamics

  • Tenant and Client Id: in the Azure Portal, under Microsoft Entra ID → App registrations, open your app registration — its Overview page shows the Directory (tenant) ID and Application (client) ID.
  • Client Secret: on the same app registration, go to Certificates & secrets → New client secret. Copy the Value immediately — Azure only shows it once.
  • Scope (your environment URL): in the Power Platform admin center → Environments, open your environment — its Environment URL is shown on the Details page.
  • Redirect URI: add it yourself on the app registration, under Authentication → Add a platform → Web.

PostgreSQL

Click Connect to Postgres, fill in Host, Port, Username, Password and Database, then click Log In. Make sure the database is reachable from DQE One Standalone's server (network/ firewall access).

Where to find this

These are your own PostgreSQL server's connection details — ask whoever manages that database (your DBA or infrastructure team) for the host, port, database name and a username/password with access to it.

BigQuery

Click Connect to BigQuery. Open the Service Account JSON key file you downloaded from Google Cloud Console and copy these 5 values across:

  • Client Id
  • Client Email
  • Project Id
  • Private Key Id
  • Private Key — upload or paste the PEM-formatted value (the private_key field in the JSON file).

Then click Log In.

Where to find this

In Google Cloud Console, go to IAM & Admin → Service Accounts, select (or create) the service account to use, open its Keys tab, then Add Key → Create new key → JSON. This downloads a JSON file containing all 5 values above — open it and copy each field into the matching box.

Snowflake

Click Connect to Snowflake, fill in:

  • Host — your Snowflake account host, ending in .snowflakecomputing.com.
  • Client Id
  • Client Secret

Click Log In. A Snowflake sign-in window opens — sign in and authorize, then close the confirmation page. Snowflake connections always use this sign-in step (including every time the connection is silently refreshed in the background afterwards).

Prerequisite: your Snowflake administrator needs to set up a Security Integration (OAuth client) giving you the Client ID/ Secret above, with a redirect URI of {your DQE One Standalone URL}/snowflake/code.

Where to find this

Your Host is your Snowflake account identifier plus .snowflakecomputing.com (visible in the URL you use to open Snowflake, or under Admin → Accounts). The Client Id and Client Secret come from the Security Integration — a Snowflake ACCOUNTADMIN creates it with a CREATE SECURITY INTEGRATION ... TYPE = OAUTH statement, then retrieves the secret with SELECT SYSTEM$SHOW_OAUTH_CLIENT_SECRETS('integration_name'). Ask your Snowflake administrator if you don't have ACCOUNTADMIN access yourself.

SFTP

Click Connect to SFTP, fill in Host, Port and Username, then choose an authentication method:

  • Password — enter your Password.
  • Key Pair — paste your Private Key content, and optionally its Private Key Password.

Click Log In.

Prerequisite: your SFTP host must be added to an allow-list before you can connect — the Host you type here must match it exactly. This allow-list is a server-side setting of the machine running DQE One Standalone itself, not something configurable from within the app:

  • If you host DQE One Standalone yourself, your own infrastructure team adds the host to that server's configuration.
  • If DQE Software hosts it for you, ask your DQE project manager or DQE Support to add it.

If you see a "not allowed" message when connecting, this is the first thing to check.

Once connected, you'll choose 4 locations on the SFTP server: an Input file, an Output directory, a Logs directory and a Reject directory (files that fail to be read during a run are moved here). When browsing for a file, you can type a filename mask using * and ? wildcards to select several matching files at once.

CSV file upload

In the wizard, choose Import data files and drag a CSV file onto the drop zone (or click to browse). There's no login step and nothing to configure beforehand — the file is uploaded directly.

Managing saved credentials

Go to My Account → Credentials to see every connection you've saved, with its connector type and masked login. From here you can:

  • Create a new connection ahead of time (New button), without needing to start a process first.
  • Delete a connection — only possible if it isn't used by any existing Process or RuleSet.

The Edit button on a saved credential is always disabled — you can't currently update a saved connection's details from this screen. To change credentials, delete the old connection (once unused) and create a new one.

Related to

Was this article helpful?

0 out of 0 found this helpful