Movatterモバイル変換


[0]ホーム

URL:


DOCS >INTEGRATIONS >DATABASES >RESPONSYS (V1)

Get started with a free trial today

Already have an account? Sign in

Responsys (v1)

Responsys extraction is supported by Stitch
This integration is powered bySinger's Responsys tap and certified by Stitch.Check out and contribute to the repo on GitHub.

For support, contactSupport.

Responsys feature snapshot

A high-level look at Stitch's Responsys (v1) integration, including release status, useful links, and the features supported in Stitch.

STITCH
Release status

Released on January 17, 2019

Supported by

Stitch

Stitch plan

Standard

Supported versions

n/a

API availability

Available

Singer GitHub repository

singer-io/tap-responsys

CONNECTION METHODS
SSH connections

Supported

SSL connections

Unsupported

REPLICATION SETTINGS
Anchor Scheduling

Supported

Advanced Scheduling

Supported

Table-level reset

Unsupported

Configurable Replication Methods

Unsupported

REPLICATION METHODS
Log-based Replication

Unsupported

Key-based Replication

Supported

Full Table Replication

Unsupported

DATA SELECTION
Table selection

Supported

Column selection

Unsupported

View replication

Unsupported

Select all

Supported

TRANSPARENCY
Extraction Logs

Supported

Loading Reports

Supported

Connecting Responsys

Responsys setup requirements

To set up Responsys in Stitch, you need:

  • Export files that adhere toStitch’s requirements. Files that aren’t set up correctly may not be replicated successfully, or may cause issues during extraction.


Step 1: Add Stitch's Public Key to your Responsys SFTP server

Stitch uses an SSH tunnel to securely connect to your Responsys SFTP server. This means that to connect successfully, you’ll need to add Stitch’s Public Key to your server.

Step 1.1: Retrieve your Stitch public key

  1. On the Stitch Dashboard page, click theAdd Integration button.
  2. Click theResponsys icon.
  3. The Stitch public key will be at the top of the page that opens:

    The Stitch Public Key in the Responsys settings page

Step 1.2: Determine your SFTP server hosting

Next, you’ll need to add the public key to your SFTP server. The steps for doing this depend on how your SFTP server is hosted:

Contact Oracle and provide them with the public key to complete this step.

If your SFTP server is self-hosted, or not hosted by Oracle, you’ll need to add the public key to theauthorized_keys file. This will allow Stitch to conntect to the server using a trusted user.

  1. Open a new terminal window and log into your SSH server.

  2. Create a group namedstitch:

    sudogroupadd stitch
  3. Create a user namedstitch:

    sudouseradd-m-g stitch stitch
  4. Switch to thestitch user:

    sudosu - stitch
  5. Create the.ssh directory:

    mkdir ~/.ssh
  6. Usingchmod, alter the permissions of the directory to allow access:

    chmod700 ~/.ssh
  7. Navigate to the.ssh directory:

    cd ~/.ssh
  8. Usingtouch, create theauthorized_keys file:

    touchauthorized_keys
  9. Set the permissions forauthorized_keys:

    chmod600 authorized_keys
  10. Import theStitch public key intoauthorized_keys, replacing<PUBLIC KEY> with the public key. Verify after replacing the key that it is on one line and doesn’t contain line breaks:

    echo"<PUBLIC KEY>">> ~/.ssh/authorized_keys

If you skip this step or the Public Key is added incorrectly, the following error will surface when you save the integration in Stitch:

"Message from SFTP server: Authentication failed. - Please ensure that the server is configured to accept the public key for this integration."

Step 2: Verify Responsys Connect data export configuration

Connect Data Export Destination Specification page

Stitch’s Responsys integration replicates.csv or.txt files created as part of aConnect data export job. In the Responsys app, jobs are created and managed in theManage Connect page, accessed viaData > Connect.

File settings are defined in theDestination Specification step of the Connect data export process, which can be seen in the image to the right.

The settings in theDestination Specification page must match the required values listed in the table below. This will ensure that data is replicated successfully from Responsys.

Setting in ResponsysRequired value
File to be created

We recommend using adate/time prefix OR suffix for file names, which will result in Responsys creating multiple files.

If a prefix or suffix isn’t used, the export will only ever create a single file. Every new export will replace the entire file, overwriting the data it contains. If this occurs before Stitch runs an extraction job, the overwritten data would be lost and unable to be replicated.

File extension

.csv or.txt

Stitch’s Responsys integration doesn’t currently support replicating other file types.

Character set

Unicode (UTF-8)

File delimiter

Comma

Stitch’s Responsys integration doesn’t currently support other file delimiters.

Field enclosure

Double quotes (")

Insert column header as first line

Box must be checked

Stitch’s Responsys integration requires that the first row of every export file be a column header.

Encryption/compression

Do not encrypt or compress file

Stitch’s Responsys does not currently support replicating encrypted or compressed files.

Additional ready file at completion of download

SelectCreate file with record count.

In theFile extension field, enterready

Step 3: Connect Stitch

In this step, you’ll complete the setup by entering the connection details and defining replication settings in Stitch:

Step 3.1: Define the Responsys connection details

The info you need to complete the remaining fields depends on how your SFTP server is hosted:

If your server is hosted by Oracle, you can find its connection details in the Responsys app by navigating toData > Connect > Destination Connectivity. If you have multiple file locations, click the one you want to connect to Stitch.

Oracle-hosted SFTP server connection details

The image on the right shows an example of the connection details in Responsys.

Fill in the remaining fields in Stitch as follows:

  • Host: In Stitch, enter the value from the ResponsysServer field. This will likely befiles.responsys.net
  • Port: Leave this as22.
  • Username: In Stitch, enter the value from the ResponsysUser name field. In the example, this isdemo_scp
  • Path: In Stitch, enter the value of the ResponsysDirectory path field, or the file server path where completed Responsys export files are stored. In the example, this isdownload

If your server is hosted by Oracle, you can find its connection details in the Responsys app by navigating toData > Connect > Destination Connectivity. If you have multiple file locations, click the one you want to connect to Stitch.

Self-hosted SFTP server connection details

The image on the right shows an example of the connection details in Responsys.

Fill in the remaining fields in Stitch as follows:

  • Host: Enter the host address (endpoint) used by the SFTP server.
  • Port: Enter the SSH port used by the SFTP server. This is usually22.
  • Username: Enter the name of the user you created inStep 1.2. In the example, this isstitch_user
  • Path: Enter the file server path where completed Responsys export files are stored.

Step 3.2: Define the historical sync

The Sync Historical Data setting defines the starting date for your Responsys integration. This means that dataequal to or newer than this date will be replicated to your data warehouse.

Change this setting if you want to replicate data beyond Responsys’s default setting of1 year. For a detailed look at historical replication jobs, check out theSyncing Historical SaaS Data guide.

Step 3.3: Create a replication schedule

Replication schedules affect the time Extraction begins, not the time to data loaded. Refer to theReplication Scheduling documentation for more information.

In theReplication Frequency section, you’ll create the integration’sreplication schedule. An integration’s replication schedule determines how often Stitch runs a replication job, and the time that job begins.

Responsys integrations support the following replication scheduling methods:

To keep your row usage low, consider setting the integration to replicate less frequently. See theUnderstanding and Reducing Your Row Usage guide for tips on reducing your usage.

Step 4: Select data to replicate

Is an object missing or not replicating? Verify that the object meets the requirements forselection andreplication.

The last step is to select the tables you want to replicate.

Note: If a replication job is currently in progress, new selections won’t be used until the next job starts.

For Responsys integrations, you can select:

  1. **Individual tables **

  2. All tables and columns

Click the tabs to view instructions for each selection method.

  1. In the Integration Details page, click theTables to Replicate tab.
  2. Locate a table you want to replicate.
  3. Click thecheckbox next to the table’s name. A blue checkmark means the table is set to replicate.
  4. After you set a table to replicate, a page with the table’s columns will display. De-select columns if needed.Note: Responsys tables replicate using Key-based Incremental Replication. Refer to theReplication section for more info.
  5. Repeat this process for every table you want to replicate.

  6. Click theFinalize Your Selections button at the bottom of the page to save your data selections.
Important: Using theSelect All feature will overwrite any previous selections. However, selections aren’t final untilFinalize Your Selections is clicked. ClickingCancel will restore your previous selections.Refer to theSelect All guide for more info about this feature.
  1. Click into the integration from the Stitch Dashboard page.
  2. Click theTables to Replicate tab.

  3. Navigate to the table level, selecting any databases and/or schemas that contain tables you want to replicate.

  4. In the list of tables, click the box next to theTable Names column.
  5. In the menu that displays, clickTrack AllTables and Fields (Except Views):

    The Track AllTables and Fields (Except Views) menu in the Tables to Replicate tab

  6. Click theFinalize Your Selections button at the bottom of the page to save your data selections.

Initial and historical replication jobs

After you finish setting up Responsys, itsSync Status may show asPending on either the Stitch Dashboard or in the Integration Details page.

For a new integration, aPending status indicates that Stitch is in the process of scheduling the initial replication job for the integration.This may take some time to complete.

Initial replication jobs with Anchor Scheduling

If using Anchor Scheduling, an initial replication job may not kick off immediately. This depends on the selected Replication Frequency and Anchor Time. Refer to theAnchor Scheduling documentation for more information.

Free historical data loads

The first seven days of replication, beginning when data is first replicated, are free. Rows replicated from the new integration during this time won’t count towards your quota. Stitch offers this as a way of testing new integrations, measuring usage, and ensuring historical data volumes don’t quickly consume your quota.

Replication will continue after the seven days are over. If you’re no longer interested in this source, be sure topause ordelete the integration to prevent unwanted usage.

Responsys replication

While data from Responsys integrations is replicated usingKey-based Incremental Replication, the behavior for this integration differs subtly from other integrations.

The table below compares Key-based Incremental Replication andReplication Key behavior for Responsys to that of other integrations.

ResponsysOther integrations
What's replicated during a replication job?

The entire contents of a modified file.

Only new or updated rows in a table.

What's used as a Replication Key?

The time a file is modified.

A column or columns in a table.

Are Replication Keys inclusive?

No. Only files with a modification timestamp value greater than the last saved bookmark are replicated.

Yes. Rows with a Replication Key valuegreater than or equal to the last saved bookmark are replicated.


Responsys Schema

Responsys tables will contain the same columns that the source files contains. These tables will also containcommon system columns, as well as columns specific to Responsys integrations:

_sdc_source_file

Applicable only to Intacct and Responsys integrations, this column contains the file path on the SFTP server of the table’s source file.

_sdc_source_lineno

Applicable only to Intacct and Responsys integrations, this column contains the row number for the record in the source file.

RelatedTroubleshooting

Questions? Feedback?

Did this article help? If you have questions or feedback, feel free tosubmit a pull request with your suggestions,open an issue on GitHub, orreach out to us.


[8]ページ先頭

©2009-2026 Movatter.jp