Arcion Cloud

Arcion Cloud quickstart#

This quickstart helps you get familiar with the Arcion Cloud UI by going through the general steps of a sample replication process. By the end of this tutorial, you can confidently start using Arcion Cloud UI.

Tip:: The default username and password for the Arcion Cloud console isadmin andarcion respectively.

Objectives#

• Create a new replication job.
• Select a write mode.
• Set up a data source.
• Set up a target database.
• Filter source data.
• Specify data mappings.
• Start a replication.
• Get an overview of your replication job.

Before you begin#

Whitelist our NAT IP52.52.196.143 in your firewall, so that Arcion can connect to your source or destination database.

Log in#

Log intoyour Arcion Cloud account. If you haven’t signed up yet, sign up using your Google account or email and password.

After logging in, the console dashboard appears and shows you a list of replications you might’ve previously created. Otherwise, the dashboard appears empty.

ClickNew Replication to start a new replication job.

Select replication and write mode#

In theSet up a Replication page, fill up the following replication details to proceed:

1. Set aName and an optionalDescription for the replication.
2. Select theReplication mode andWrite mode for your replication job.
3. ClickNext.

Replication modes#

Snapshot

Use this mode for a one-time replication of data from source to target.

Realtime

Use this mode to replicate real-time changes from source to target. This mode also allows real-time replication after performing a snapshot.

Full

This mode combines the snapshot and real time modes and automatically switches over to real time once the snapshot completes.

Write modes#

Replacing

This mode takes all metadata and data from the source and replicates them to the target. This means the target drops all existing data and recreates them with the data from the source.

Truncating

This mode keeps the target tables intact and only truncates them before replicating the data from the source.

Appending

This mode only replicates changes to the target database but doesn't change any existing data on the target.

Tip:: If you want to keep the source in sync with the target in real time, pickFull replication mode andReplacing write mode.

Set up data source#

After completing the preceding steps, theSource page appears. This page shows you the available source connectors. You must set up these sources for every database that you would like to replicate to and from.

ClickAdd your own source to add a data source.

Select the data source#

In theCreate connection page, pick the data source you want and clickContinue. This quickstart uses Oracle as the source database.

Enter the source connection details#

1. In this page, select theConnection form tab and fill in the connection details for your data source. All sources and targets you set up in Arcion follows a similar way.

   The right hand side of the page displays the source documentation for easy reference.

2. Once you enter all the information, clickSave.

Test the connection#

1. You can test the connection to your source database by clicking by clicking onTest connection. This brings up a dialog with results of the connection tests. For correct connection credentials, the connection check passes every test.If you face any error, check the documentation on the right side to make sure you have followed all steps correctly. Then test the connection again before proceeding.

2. After testing your connection, clickDone to close the dialog and then clickContinue at the bottom of the page to proceed to the next step.

Sync the data source#

1. Click theSync connector tab and clickSync connector at the bottommost pane. This fetches all the metadata Arcion requires in order to filter tables and replicate data to the target database.

2. After a successful sync, the page shows the schemas and tables available to the user. ClickContinue to move to the next step.

   Caution: Syncing the connector can time out if the Replicant user has access to hundreds of schemas and tens of thousands of tables and slow connection. If you face timeouts, try to limit the number schemas and tables to the ones you only need to replicate. If you still face issues, please reach out toour support team.

3. TheSource connector page appears listing the data source you just created. Select this new connector and clickContinue to destination.

Set up target database#

ClickAdd your own destination to start the process.

Select the target database#

In theCreate connection page, pick the target database you want and clickContinue. This quickstart uses Databricks as the target.

Enter the target connection details#

1. In this page, select theConnection form tab and fill in the connection details for your target. Similar to the source, the right hand side of the page displays the target documentation for easy reference.
2. Once you enter all the information, clickSave and thenContinue. You don’t need to sync this connector since it’s not a source.
3. TheDestination connector page appears listing the target you just created. Select this new connector and clickContinue to filter.

Filter data for replication#

TheFilter page lists the databases and catalogs that you can select to replicate to the target database. You can pick specific tables and columns from each database and table that you want.

If the database, catalog, or table you’re looking for doesn’t appear in the list, try these steps:

1. Check the database permissions for the user you’ve used for authentication in the data source.
2. ClickSync schemas on the right hand side of the page to refresh the metadata.

For more information about filters, seeFilter configuration.

Specify data mappings#

If you want to rename or map tables to different databases or catalogs, clickMap tables at the bottom of theFilter page.

TheMapper page displays the catalogs or databases and the tables for each one that you pick intheFilter page. The left side showsSource names and the right side showsTarget names. You can change any one of these all the way down to the column level and that’s how they appear on the target.

For more information about mapping rules, seeMapper configuration.

Start the replication job#

1. Review your replication details. The left pane of the page displays all the previous steps you’ve completed:

   a.General

   b.Source

   c.Filter

   To get back to a previous step, click any of the previous steps. If everything looks OK, clickSave.

2. ClickStart replication to start the replication job.

Replication job overview#

After starting the replication, the next page displaysInitializing in the top right hand corner. This message changes toRunning with a green bacground once the initialization process finishes. In the middle of the screen, various replication statistics gradually appears.

Replication Details#

To view replication details, clickView details. It shows each catalog and table undergoing replication and the number of each operation performed on each. To go back to the summary page, clickBack to summary in the top left hand corner of theView details page.

Actions#

After a replication starts, you can take several actions based on your requirements. To see the list of actions, expand theActions section on the top right of the summary page. For example, if you want to stop the replication, chooseStop from theActions menu.

At the bottom of the replication summary page, theUser actions pane on the left shows different actions that users have carried out over time on the replication job:

• Stopped
• Started
• Restarted
• Resumed

Logging#

On the right side of theUser actions pane, the following three tabs contain logging and troubleshooting information about the replication job:

Trace log

Shows the output of the replication job.

Errors

Only shows the errors if any exists.

Events

This tab is currently undergoing implementation.

To search through the contents of a tab, use theSearch field under the respective tab. To search backward and forward inside a tab, use thePrev find andNext find buttons.

Additional features#

Next to thePrev find andNext find buttons, the following buttons allows you to perform some additional actions:

fullscreen

Maximize the current tab’s output.

cloud_download

Download all the logfiles and configuration files to troubleshoot issues.