Execute Pipeline with Remote Server

Link allows remote execution by utilizing different server resources for each pipeline component.

Create a Remote Server

📘

Redis and RabbitMQ are both supported as Message Queue Server(Broker). And, Redis is supported as a Data Storage Server(Backend).

1. Install Redis or RabbitMQ in the environment where you want to use the remote server.
   • If Using Redis
   • If Using RabbitMQ
2. Install Link in the environment.
   Python

   pip install mrx-link
   

3. Activate remote servers in the environment.

   📘

   Enter the url address with the port and protocol information for the Backend and Broker.

   • ex: --backend="redis://172.25.1.88:6379"

   Python

   python3 -m mrx_link.kernel.executors.remote_executor --backend="\<data_storage_server>" --broker="\<message_queue_server>"
   

Add a Remote Ser

1. Click the Remote Execution button on the pipeline menu bar.
   

2. In the Remote Execution panel, click the Add button.
   

3. Enter information for the Server Name, the Message Queue Server, and the Data Storage Server, and click the Save button.

   📘

   Enter the url address with the port and protocol information for the Message Queue Server and the Data Storage Server. (ex: redis://172.25.1.88:6379)

   
   

4. Select the pipeline component(s) from Execution Components.

   📘

   The Remote server will be used to execute selected components.

   

Edit the remote resources information

1. Click the Edit button in a remote execution information area.
   
2. After Editing the information, click Save button.
   

Remove the remote resources information

1. Click the Remove button in a remote execution information area.
   
2. Click Remove button in the dialog.