Execute Pipeline with Remote Server

Link allows remote execution by utilizing different server resources for each pipeline component.

Create Remote Server

Redis and RabbitMQ are both supported as Message Queue Server(Broker). And, Redis is supported as a Data Storage Server(Backend).

  1. Install Redis or RabbitMQ in the environment where you want to use the remote server.
  2. Install Link in the environment.
    pip install mrx-link
    
  3. Activate remote servers in the environment.
    1. Enter the url address with the port and protocol information for the Backend and Broker.
      • ex: --backend="redis://172.25.1.88:6379"
      python3 -m mrx_link.kernel.executors.remote_executor --backend="\<data_storage_server>" --broker="\<message_queue_server>"
      

Add Remote Server

  1. Click the Remote Execution button on the pipeline menu bar.

  1. In the Remote Execution panel, click the Add button.

  1. Enter information for the Server Name, the Message Queue Server, and the Data Storage Server, and click the Save button.
    1. Enter the url address with the port and protocol information for the Message Queue Server and the Data Storage Server. (ex: redis://172.25.1.88:6379)

  1. Select the pipeline component(s) from Execution Components.
    1. The Remote server will be used to execute selected components.

Edit remote resources information

  1. Click the Edit button in a remote execution information area.

  1. After Editing the information, click Save button.

Remove remote resources information

  1. Click the Remove button in a remote execution information area.

  1. Click Remove button in the dialog.