From Bright Pattern Documentation
Jump to: navigation, search
(6 intermediate revisions by 5 users not shown)
Line 1: Line 1:
<translate>= Fetch URL=
 
The ''Fetch URL'' workflow block fetches web content, including JSON-formatted data, from a specified URL, using a specified method and parses it into workflow variables. Both HTTP and HTTPS protocols are supported, as well as basic authentication.
 
  
 +
=Fetch URL=
 +
Requests web content from a URL over HTTP/HTTPS using a GET, POST, PUT, PATCH, or DELETE and parses received data into workflow variables.
  
[[File:WB-Fetch-URL-52.PNG|225px|Fetch URL workflow block]]
+
{{Image850|2022-12-12-workflow-fetchurl-2.png| Workflow Builder FetchURL block}}
  
 +
===Conditional Exits===
 +
The Fetch URL block may take one of three conditional exits:
  
== Conditional Exits ==
+
;Failed
The Fetch URL block may take one of two conditional exits: ''Failed'' or ''No Data''.
+
:The Failed conditional exit is taken if an error occurred during the HTTP method execution. See HTTP Response Codes below for details.
 +
;No Data
 +
:The No Data conditional exit is executed if no data is returned in the body of the HTTP response.
 +
;Timeout
 +
:The Timeout conditional exit executes when the processing time exceeds the value entered in the '''Request Timeout''' field.
  
=== Failed ===
+
===Settings===  
The Failed conditional exit is taken if an error occurred during the HTTP method execution. See [[#HTTPResponseCodes|HTTP Response Codes]] below for details.
+
Fetch URL workflow block settings
  
=== No Data ===
+
;Title text
The No Data conditional exit is executed if no data is returned in the body of the HTTP response.
+
:Title text is the name of the instance of the block, displayed in the flowchart.
  
 +
;Request type
 +
:The HTTP method used in the fetch.
  
[[File:WB-Fetch-URL-CE-52.PNG|300px|thumb|center|Fetch URL conditional exits]]
+
:{| class="wikitable"
 +
|-
 +
! Request Type (HTTP Method)
 +
! Content Type
 +
! Notes
 +
|-
 +
| GET
 +
|
 +
* application/json
 +
* application/x-www-form-urlencoded
 +
* application/soap+xml; charset=utf-8
 +
|  
 +
|-
 +
| POST
 +
|  
 +
* application/json
 +
* application/x-www-form-urlencoded
 +
* application/soap+xml; charset=utf-8
 +
* multipart/form-data
 +
* Single file upload, content-type set below
 +
|
 +
* Allows adding multiple attachment or text parts
 +
* Content type is optional. If not specified, the system uses the attachment’s content type
  
 +
|-
 +
| PUT
 +
|
 +
* application/json
 +
* application/x-www-form-urlencoded
 +
|
 +
|-
 +
| PATCH
 +
|
 +
* application/json
 +
* application/x-www-form-urlencoded
 +
|
 +
|-
 +
| DELETE
 +
|
 +
* application/json
 +
* application/x-www-form-urlencoded
 +
|
 +
|}
  
== Settings ==
+
{{LightBulb | Messenger integrations LINE and WhatsApp allow users to upload multiple attachments with the same name at the same time. Users should upload files one at a time with unique names as a best practice.}}
  
=== Title text ===
 
''Title text'' is the name of the instance of the block, displayed in the flowchart.
 
  
=== Request type ===
+
;URL to fetch
''Request type'' is the type of method to be used to fetch web content from the specified URL. Request types are defined in the pull-down menu.
+
:URL to fetch is the HTTP/HTTPS URL of the web content to get. Query string parameters are specified separately.
  
Select from the following request types, or write in another method manually:
+
;Extra headers
 +
:Extra headers are the HTTP headers to add to the request (e.g. for authentication purposes). Functions can be used by inserting them as a value. Click add to define a header, type in the name, and type in the value.
  
* GET (default)
+
:For example, a payment gateway may have a RESTful interface that requires authentication via “Authorization” header and SHA-256 hash of time, username, and password. To enable authentication, you would provide a request header with the name “Authorization” and the value like "bearer $(accessid)" where accessid is set to something like =hmac('SHA-256', '<key>', '<user>:<secret>').
* POST
 
* PUT
 
* PATCH
 
* DELETE
 
  
=== URL to fetch ===
+
;URL parameters
''URL to fetch'' is the HTTP/HTTPS URL of the web content to get. Query string parameters are specified separately.
+
: These are the URL parameters to be URL encoded and appended into URL. Workflow variables can be used by inserting them as $(varname). Click add to define URL parameters, type in the name, and type in the value.
  
=== Extra headers ===
+
;Content Type
''Extra headers'' are the HTTP headers to add to the request (e.g. for authentication purposes). Functions can be used by inserting them as a value. Click '''add''' to define a header, type in the name, and type in the value.
+
:The type of data supported in the request.
  
For example, a payment gateway may have a RESTful interface that requires authentication via “Authorization” header and SHA-256 hash of time, username, and password. To enable authentication, you would provide a request header with the ''name'' “Authorization” and the value ''“accessid==hmac(“SHA-256”, key, message)”''. Functions are described in the ''Workflow Builder Reference Guide'', section [[workflow-builder-reference-guide/Built-InFunctions|Built-in Functions]].
+
:{| class="wikitable"
 +
|-
 +
! Content Type
 +
! Request Type (HTTP Method)
 +
! Notes
 +
|-
 +
| application/json
 +
| GET, POST, PUT, PATCH, DELETE
 +
|
 +
|-
 +
| application/x-www-form-urlencoded
 +
| GET, POST, PUT, PATCH, DELETE
 +
|
 +
|-
 +
| application/soap+xml
 +
| GET, POST
 +
|
 +
|-
 +
| multipart/form-data
 +
| POST
 +
| Allows adding multiple attachment or text parts
 +
|-
 +
| single file upload, content-type set below
 +
| POST
 +
| Content type is optional. If not specified, the system uses the attachment’s content type.
 +
|} Please note that the content type drop-down contains the most common suggestions, and you can type your own content type value manually right over the drop-down box suggestion.  
  
=== URL parameters ===
+
;Body
These are the URL parameters to be URL encoded and appended into URL. Workflow variables can be used by inserting them as ''$(varname)''. Click '''add''' to define URL parameters, type in the name, and type in the value.
+
:Body is the data to be submitted in the request body. The setting is displayed only if request type POST is selected. The format of the data must correspond to the Content Type above. Workflow variable substitutions are allowed.
  
=== Content Type ===
+
;Username
''Content type'' is the type of data to be submitted in the request body. The setting is displayed only if request type POST is selected.
+
:Username is the request authentication username. Variable substitutions are allowed.
  
Select ''application/json'' for a JSON data structure, or select ''application/x-www-form-urlencoded'' for a URI-encoded data in the body of the message.
+
;Password
 +
:Password is the request authentication password. Variable substitutions are allowed.
  
=== Body ===
+
; Expected response body content is
''Body'' is the data to be submitted in the request body. The setting is displayed only if request type POST is selected.
+
: The expected format of the response body, with options for text, XML, and JSON.  
  
Body is the data to be submitted. The format of the data must correspond to the ''Content Type'' above. Workflow variable substitutions are allowed.
+
;Initial path in the result JSON
 +
:If the response body contains JSON, this setting can be used to save into workflow variables a specific part of the data. Example: myobject.node.list[4]. The default value is "none".  
  
=== Username ===
+
The path starts from the root of the returned JSON.
''Username'' is the request authentication username. Variable substitutions are allowed.
 
  
=== Password ===
+
;Scenario variable prefix for JSON data
''Password'' is the request authentication password. Variable substitutions are allowed.
+
:This string will be used as the name of the variable to receive parsed JSON data. Note that if the initial path above points to an array, depending on the value of the GetNext option below, this variable would either contain the array or its first (and subsequent) elements.
  
=== Initial path in the result JSON ===
+
;Use GetNext block to loop through data
If the response body contains JSON, this setting can be used to save into workflow variables a specific part of the data. Example: ''myobject.node.list[4]''. The default is "none"; the path starts from the root of the returned JSON.
+
:This box is selected if the JSON response data (at the initial path) is an array. The workflow variable will be set to the first element of the array and GetNext block could be used to iterate over the array elements, setting workflow variable to the next element.
  
=== Scenario variable prefix for JSON data ===
+
{{Note| If you enable this option, the behavior of the Fetch URL block will be the same as it was for Bright Pattern Contact Center version 3.13 and earlier.}}
This string will be used as the name of the variable to receive parsed JSON data. Note that if the initial path above points to an array, depending on the value of the ''GetNext'' option below, this variable would either contain the array or its first (and subsequent) elements.
 
  
=== Request timeout ===
+
; Extract variables
This option allows you to set a timeout for situations when processing external web service APIs run longer than expected, enabling the system to move to the next block if there is no API response within the time configured. The range for this field is between 2 and 100 seconds; when left blank, the set time defaults to 100 seconds. Note that this field is present only if an explicit value is entered.
+
: If the response body contains XML, this setting saves specific data into scenario variables organized by XPath and variable name. These variables are dynamically listed in the following format: ''XPath : variable''.
 +
:
 +
: Example: ''/response/receipt/ReceiptID: receiptID''
  
=== Use GetNext block to loop through data ===
 
This box is selected if the JSON response data (at the initial path) is an array. The workflow variable will be set to the first element of the array and ''GetNext'' block could be used to iterate over the array elements, setting workflow variable to the next element.
 
  
'''Note''': If you enable this option, the behavior of the Fetch URL block will be the same as it was for Bright Pattern Contact Center version 3.13 and earlier.
+
=== Response Data Handling ===
 +
In all cases, the response data is limited to 100 KB.
  
 +
{{Note | If the response data is not JSON-encoded, it could be accessed as string via the $(integrationResultBody) workflow variable described below.}}
  
[[File:2022.06.06_CCA_Workflows.FetchURL.png|650px|thumb|center|Fetch URL settings]]
 
 
 
== Response Data Handling ==
 
In all cases, the response data is limited to 50 KB.
 
 
If the response data is not JSON-encoded, it could be accessed as string via the ''$(integrationResultBody)'' workflow variable described below.
 
 
If the response data is JSON, the following will happen:
 
  
 +
: If the response data is JSON, the following will happen:
 
# It will be parsed.
 
# It will be parsed.
 
# If the "GetNext" option is enabled and the item the initial path is pointing to is a regular, non-associative array:
 
# If the "GetNext" option is enabled and the item the initial path is pointing to is a regular, non-associative array:
Line 92: Line 155:
 
## The GetNext block could be used to initialize the variable to the next and subsequent items.
 
## The GetNext block could be used to initialize the variable to the next and subsequent items.
 
# Otherwise, the workflow variable will be set to the item to which the initial path is pointing.
 
# Otherwise, the workflow variable will be set to the item to which the initial path is pointing.
 +
<br>
 +
: Syntax for the initial path setting and the access to the data saved in the workflow variable:
  
Possible syntax for the initial path setting and the access to the data saved in the workflow variable is as follows:
+
:* item. Subitem
 
+
:* item[index]
* ''item.subitem''
+
:* item[attr1=value].attr2
* ''item[index]''
+
:* combinations (e.g., item.subitem.array[index].value. Array[attr=x].value)
* ''item[attr1=value].attr2''
 
* combinations (e.g., ''item.subitem.array[index].value.array[attr=x].value'')
 
  
 +
If the response data is in XML format, the following occurs:
  
== HTTP Response Codes ==
+
# A note is shown to the user indicating that the FetchURL response body contains the response body text.
The status code and the body of the received HTTP response will be stored in local variables ''$(integrationResultCode)'' and ''$(integrationResultBody)'', respectively. For troubleshooting purposes, you may use the [[workflow-builder-reference-guide/EMail|EMail]] or [[workflow-builder-reference-guide/InternalMessage|Internal Message]] block to obtain content of responses indicating a failed attempt. For more information, see the description of variable ''$(integrationResultBody)''.
+
# An attempt to parse the response as XML occurs.
 +
## If XPath points to a value, the recordset name will be a variable paired with the XPath value.
 +
## If XPath points to a node, each attribute name will be paired with the recordset of the node. Child nodes of atomic value will have the child node's name paired with the recordset.
 +
# XPaths are applied, and recordsets are set, when XML is successfully parsed. XPaths without associated recordsets are assigned empty strings.
 +
# GetNext is used to retrieve the next value if an XPath matches and returns an array of values.
 +
 +
===HTTP Response Codes===  
 +
The status code and the body of the received HTTP response will be stored in local variables $(integrationResultCode) and $(integrationResultBody), respectively.  
  
For backward compatibility reasons, the code and the body of the received HTTP response are also stored in local variables ''$(fetchURLResultCode)'' and ''$(fetchURLResultBody)''.
+
For troubleshooting, you may use the [[workflow-builder-reference-guide/EMail|EMail]] or [[workflow-builder-reference-guide/InternalMessage|Internal Message]] block to obtain content of responses indicating a failed attempt.  
  
The possible values of the ''$(fetchURLResultCode)'' variable are as follows:
+
For more information, see the description of variable $(integrationResultBody).
  
* '''0''': 200 OK response (i.e., a successful HTTP request response)
+
For backward compatibility, the code and the body of the received HTTP response are also stored in local variables $(fetchURLResultCode) and $(fetchUR1LResultBody).
* '''-1''': 200 OK response, but unable to parse the body into recordset
 
* '''-2''': 200 OK response, but body length exceeds 50 KB
 
* '''-3''': Unable to connect to HTTP server or other connection errors
 
* '''-4:''' Incorrect JSON syntax in the request body when using PUT or POST requests
 
* '''Other''': Actual non-200 response code
 
  
 +
The possible values of the $(fetchURLResultCode) variable are as follows:
 +
* 0: 200 OK response (i.e., a successful HTTP request response)
 +
* -1: 200 OK response, but unable to parse the body into recordset
 +
* -2: 200 OK response, but body length exceeds 50 KB
 +
* -3: Unable to connect to HTTP server or other connection errors
 +
* -4: Incorrect JSON syntax in the request body when using PUT or POST requests
 +
* Other: Actual non-200 response code
  
=== HTTP Redirect Response Handling ===
+
===HTTP Redirect Response Handling===  
 
The Fetch URL block handles 3xx Hypertext Transfer Protocol (HTTP) response codes in the following way.
 
The Fetch URL block handles 3xx Hypertext Transfer Protocol (HTTP) response codes in the following way.
 
+
When the following codes are received, the block retries the request to the provided redirect URL using the GET request method:
When the following codes are received, the block retries the request to the provided redirect URL using the ''GET'' request method:
+
<br>
 
 
 
* 301 Moved Permanently
 
* 301 Moved Permanently
 
* 302 Found
 
* 302 Found
 
* 303 See Other (since HTTP/1.1)
 
* 303 See Other (since HTTP/1.1)
 
+
<br>
 
When the following codes are received, the block retries the request to the provided redirect URL using the originally specified request method:
 
When the following codes are received, the block retries the request to the provided redirect URL using the originally specified request method:
 
+
<br>
 
* 307 Temporary Redirect (since HTTP/1.1)
 
* 307 Temporary Redirect (since HTTP/1.1)
 
* 308 Permanent Redirect (RFC 7538)
 
* 308 Permanent Redirect (RFC 7538)
 
+
<br>
 
When the following status codes are received, the conditional exit Failed will be selected:
 
When the following status codes are received, the conditional exit Failed will be selected:
 
 
* 300 Multiple Choices
 
* 300 Multiple Choices
 
* 304 Not Modified (RFC 7232)
 
* 304 Not Modified (RFC 7232)
 
* 305 Use Proxy (since HTTP/1.1)
 
* 305 Use Proxy (since HTTP/1.1)
 
* 306 Switch Proxy
 
* 306 Switch Proxy
 
 
 
 
</translate>
 

Revision as of 19:11, 5 December 2024

• 5.19 • 5.2 • 5.3 • 5.8


Fetch URL

Requests web content from a URL over HTTP/HTTPS using a GET, POST, PUT, PATCH, or DELETE and parses received data into workflow variables.

Workflow Builder FetchURL block

Conditional Exits

The Fetch URL block may take one of three conditional exits:

Failed
The Failed conditional exit is taken if an error occurred during the HTTP method execution. See HTTP Response Codes below for details.
No Data
The No Data conditional exit is executed if no data is returned in the body of the HTTP response.
Timeout
The Timeout conditional exit executes when the processing time exceeds the value entered in the Request Timeout field.

Settings

Fetch URL workflow block settings

Title text
Title text is the name of the instance of the block, displayed in the flowchart.
Request type
The HTTP method used in the fetch.
Request Type (HTTP Method) Content Type Notes
GET
  • application/json
  • application/x-www-form-urlencoded
  • application/soap+xml; charset=utf-8
POST
  • application/json
  • application/x-www-form-urlencoded
  • application/soap+xml; charset=utf-8
  • multipart/form-data
  • Single file upload, content-type set below
  • Allows adding multiple attachment or text parts
  • Content type is optional. If not specified, the system uses the attachment’s content type
PUT
  • application/json
  • application/x-www-form-urlencoded
PATCH
  • application/json
  • application/x-www-form-urlencoded
DELETE
  • application/json
  • application/x-www-form-urlencoded


Bulb-on.50x50.png Messenger integrations LINE and WhatsApp allow users to upload multiple attachments with the same name at the same time. Users should upload files one at a time with unique names as a best practice.



URL to fetch
URL to fetch is the HTTP/HTTPS URL of the web content to get. Query string parameters are specified separately.
Extra headers
Extra headers are the HTTP headers to add to the request (e.g. for authentication purposes). Functions can be used by inserting them as a value. Click add to define a header, type in the name, and type in the value.
For example, a payment gateway may have a RESTful interface that requires authentication via “Authorization” header and SHA-256 hash of time, username, and password. To enable authentication, you would provide a request header with the name “Authorization” and the value like "bearer $(accessid)" where accessid is set to something like =hmac('SHA-256', '<key>', '<user>:<secret>').
URL parameters
These are the URL parameters to be URL encoded and appended into URL. Workflow variables can be used by inserting them as $(varname). Click add to define URL parameters, type in the name, and type in the value.
Content Type
The type of data supported in the request.
Content Type Request Type (HTTP Method) Notes
application/json GET, POST, PUT, PATCH, DELETE
application/x-www-form-urlencoded GET, POST, PUT, PATCH, DELETE
application/soap+xml GET, POST
multipart/form-data POST Allows adding multiple attachment or text parts
single file upload, content-type set below POST Content type is optional. If not specified, the system uses the attachment’s content type.
Please note that the content type drop-down contains the most common suggestions, and you can type your own content type value manually right over the drop-down box suggestion.
Body
Body is the data to be submitted in the request body. The setting is displayed only if request type POST is selected. The format of the data must correspond to the Content Type above. Workflow variable substitutions are allowed.
Username
Username is the request authentication username. Variable substitutions are allowed.
Password
Password is the request authentication password. Variable substitutions are allowed.
Expected response body content is
The expected format of the response body, with options for text, XML, and JSON.
Initial path in the result JSON
If the response body contains JSON, this setting can be used to save into workflow variables a specific part of the data. Example: myobject.node.list[4]. The default value is "none".

The path starts from the root of the returned JSON.

Scenario variable prefix for JSON data
This string will be used as the name of the variable to receive parsed JSON data. Note that if the initial path above points to an array, depending on the value of the GetNext option below, this variable would either contain the array or its first (and subsequent) elements.
Use GetNext block to loop through data
This box is selected if the JSON response data (at the initial path) is an array. The workflow variable will be set to the first element of the array and GetNext block could be used to iterate over the array elements, setting workflow variable to the next element.


Info.40x40.png If you enable this option, the behavior of the Fetch URL block will be the same as it was for Bright Pattern Contact Center version 3.13 and earlier.


Extract variables
If the response body contains XML, this setting saves specific data into scenario variables organized by XPath and variable name. These variables are dynamically listed in the following format: XPath : variable.
Example: /response/receipt/ReceiptID: receiptID


Response Data Handling

In all cases, the response data is limited to 100 KB.


Info.40x40.png If the response data is not JSON-encoded, it could be accessed as string via the $(integrationResultBody) workflow variable described below.



If the response data is JSON, the following will happen:
  1. It will be parsed.
  2. If the "GetNext" option is enabled and the item the initial path is pointing to is a regular, non-associative array:
    1. The workflow variable will be set to the first item of the array.
    2. The GetNext block could be used to initialize the variable to the next and subsequent items.
  3. Otherwise, the workflow variable will be set to the item to which the initial path is pointing.


Syntax for the initial path setting and the access to the data saved in the workflow variable:
  • item. Subitem
  • item[index]
  • item[attr1=value].attr2
  • combinations (e.g., item.subitem.array[index].value. Array[attr=x].value)

If the response data is in XML format, the following occurs:

  1. A note is shown to the user indicating that the FetchURL response body contains the response body text.
  2. An attempt to parse the response as XML occurs.
    1. If XPath points to a value, the recordset name will be a variable paired with the XPath value.
    2. If XPath points to a node, each attribute name will be paired with the recordset of the node. Child nodes of atomic value will have the child node's name paired with the recordset.
  3. XPaths are applied, and recordsets are set, when XML is successfully parsed. XPaths without associated recordsets are assigned empty strings.
  4. GetNext is used to retrieve the next value if an XPath matches and returns an array of values.

HTTP Response Codes

The status code and the body of the received HTTP response will be stored in local variables $(integrationResultCode) and $(integrationResultBody), respectively.

For troubleshooting, you may use the EMail or Internal Message block to obtain content of responses indicating a failed attempt.

For more information, see the description of variable $(integrationResultBody).

For backward compatibility, the code and the body of the received HTTP response are also stored in local variables $(fetchURLResultCode) and $(fetchUR1LResultBody).

The possible values of the $(fetchURLResultCode) variable are as follows:

  • 0: 200 OK response (i.e., a successful HTTP request response)
  • -1: 200 OK response, but unable to parse the body into recordset
  • -2: 200 OK response, but body length exceeds 50 KB
  • -3: Unable to connect to HTTP server or other connection errors
  • -4: Incorrect JSON syntax in the request body when using PUT or POST requests
  • Other: Actual non-200 response code

HTTP Redirect Response Handling

The Fetch URL block handles 3xx Hypertext Transfer Protocol (HTTP) response codes in the following way. When the following codes are received, the block retries the request to the provided redirect URL using the GET request method:

  • 301 Moved Permanently
  • 302 Found
  • 303 See Other (since HTTP/1.1)


When the following codes are received, the block retries the request to the provided redirect URL using the originally specified request method:

  • 307 Temporary Redirect (since HTTP/1.1)
  • 308 Permanent Redirect (RFC 7538)


When the following status codes are received, the conditional exit Failed will be selected:

  • 300 Multiple Choices
  • 304 Not Modified (RFC 7232)
  • 305 Use Proxy (since HTTP/1.1)
  • 306 Switch Proxy
    < Previous | Next >