Modifying Request and Response
As we've seen in the previous examples, actions get called with the request and response objects (named req and res in the examples) passed as parameters to their handler functions.
The req object contains the incoming HTTP request, which might or might not have been modified by a previous action (if actions were chained).
A handler can modify the request object in place if desired. This might be useful when writing middleware (see below) that is used to intercept incoming requests, modify them and pass them to the actual handlers.
While modifying the request object might not be that relevant for non-middleware actions, modifying the response object definitely is. Modifying the response object is an action's only way to return data to the caller of the action.
We've already seen how to set the HTTP status code, the content type, and the result body. The res object has the following properties for these:
- contentType: MIME type of the body as defined in the HTTP standard (e.g. text/html, text/plain, application/json, ...)
- responsecode: the HTTP status code of the response as defined in the HTTP standard. Common values for actions that succeed are 200 or 201. Please refer to the HTTP standard for more information.
- body: the actual response data
To set or modify arbitrary headers of the response object, the headers property can be used. For example, to add a user-defined header to the response, the following code will do:
res.headers = res.headers || { }; // headers might or might not be present
res.headers['X-Test'] = 'someValue'; // set header X-Test to "someValue"
This will set the additional HTTP header X-Test to value someValue. Other headers can be set as well. Note that ArangoDB might change the case of the header names to lower case when assembling the overall response that is sent to the caller.
It is not necessary to explicitly set a Content-Length header for the response as ArangoDB will calculate the content length automatically and add this header itself. ArangoDB might also add a Connection header itself to handle HTTP keep-alive.
ArangoDB also supports automatic transformation of the body data to another format. Currently, the only supported transformations are base64-encoding and base64-decoding. Using the transformations, an action can create a base64 encoded body and still let ArangoDB send the non-encoded version, for example:
res.body = 'VGhpcyBpcyBhIHRlc3Q=';
res.transformations = res.transformations || [ ]; // initialize
res.transformations.push('base64decode'); // will base64 decode the response body
When ArangoDB processes the response, it will base64-decode what's in res.body and set the HTTP header Content-Encoding: binary. The opposite can be achieved with the base64encode transformation: ArangoDB will then automatically base64-encode the body and set a Content-Encoding: base64 HTTP header.
Writing dynamic action handlers
To write your own dynamic action handlers, you must put them into modules.
Modules are a means of organizing action handlers and making them loadable under specific names.
To start, we'll define a simple action handler in a module /ownTest:
arangosh> db._modules.save({
........> path: "/db:/ownTest",
........> content:
........> "exports.do = function(req, res, options, next) {"+
........> " res.body = 'test';" +
........> " res.responseCode = 200;" +
........> " res.contentType = 'text/plain';" +
........> "};"
........> });
{
"_id" : "_modules/8995",
"_key" : "8995",
"_rev" : "_VTxSgpi---"
}
arangosh> db._modules.save({
........> path: "/db:/ownTest",
........> content:
........> "exports.do = function(req, res, options, next) {"+
........> " res.body = 'test';" +
........> " res.responseCode = 200;" +
........> " res.contentType = 'text/plain';" +
........> "};"
........> });
This does nothing but register a do action handler in a module /ownTest. The action handler is not yet callable, but must be mapped to a route first. To map the action to the route /ourtest, execute the following command:
arangosh> db._routing.save({
........> url: "/ourtest",
........> action: {
........> controller: "db://ownTest"
........> }
........> });
{
"_id" : "_routing/8999",
"_key" : "8999",
"_rev" : "_VTxSgpu---"
}
arangosh> require("internal").reloadRouting()
arangosh> db._routing.save({
........> url: "/ourtest",
........> action: {
........> controller: "db://ownTest"
........> }
........> });
arangosh> require("internal").reloadRouting()
Now use the browser or cURL and access http://localhost:8529/ourtest :
shell> curl --dump - http://localhost:8529/ourtest HTTP/1.1 200 OK content-type: text/plain x-content-type-options: nosniff "test"
You will see that the module's do function has been executed.
A Word about Caching
Sometimes it might seem that your change do not take effect. In this case the culprit could be the routing caches:
The routing cache stores the routing information computed from the _routing collection. Whenever you change this collection manually, you need to call
arangosh> require("internal").reloadRouting()
in order to rebuild the cache.
Advanced Usages
For detailed information see the reference manual.
Redirects
Use the following for a permanent redirect:
arangosh> db._routing.save({
........> url: "/redirectMe",
........> action: {
........> do: "@arangodb/actions/redirectRequest",
........> options: {
........> permanently: true,
........> destination: "/somewhere.else/"
........> }
........> }
........> });
{
"_id" : "_routing/9020",
"_key" : "9020",
"_rev" : "_VTxSguK---"
}
arangosh> require("internal").reloadRouting()
arangosh> db._routing.save({
........> url: "/redirectMe",
........> action: {
........> do: "@arangodb/actions/redirectRequest",
........> options: {
........> permanently: true,
........> destination: "/somewhere.else/"
........> }
........> }
........> });
arangosh> require("internal").reloadRouting()
shell> curl --dump - http://localhost:8529/redirectMe
HTTP/1.1 301 Moved Permanently
content-type: text/html
x-content-type-options: nosniff
location: /somewhere.else/
"<html><head><title>Moved</title></head><body><h1>Moved</h1><p>This page has moved to <a href=\"/somewhere.else/\">/somewhere.else/</a>.</p></body></html>"
Routing Bundles
Instead of adding all routes for package separately, you can specify a bundle:
arangosh> db._routing.save({
........> routes: [
........> {
........> url: "/url1",
........> content: "route 1"
........> },
........> {
........> url: "/url2",
........> content: "route 2"
........> },
........> {
........> url: "/url3",
........> content: "route 3"
........> }
........> ]
........> });
{
"_id" : "_routing/9034",
"_key" : "9034",
"_rev" : "_VTxSgye---"
}
arangosh> require("internal").reloadRouting()
arangosh> db._routing.save({
........> routes: [
........> {
........> url: "/url1",
........> content: "route 1"
........> },
........> {
........> url: "/url2",
........> content: "route 2"
........> },
........> {
........> url: "/url3",
........> content: "route 3"
........> }
........> ]
........> });
arangosh> require("internal").reloadRouting()
shell> curl --dump - http://localhost:8529/url2 HTTP/1.1 200 OK content-type: text/plain x-content-type-options: nosniff "route 2" shell> curl --dump - http://localhost:8529/url3 HTTP/1.1 200 OK content-type: text/plain x-content-type-options: nosniff "route 3"
The advantage is, that you can put all your routes into one document and use a common prefix.
arangosh> db._routing.save({
........> urlPrefix: "/test",
........> routes: [
........> {
........> url: "/url1",
........> content: "route 1"
........> },
........> {
........> url: "/url2",
........> content: "route 2"
........> },
........> {
........> url: "/url3",
........> content: "route 3"
........> }
........> ]
........> });
{
"_id" : "_routing/9048",
"_key" : "9048",
"_rev" : "_VTxSg2a---"
}
arangosh> require("internal").reloadRouting()
arangosh> db._routing.save({
........> urlPrefix: "/test",
........> routes: [
........> {
........> url: "/url1",
........> content: "route 1"
........> },
........> {
........> url: "/url2",
........> content: "route 2"
........> },
........> {
........> url: "/url3",
........> content: "route 3"
........> }
........> ]
........> });
arangosh> require("internal").reloadRouting()
will define the URL /test/url1, /test/url2, and /test/url3:
shell> curl --dump - http://localhost:8529/test/url1 HTTP/1.1 200 OK content-type: text/plain x-content-type-options: nosniff "route 1" shell> curl --dump - http://localhost:8529/test/url2 HTTP/1.1 200 OK content-type: text/plain x-content-type-options: nosniff "route 2" shell> curl --dump - http://localhost:8529/test/url3 HTTP/1.1 200 OK content-type: text/plain x-content-type-options: nosniff "route 3"
Writing Middleware
Assume, you want to log every request in your namespace to the console. (if ArangoDB is running as a daemon, this will end up in the logfile). In this case you can easily define an action for the URL /subdirectory. This action simply logs the requests, calls the next in line, and logs the response:
arangosh> db._modules.save({
........> path: "/db:/OwnMiddlewareTest",
........> content:
........> "exports.logRequest = function (req, res, options, next) {" +
........> " console = require('console'); " +
........> " console.log('received request: %s', JSON.stringify(req));" +
........> " next();" +
........> " console.log('produced response: %s', JSON.stringify(res));" +
........> "};"
........> });
{
"_id" : "_modules/9062",
"_key" : "9062",
"_rev" : "_VTxSg8e---"
}
arangosh> db._modules.save({
........> path: "/db:/OwnMiddlewareTest",
........> content:
........> "exports.logRequest = function (req, res, options, next) {" +
........> " console = require('console'); " +
........> " console.log('received request: %s', JSON.stringify(req));" +
........> " next();" +
........> " console.log('produced response: %s', JSON.stringify(res));" +
........> "};"
........> });
This function will now be available as db://OwnMiddlewareTest/logRequest. You need to tell ArangoDB that it is should use a prefix match and that the shortest match should win in this case:
arangosh> db._routing.save({
........> middleware: [
........> {
........> url: {
........> match: "/subdirectory/*"
........> },
........> action: {
........> do: "db://OwnMiddlewareTest/logRequest"
........> }
........> }
........> ]
........> });
{
"_id" : "_routing/9066",
"_key" : "9066",
"_rev" : "_VTxSg8m---"
}
arangosh> db._routing.save({
........> middleware: [
........> {
........> url: {
........> match: "/subdirectory/*"
........> },
........> action: {
........> do: "db://OwnMiddlewareTest/logRequest"
........> }
........> }
........> ]
........> });
When you call next() in that action, the next specific routing will be used for the original URL. Even if you modify the URL in the request object req, this will not cause the next() to jump to the routing defined for this next URL. If proceeds occurring the origin URL. However, if you use next(true), the routing will stop and request handling is started with the new URL. You must ensure that next(true) is never called without modifying the URL in the request object req. Otherwise an endless loop will occur.
Now we add some other simple routings to test all this:
arangosh> db._routing.save({
........> url: "/subdirectory/ourtest/1",
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
{
"_id" : "_routing/9070",
"_key" : "9070",
"_rev" : "_VTxSg9C---"
}
arangosh> db._routing.save({
........> url: "/subdirectory/ourtest/2",
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
{
"_id" : "_routing/9073",
"_key" : "9073",
"_rev" : "_VTxSg9G---"
}
arangosh> db._routing.save({
........> url: "/subdirectory/ourtest/3",
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
{
"_id" : "_routing/9076",
"_key" : "9076",
"_rev" : "_VTxSg9K---"
}
arangosh> require("internal").reloadRouting()
arangosh> db._routing.save({
........> url: "/subdirectory/ourtest/1",
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
arangosh> db._routing.save({
........> url: "/subdirectory/ourtest/2",
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
arangosh> db._routing.save({
........> url: "/subdirectory/ourtest/3",
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
arangosh> require("internal").reloadRouting()
Then we send some curl requests to these sample routes:
shell> curl --dump - http://localhost:8529/subdirectory/ourtest/1
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
{
"request" : {
"authorized" : true,
"user" : "root",
"database" : "_system",
"url" : "/subdirectory/ourtest/1",
"protocol" : "http",
"server" : {
"address" : "127.0.0.1",
"port" : 15554
},
"client" : {
"address" : "127.0.0.1",
"port" : 49646,
"id" : "150050101097624"
},
"internals" : {
},
"headers" : {
"host" : "127.0.0.1",
"authorization" : "Basic cm9vdDo=",
"connection" : "Keep-Alive",
"user-agent" : "ArangoDB",
"accept-encoding" : "deflate"
},
"requestType" : "GET",
"parameters" : {
},
"cookies" : {
},
"urlParameters" : {
}
},
"options" : {
}
}
shell> curl --dump - http://localhost:8529/subdirectory/ourtest/2
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
{
"request" : {
"authorized" : true,
"user" : "root",
"database" : "_system",
"url" : "/subdirectory/ourtest/2",
"protocol" : "http",
"server" : {
"address" : "127.0.0.1",
"port" : 15554
},
"client" : {
"address" : "127.0.0.1",
"port" : 49646,
"id" : "150050101097624"
},
"internals" : {
},
"headers" : {
"host" : "127.0.0.1",
"authorization" : "Basic cm9vdDo=",
"connection" : "Keep-Alive",
"user-agent" : "ArangoDB",
"accept-encoding" : "deflate"
},
"requestType" : "GET",
"parameters" : {
},
"cookies" : {
},
"urlParameters" : {
}
},
"options" : {
}
}
shell> curl --dump - http://localhost:8529/subdirectory/ourtest/3
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
{
"request" : {
"authorized" : true,
"user" : "root",
"database" : "_system",
"url" : "/subdirectory/ourtest/3",
"protocol" : "http",
"server" : {
"address" : "127.0.0.1",
"port" : 15554
},
"client" : {
"address" : "127.0.0.1",
"port" : 49646,
"id" : "150050101097624"
},
"internals" : {
},
"headers" : {
"host" : "127.0.0.1",
"authorization" : "Basic cm9vdDo=",
"connection" : "Keep-Alive",
"user-agent" : "ArangoDB",
"accept-encoding" : "deflate"
},
"requestType" : "GET",
"parameters" : {
},
"cookies" : {
},
"urlParameters" : {
}
},
"options" : {
}
}
shell> curl --dump - http://localhost:8529/subdirectory/ourtest/1
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
and the console (and / or the logfile) will show requests and replies. Note that logging doesn't warrant the sequence in which these lines will appear.
Application Deployment
Using single routes or bundles can be become a bit messy in large applications. Kaerus has written a deployment tool in node.js.
Note that there is also Foxx for building applications with ArangoDB.
Common Pitfalls when using Actions
Caching
If you made any changes to the routing but the changes does not have any effect when calling the modified actions URL, you might have been hit by some caching issues.
After any modification to the routing or actions, it is thus recommended to make the changes "live" by calling the following functions from within arangosh:
You might also be affected by client-side caching. Browsers tend to cache content and also redirection URLs. You might need to clear or disable the browser cache in some cases to see your changes in effect.
Data types
When processing the request data in an action, please be aware that the data type of all query parameters is string. This is because the whole URL is a string and when the individual parts are extracted, they will also be strings.
For example, when calling the URL http:// localhost:8529/hello/world?value=5
the parameter value will have a value of (string) 5, not (number) 5. This might be troublesome if you use JavaScript's === operator when checking request parameter values.
The same problem occurs with incoming HTTP headers. When sending the following header from a client to ArangoDB
X-My-Value: 5
then the header X-My-Value will have a value of (string) 5 and not (number) 5.
404 Not Found
If you defined a URL in the routing and the URL is accessible fine via HTTP GET but returns an HTTP 501 (not implemented) for other HTTP methods such as POST, PUT or DELETE, then you might have been hit by some defaults.
By default, URLs defined like this (simple string url attribute) are accessible via HTTP GET and HEAD only. To make such URLs accessible via other HTTP methods, extend the URL definition with the methods attribute.
For example, this definition only allows access via GET and HEAD:
{
url: "/hello/world"
}
whereas this definition allows HTTP GET, POST, and PUT:
arangosh> db._routing.save({
........> url: {
........> match: "/hello/world",
........> methods: [ "get", "post", "put" ]
........> },
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
{
"_id" : "_routing/9111",
"_key" : "9111",
"_rev" : "_VTxShDK---"
}
arangosh> require("internal").reloadRouting()
arangosh> db._routing.save({
........> url: {
........> match: "/hello/world",
........> methods: [ "get", "post", "put" ]
........> },
........> action: {
........> do: "@arangodb/actions/echoRequest"
........> }
........> });
arangosh> require("internal").reloadRouting()
shell> curl --dump - http://localhost:8529/hello/world
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
{
"request" : {
"authorized" : true,
"user" : "root",
"database" : "_system",
"url" : "/hello/world",
"protocol" : "http",
"server" : {
"address" : "127.0.0.1",
"port" : 15554
},
"client" : {
"address" : "127.0.0.1",
"port" : 49646,
"id" : "150050101097624"
},
"internals" : {
},
"headers" : {
"host" : "127.0.0.1",
"authorization" : "Basic cm9vdDo=",
"connection" : "Keep-Alive",
"user-agent" : "ArangoDB",
"accept-encoding" : "deflate"
},
"requestType" : "GET",
"parameters" : {
},
"cookies" : {
},
"urlParameters" : {
}
},
"options" : {
}
}
shell> curl -X POST --data-binary @- --dump - http://localhost:8529/hello/world <<EOF
{hello: 'world'}
EOF
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
{
"request" : {
"authorized" : true,
"user" : "root",
"database" : "_system",
"url" : "/hello/world",
"protocol" : "http",
"server" : {
"address" : "127.0.0.1",
"port" : 15554
},
"client" : {
"address" : "127.0.0.1",
"port" : 49646,
"id" : "150050101097624"
},
"internals" : {
},
"headers" : {
"host" : "127.0.0.1",
"authorization" : "Basic cm9vdDo=",
"content-length" : "16",
"connection" : "Keep-Alive",
"user-agent" : "ArangoDB",
"accept-encoding" : "deflate"
},
"requestType" : "POST",
"requestBody" : "{hello: 'world'}",
"parameters" : {
},
"cookies" : {
},
"urlParameters" : {
}
},
"options" : {
}
}
shell> curl -X PUT --data-binary @- --dump - http://localhost:8529/hello/world <<EOF
{hello: 'world'}
EOF
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
{
"request" : {
"authorized" : true,
"user" : "root",
"database" : "_system",
"url" : "/hello/world",
"protocol" : "http",
"server" : {
"address" : "127.0.0.1",
"port" : 15554
},
"client" : {
"address" : "127.0.0.1",
"port" : 49646,
"id" : "150050101097624"
},
"internals" : {
},
"headers" : {
"host" : "127.0.0.1",
"authorization" : "Basic cm9vdDo=",
"content-length" : "16",
"connection" : "Keep-Alive",
"user-agent" : "ArangoDB",
"accept-encoding" : "deflate"
},
"requestType" : "PUT",
"requestBody" : "{hello: 'world'}",
"parameters" : {
},
"cookies" : {
},
"urlParameters" : {
}
},
"options" : {
}
}
shell> curl -X DELETE --dump - http://localhost:8529/hello/world
HTTP/1.1 404 Not Found
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
{
"error" : true,
"code" : 404,
"errorNum" : 404,
"errorMessage" : "unknown path '/hello/world'"
}
shell> curl --dump - http://localhost:8529/hello/world
HTTP/1.1 200 OK
content-type: application/json; charset=utf-8
x-content-type-options: nosniff
The former definition (defining url as an object with a match attribute) will result in the URL being accessible via all supported HTTP methods (e.g. GET, POST, PUT, DELETE, ...), whereas the latter definition (providing a string url attribute) will result in the URL being accessible via HTTP GET and HTTP HEAD only, with all other HTTP methods being disabled. Calling a URL with an unsupported or disabled HTTP method will result in an HTTP 404 error.