Message Transformers play a very important role in enabling the loose-coupling of Message Producers and Message Consumers. Rather than requiring every Message-producing component to know what type is expected by the next consumer, Transformers can be added between those components. Generic transformers, such as one that converts a String to an XML Document, are also highly reusable.
For some systems, it may be best to provide a Canonical Data Model, but Spring Integration's general philosophy is not to require any particular format. Rather, for maximum flexibility, Spring Integration aims to provide the simplest possible model for extension. As with the other endpoint types, the use of declarative configuration in XML and/or Annotations enables simple POJOs to be adapted for the role of Message Transformers. These configuration options will be described below.
Note | |
---|---|
For the same reason of maximizing flexibility, Spring does not require XML-based Message payloads. Nevertheless, the framework does provide some convenient Transformers for dealing with XML-based payloads if that is indeed the right choice for your application. For more information on those transformers, see Chapter 29, XML Support - Dealing with XML Payloads. |
The <transformer> element is used to create a Message-transforming endpoint. In addition to "input-channel" and "output-channel" attributes, it requires a "ref". The "ref" may either point to an Object that contains the @Transformer annotation on a single method (see below) or it may be combined with an explicit method name value provided via the "method" attribute.
<int:transformer id="testTransformer" ref="testTransformerBean" input-channel="inChannel" method="transform" output-channel="outChannel"/> <beans:bean id="testTransformerBean" class="org.foo.TestTransformer" />
Using a "ref" attribute is generally recommended if the custom transformer handler implementation can be reused in
other <transformer>
definitions. However if the custom transformer handler implementation should
be scoped to a single definition of the <transformer>
, you can define an inner bean definition:
<int:transformer id="testTransformer" input-channel="inChannel" method="transform" output-channel="outChannel"> <beans:bean class="org.foo.TestTransformer"/> </transformer>
Note | |
---|---|
Using both the "ref" attribute and an inner handler definition in the same |
The method that is used for transformation may expect either the Message
type or
the payload type of inbound Messages. It may also accept Message header values either individually or as a full
map by using the @Header
and @Headers
parameter annotations respectively. The return value of the method can be
any type. If the return value is itself a Message
, that will be passed along to
the transformer's output channel.
As of Spring Integration 2.0, a Message Transformer's transformation method can no longer return null
.
Returning null
will result in an exception since a Message Transformer should always be expected to
transform each source Message into a valid target Message. In other words, a Message Transformer should not be used
as a Message Filter since there is a dedicated <filter> option for that. However, if you do need this type of
behavior (where a component might return NULL and that should not be considered an error), a
service-activator could be used. Its requires-reply
value is FALSE by default,
but that can be set to TRUE in order to have Exceptions thrown for NULL return values as with the transformer.
Transformers and Spring Expression Language (SpEL)
Just like Routers, Aggregators and other components, as of Spring Integration 2.0 Transformers can also benefit from SpEL support (http://static.springsource.org/spring/docs/3.0.x/spring-framework-reference/html/expressions.html) whenever transformation logic is relatively simple.
<int:transformer input-channel="inChannel" output-channel="outChannel" expression="payload.toUpperCase() + '- [' + T(java.lang.System).currentTimeMillis() + ']'"/>
In the above configuration we are achieving a simple transformation of the payload with a simple SpEL expression and without writing a custom transformer. Our payload (assuming String) will be upper-cased and concatenated with the current timestamp with some simple formatting.
Common Transformers
There are also a few Transformer implementations available out of the box. Because, it is fairly common
to use the toString()
representation of an Object, Spring Integration provides an
ObjectToStringTransformer
whose output is a Message with a String payload. That String
is the result of invoking the toString() operation on the inbound Message's payload.
<int:object-to-string-transformer input-channel="in" output-channel="out"/>
A potential example for this would be sending some arbitrary object to the 'outbound-channel-adapter' in the
file namespace. Whereas that Channel Adapter only supports String, byte-array, or
java.io.File
payloads by default, adding this transformer immediately before the
adapter will handle the necessary conversion. Of course, that works fine as long as the result of the
toString()
call is what you want to be written to the File. Otherwise, you can
just provide a custom POJO-based Transformer via the generic 'transformer' element shown previously.
Tip | |
---|---|
When debugging, this transformer is not typically necessary since the 'logging-channel-adapter' is capable of logging the Message payload. Refer to the section called “Wire Tap” for more detail. |
If you need to serialize an Object to a byte array or deserialize a byte array back into an Object, Spring Integration provides symmetrical serialization transformers. These will use standard Java serialization by default, but you can provide an implementation of Spring 3.0's Serializer or Deserializer strategies via the 'serializer' and 'deserializer' attributes, respectively.
<int:payload-serializing-transformer input-channel="objectsIn" output-channel="bytesOut"/> <int:payload-deserializing-transformer input-channel="bytesIn" output-channel="objectsOut"/>
Object-to-Map Transformer
Spring Integration also provides Object-to-Map and Map-to-Object transformers which utilize the Spring Expression Language (SpEL) to serialize and de-serialize the object graphs. The object hierarchy is introspected to the most primitive types (String, int, etc.). The path to this type is described via SpEL, which becomes the key in the transformed Map. The primitive type becomes the value.
For example:
public class Parent{ private Child child; private String name; // setters and getters are omitted } public class Child{ private String name; private List<String> nickNames; // setters and getters are omitted }
... will be transformed to a Map which looks like this:
{person.name=George, person.child.name=Jenna, person.child.nickNames[0]=Bimbo . . . etc}
The SpEL-based Map allows you to describe the object structure without sharing the actual types allowing you to restore/rebuild the object graph into a differently typed Object graph as long as you maintain the structure.
For example: The above structure could be easily restored back to the following Object graph via the Map-to-Object transformer:
public class Father { private Kid child; private String name; // setters and getters are omitted } public class Kid { private String name; private List<String> nickNames; // setters and getters are omitted }
To configure these transformers, Spring Integration provides namespace support Object-to-Map:
<int:object-to-map-transformer input-channel="directInput" output-channel="output"/>
Map-to-Object
<int:map-to-object-transformer input-channel="input" output-channel="output" type="org.foo.Person"/>
or
<int:map-to-object-transformer input-channel="inputA" output-channel="outputA" ref="person"/> <bean id="person" class="org.foo.Person" scope="prototype"/>
Note | |
---|---|
NOTE: 'ref' and 'type' attributes are mutually exclusive. You can only use one. Also, if using the 'ref' attribute, you must point to a 'prototype' scoped bean, otherwise a BeanCreationException will be thrown. |
JSON Transformers
Object to JSON and JSON to Object transformers are provided.
<int:object-to-json-transformer input-channel="objectMapperInput"/>
<int:json-to-object-transformer input-channel="objectMapperInput" type="foo.MyDomainObject"/>
These use a vanilla Jackson ObjectMapper by default. If you wish to customize the ObjectMapper (for example, to configure the 'ALLOW_COMMENTS' feature when parsing JSON), you can supply a reference to your custom ObjectMapper bean using the object-mapper attribute.
<int:json-to-object-transformer input-channel="objectMapperInput" type="foo.MyDomainObject" object-mapper="customObjectMapper"/>
You may wish to consider using a FactoryBean or simple factory method to create the ObjectMapper with the required characteristics.
public class ObjectMapperFactory { public static ObjectMapper getMapper() { ObjectMapper mapper = new ObjectMapper(); mapper.configure(JsonParser.Feature.ALLOW_COMMENTS, true); return mapper; } }
<bean id="customObjectMapper" class="foo.ObjectMapperFactory" factory-method="getMapper"/>
Important | |
---|---|
Beginning with version 2.2, the
It you wish to set the content type header to some other value, or explicitly overwrite any existing header
with some value (including The behavior of adding the default header has a side affect - causing applications with the following sequence to fail:
This is because the default If you are using this pattern, there are a number of ways to configure the environment so that JSON conversion will be performed correctly. One solution is to set the content type to a text type, so the inbound converter will convert the JSON to String. This solution requires a change to just the outbound application.
<object-to-json-transformer ... content-type="text/x-json"/>
The second solution is to eliminate the json transformers altogether and use an
The third solution is to eliminate the json-to-object-transformer in just
the inbound application and use an
<bean id="jsonConverterWithPOType" class="org.springframework.amqp.support.converter.JsonMessageConverter"> <property name="classMapper"> <bean class="org.springframework.amqp.support.converter.DefaultClassMapper"> <property name="defaultType" value="foo.PurchaseOrder" /> </bean> </property> </bean> <int-amqp:inbound-channel-adapter ... message-converter="jsonConverterWithPOType" ... /> |
The @Transformer
annotation can also be added to methods that expect either the
Message
type or the message payload type. The return value will be handled in the
exact same way as described above in the section describing the <transformer> element.
@Transformer Order generateOrder(String productId) { return new Order(productId); }
Transformer methods may also accept the @Header and @Headers annotations that is documented in Section E.5, “Annotation Support”
@Transformer Order generateOrder(String productId, @Header("customerName") String customer) { return new Order(productId, customer); }
<int:header-filter input-channel="inputChannel" output-channel="outputChannel" header-names="lastName, state"/>As you can see, configuration of a Header Filter is quite simple. It is a typical endpoint with input/output channels and a
header-names
attribute. That attribute accepts the names of the header(s) (delimited by commas if there are multiple)
that need to be removed. So, in the above example the headers named 'lastName' and 'state' will not be present on the outbound Message.
At times you may have a requirement to enhance a request with more information than was provided by the target system. The Content Enricher pattern describes various scenarios as well as the component (Enricher), which allows you to address such requirements.
The Spring Integration Core
module includes 2 enrichers:
Furthermore, several Adapter specific Header Enrichers are included as well:
Please go to the adapter specific sections of this reference manual to learn more about those adapters.
If you only need to add headers to a Message, and they are not
dynamically determined by the Message content, then referencing a
custom implementation of a Transformer may be overkill. For that reason,
Spring Integration provides support for the Header Enricher
pattern. It is exposed via the <header-enricher>
element.
<int:header-enricher input-channel="in" output-channel="out"> <int:header name="foo" value="123"/> <int:header name="bar" ref="someBean"/> </int:header-enricher>
The Header Enricher also provides helpful sub-elements to set well-known header names.
<int:header-enricher input-channel="in" output-channel="out"> <int:error-channel ref="applicationErrorChannel"/> <int:reply-channel ref="quoteReplyChannel"/> <int:correlation-id value="123"/> <int:priority value="HIGHEST"/> <int:header name="bar" ref="someBean"/> </int:header-enricher>
In the above configuration you can clearly see that for well-known
headers such as errorChannel
, correlationId
,
priority
, replyChannel
etc., instead of
using generic <header> sub-elements where
you would have to provide both header 'name' and 'value', you can use
convenient sub-elements to set those values directly.
POJO Support
Often a header value cannot be defined statically and has to be
determined dynamically based on some content in the Message. That is why
Header Enricher allows you to also specify a bean
reference using the ref
and method
attribute.
The specified method will calculate the header value. Let's look at
the following configuration:
<int:header-enricher input-channel="in" output-channel="out"> <int:header name="foo" method="computeValue" ref="myBean"/> </int:header-enricher> <bean id="myBean" class="foo.bar.MyBean"/>
public class MyBean { public String computeValue(String payload){ return payload.toUpperCase() + "_US"; } }
You can also configure your POJO as inner bean:
<int:header-enricher input-channel="inputChannel" output-channel="outputChannel"> <int:header name="some_header"> <bean class="org.MyEnricher"/> </int:header> </int:header-enricher>
as well as point to a Groovy script:
<int:header-enricher input-channel="inputChannel" output-channel="outputChannel"> <int:header name="some_header"> <int-groovy:script location="org/SampleGroovyHeaderEnricher.groovy"/> </int:header> </int:header-enricher>
SpEL Support
In Spring Integration 2.0 we have introduced the convenience of the Spring Expression Language (SpEL) to help configure many different components. The Header Enricher is one of them. Looking again at the POJO example above, you can see that the computation logic to determine the header value is actually pretty simple. A natural question would be: "is there a simpler way to accomplish this?". That is where SpEL shows its true power.
<int:header-enricher input-channel="in" output-channel="out"> <int:header name="foo" expression="payload.toUpperCase() + '_US'"/> </int:header-enricher>
As you can see, by using SpEL for such simple cases, we no longer have to provide a separate class and configure it in the application context. All we need is the expression attribute configured with a valid SpEL expression. The 'payload' and 'headers' variables are bound to the SpEL Evaluation Context, giving you full access to the incoming Message.
Tip | |
---|---|
For more examples for configuring header enrichers, see Header Enricher Advanced Configuration. |
In certain situations the Header Enricher, as discussed above, may not be sufficient and payloads themselves may have to be enriched with additional information. For example, order messages that enter the Spring Integration messaging system have to look up the order's customer based on the provided customer number and then enrich the original payload with that information.
Since Spring Integration 2.1, the Payload Enricher is provided. A
Payload Enricher defines an endpoint that passes a
Message
to the exposed request channel and then
expects a reply message. The reply message then becomes the root object
for evaluation of expressions to enrich the target payload.
The Payload Enricher provides full XML namespace support via the enricher
element. In order to send request messages, the payload enricher has a
request-channel
attribute that allows you to dispatch
messages to a request channel.
Basically by defining the request channel, the Payload Enricher acts as a Gateway, waiting for the message that were sent to the request channel to return, and the Enricher then augments the message's payload with the data provided by the reply message.
When sending messages to the request channel you also have the option
to only send a subset of the original payload using the
request-payload-expression
attribute.
The enriching of payloads is configured through SpEL expressions,
providing users with a maximum degree of flexibility. Therefore, users
are not only able to enrich payloads with direct values from the reply channel's
Message
, but they can use SpEL
expressions to extract a subset from that Message, only, or to apply
addtional inline transformations, allowing them to further manipulate
the data.
If you only need to enrich payloads with static values, you don't have
to provide the request-channel
attribute.
Note | |
---|---|
Enrichers are a variant of Transformers and in many cases you could use a Payload Enricher or a generic Transformer implementation to add additional data to your messages payloads. Thus, familiarize yourself with all transformation-capable components that are provided by Spring Integration and carefully select the implementation that semantically fits your business case best. |
Below, please find an overview of all available configuration options that are available for the payload enricher:
<int:enricher request-channel="" auto-startup="true" id="" order="" output-channel="" request-payload-expression="" reply-channel="" send-timeout="" should-clone-payload="false"> <int:poller></int:poller> <int:property name="" expression=""/> <int:property name="" value=""/> </int:enricher>
Channel to which a Message will be sent to get the data to use for enrichment. Optional. | |
Lifecycle attribute signaling if this component should be started during Application Context startup. Defaults to true. Optional. | |
Id of the underlying bean definition, which is either
an | |
Specifies the order for invocation when this endpoint is connected as a subscriber to a channel. This is particularly relevant when that channel is using a "failover" dispatching strategy. It has no effect when this endpoint itself is a Polling Consumer for a channel with a queue. Optional. | |
Identifies the Message channel where a Message will be sent after it is being processed by this endpoint. Optional. | |
By default the original message's payload will be used as
payload that will be send to the For the Expression evaluation the full message is available as the 'root object'. For instance the following SpEL expressions (among others) are possible:
If more sophisticated logic is required (e.g. changing the message headers etc.) please use additional downstream transformers. Optional. | |
Channel where a reply Message is expected. This is optional; typically the auto-generated temporary reply channel is sufficient. Optional. | |
Maximum amount of time in milliseconds to wait when sending a message to the channel, if such channel may block.
For example, a Queue Channel can block until space is
available, if its maximum capacity has been reached. Internally
the send timeout is set on the
By default the send timeout is set to '-1', which may cause
the send operation on the | |
Boolean value indicating whether any payload that implements
| |
Allows you to configure a Message Poller if this endpoint is a Polling Consumer. Optional. | |
Each |
Below, please find several examples of using a Payload Enricher in various situations.
In the following example, a User
object is passed
as the payload of the Message
. The
User
has several properties but only the
username
is set initially. The Enricher's
request-channel
attribute below is configured to
pass the User
on to the findUserServiceChannel
.
Through the implicitly set reply-channel
a
User
object is returned and using the
property
sub-element, properties from the reply are
extracted and used to enrich the original payload.
<int:enricher id="findUserEnricher" input-channel="findUserEnricherChannel" request-channel="findUserServiceChannel"> <int:property name="email" expression="payload.email"/> <int:property name="password" expression="payload.password"/> </int:enricher>
Note | |
---|---|
The code samples shown here, are part of the Spring Integration Samples project. Please feel free to check it out at: https://github.com/SpringSource/spring-integration-samples |
How do I pass only a subset of data to the request channel?
Using a request-payload-expression
attribute
a single property of the payload can be passed on to the request
channel instead of the full message. In the example below on the
username property is passed on to the request channel. Keep in mind,
that alwhough only the username is passed on, the resulting message
send to the request channel will contain the full set of
MessageHeaders
.
<int:enricher id="findUserByUsernameEnricher" input-channel="findUserByUsernameEnricherChannel" request-channel="findUserByUsernameServiceChannel" request-payload-expression="payload.username"> <int:property name="email" expression="payload.email"/> <int:property name="password" expression="payload.password"/> </int:enricher>
How can I enrich payloads that consist of Collection data?
In the following example, instead of a User
object,
a Map
is passed in. The
Map
contains the username under the map
key username
. Only the username
is passed on
to the request channel. The reply contains a full User
object, which
is ultimately added to the Map
under the
user
key.
<int:enricher id="findUserWithMapEnricher" input-channel="findUserWithMapEnricherChannel" request-channel="findUserByUsernameServiceChannel" request-payload-expression="payload.username"> <int:property name="user" expression="payload"/> </int:enricher>
How can I enrich payloads with static information without using a request channel?
Here is an example that does not use a request channel at all, but solely enriches the message's payload with static values. But please be aware that the word 'static' is used loosly here. You can still use SpEL expressions for setting those values.
<int:enricher id="userEnricher" input-channel="input"> <int:property name="user.updateDate" expression="new java.util.Date()"/> <int:property name="user.firstName" value="foo"/> <int:property name="user.lastName" value="bar"/> <int:property name="user.age" value="42"/> </int:enricher>
In the earlier sections we've covered several Content Enricher type components that help you deal with situations where a message is missing a piece of data. We also discussed Content Filtering which lets you remove data items from a message. However there are times when we want to hide data temporarily. For example, in a distributed system we may receive a Message with a very large payload. Some intermittent message processing steps may not need access to this payload and some may only need to access certain headers, so carrying the large Message payload through each processing step may cause performance degradation, may produce a security risk, and may make debugging more difficult.
The Claim Check pattern describes a mechanism that allows you to store data in a well known place while only maintaining a pointer (Claim Check) to where that data is located. You can pass that pointer around as a payload of a new Message thereby allowing any component within the message flow to get the actual data as soon as it needs it. This approach is very similar to the Certified Mail process where you'll get a Claim Check in your mailbox and would have to go to the Post Office to claim your actual package. Of course it's also the same idea as baggage-claim on a flight or in a hotel.
Spring Integration provides two types of Claim Check transformers:
Convenient namespace-based mechanisms are available to configure them.
An Incoming Claim Check Transformer will transform an incoming Message by storing it in the Message Store
identified by its message-store
attribute.
<int:claim-check-in id="checkin" input-channel="checkinChannel" message-store="testMessageStore" output-channel="output"/>
In the above configuration the Message that is received on the input-channel
will be persisted to the
Message Store identified with the message-store
attribute and indexed with generated ID. That ID is the
Claim Check for that Message.
The Claim Check will also become the payload of the new (transformed) Message that will be sent to the output-channel
.
Now, lets assume that at some point you do need access to the actual Message. You can of course access the Message Store manually and get the contents of the Message, or you can use the same approach as before except now you will be transforming the Claim Check to the actual Message by using an Outgoing Claim Check Transformer.
Here is an overview of all available parameters of an Incoming Claim Check Transformer:
<int:claim-check-in auto-startup="true" id="" input-channel="" message-store="messageStore" order="" output-channel="" send-timeout=""> <int:poller></int:poller> </int:claim-check-in>
Lifecycle attribute signaling if this component should
be started during Application Context startup. Defaults
to true. Attribute is not available inside a | |
Id identifying the underlying bean definition ( | |
The receiving Message channel of this endpoint.
Attribute is not available inside a | |
Reference to the MessageStore to be used by this Claim Check transformer. If not specified, the default reference will be to a bean named messageStore. Optional. | |
Specifies the order for invocation when this endpoint is
connected as a subscriber to a channel. This is particularly
relevant when that channel is using a failover
dispatching strategy. It has no effect when this endpoint
itself is a Polling Consumer for a channel with a queue.
Attribute is not available inside a | |
Identifies the Message channel where Message will be sent
after its being processed by this endpoint.
Attribute is not available inside a | |
Specify the maximum amount of time in milliseconds to wait
when sending a reply Message to the output channel. By default
the send will block for one second.
Attribute is not available inside a | |
Defines a poller. Element is not available inside
a |
An Outgoing Claim Check Transformer allows you to transform a Message with a Claim Check payload into a Message with the original content as its payload.
<int:claim-check-out id="checkout" input-channel="checkoutChannel" message-store="testMessageStore" output-channel="output"/>
In the above configuration, the Message that is received on the input-channel
should have a Claim Check as its payload
and the Outgoing Claim Check Transformer will transform it into a Message with the original payload by simply
querying the Message store for a Message identified by the provided Claim Check. It then sends the newly checked-out Message to the
output-channel
.
Here is an overview of all available parameters of an Outgoing Claim Check Transformer:
<int:claim-check-out auto-startup="true" id="" input-channel="" message-store="messageStore" order="" output-channel="" remove-message="false" send-timeout=""> <int:poller></int:poller> </int:claim-check-out>
Lifecycle attribute signaling if this component should
be started during Application Context startup. Defaults
to true. Attribute is not available inside a | |
Id identifying the underlying bean definition ( | |
The receiving Message channel of this endpoint.
Attribute is not available inside a | |
Reference to the MessageStore to be used by this Claim Check transformer. If not specified, the default reference will be to a bean named messageStore. Optional. | |
Specifies the order for invocation when this endpoint is
connected as a subscriber to a channel. This is particularly
relevant when that channel is using a failover
dispatching strategy. It has no effect when this endpoint
itself is a Polling Consumer for a channel with a queue.
Attribute is not available inside a | |
Identifies the Message channel where Message will be sent
after its being processed by this endpoint.
Attribute is not available inside a | |
If set to | |
Specify the maximum amount of time in milliseconds to wait
when sending a reply Message to the output channel. By default
the send will block for one second.
Attribute is not available inside a | |
Defines a poller. Element is not available inside
a |
Claim Once
There are scenarios when a particular message must be claimed only once. As an analogy, consider the airplane luggage check-in/out process.
Checking-in your luggage on departure and and then claiming it on arrival is a classic example of such a scenario.
Once the luggage has been claimed, it can not be claimed again without first checking it back in. To accommodate such cases, we
introduced a remove-message
boolean attribute on the claim-check-out
transformer. This attribute is
set to false
by default. However, if set to true
, the claimed Message will be removed
from the MessageStore, so that it can no longer be claimed again.
This is also something to consider in terms of storage space, especially
in the case of the in-memory Map-based SimpleMessageStore
, where failing to remove the Messages
could ultimately lead to an OutOfMemoryException
.
Therefore, if you don't expect multiple claims to be made, it's recommended
that you set the remove-message
attribute's value to true
.
<int:claim-check-out id="checkout" input-channel="checkoutChannel" message-store="testMessageStore" output-channel="output" remove-message="true"/>
Although we rarely care about the details of the claim checks as long as they work, it is still worth knowing that the current implementation of the actual Claim Check (the pointer) in Spring Integration is a UUID to ensure uniqueness.
org.springframework.integration.store.MessageStore
is a strategy interface for storing and retrieving messages.
Spring Integration provides two convenient implementations of it. SimpleMessageStore
: an in-memory, Map-based
implementation (the default, good for testing) and JdbcMessageStore
: an implementation that uses a relational
database via JDBC.