For the latest stable version, please use Spring Modulith 1.2.5! |
Working with Application Events
To keep application modules as decoupled as possible from each other, their primary means of interaction should be event publication and consumption. This avoids the originating module to know about all potentially interested parties, which is a key aspect to enable application module integration testing (see Integration Testing Application Modules).
Often we will find application components defined like this:
-
Java
-
Kotlin
@Service
@RequiredArgsConstructor
public class OrderManagement {
private final InventoryManagement inventory;
@Transactional
public void complete(Order order) {
// State transition on the order aggregate go here
// Invoke related functionality
inventory.updateStockFor(order);
}
}
@Service
class OrderManagement(val inventory: InventoryManagement) {
@Transactional
fun complete(order: Order) {
inventory.updateStockFor(order)
}
}
The complete(…)
method creates functional gravity in the sense that it attracts related functionality and thus interaction with Spring beans defined in other application modules.
This especially makes the component harder to test as we need to have instances available of those depended on beans just to create an instance of OrderManagement
(see Dealing with Efferent Dependencies).
It also means that we will have to touch the class whenever we would like to integrate further functionality with the business event order completion.
We can change the application module interaction as follows:
ApplicationEventPublisher
-
Java
-
Kotlin
@Service
@RequiredArgsConstructor
public class OrderManagement {
private final ApplicationEventPublisher events;
private final OrderInternal dependency;
@Transactional
public void complete(Order order) {
// State transition on the order aggregate go here
events.publishEvent(new OrderCompleted(order.getId()));
}
}
@Service
class OrderManagement(val events: ApplicationEventPublisher, val dependency: OrderInternal) {
@Transactional
fun complete(order: Order) {
events.publishEvent(OrderCompleted(order.id))
}
}
Note how, instead of depending on the other application module’s Spring bean, we use Spring’s ApplicationEventPublisher
to publish a domain event once we have completed the state transitions on the primary aggregate.
For a more aggregate-driven approach to event publication, see Spring Data’s application event publication mechanism for details.
As event publication happens synchronously by default, the transactional semantics of the overall arrangement stay the same as in the example above.
Both for the good, as we get to a very simple consistency model (either both the status change of the order and the inventory update succeed or none of them does), but also for the bad as more triggered related functionality will widen the transaction boundary and potentially cause the entire transaction to fail, even if the functionality that is causing the error is not crucial.
A different way of approaching this is by moving the event consumption to asynchronous handling at transaction commit and treat secondary functionality exactly as that:
-
Java
-
Kotlin
@Component
class InventoryManagement {
@Async
@TransactionalEventListener
void on(OrderCompleted event) { /* … */ }
}
@Component
class InventoryManagement {
@Async
@TransactionalEventListener
fun on(event: OrderCompleted) { /* … */ }
}
This now effectively decouples the original transaction from the execution of the listener. While this avoids the expansion of the original business transaction, it also creates a risk: if the listener fails for whatever reason, the event publication is lost, unless each listener actually implements its own safety net. Even worse, that doesn’t even fully work, as the system might fail before the method is even invoked.
Application Module Listener
To run a transactional event listener in a transaction itself, it would need to be annotated with @Transactional
in turn.
-
Java
-
Kotlin
@Component
class InventoryManagement {
@Async
@Transactional(propagation = Propagation.REQUIRES_NEW)
@TransactionalEventListener
void on(OrderCompleted event) { /* … */ }
}
@Component
class InventoryManagement {
@Async
@Transactional(propagation = Propagation.REQUIRES_NEW)
@TransactionalEventListener
fun on(event: OrderCompleted) { /* … */ }
}
To ease the declaration of what is supposed to describe the default way of integrating modules via events, Spring Modulith provides @ApplicationModuleListener
to shortcut the declaration
-
Java
-
Kotlin
@Component
class InventoryManagement {
@ApplicationModuleListener
void on(OrderCompleted event) { /* … */ }
}
@Component
class InventoryManagement {
@ApplicationModuleListener
fun on(event: OrderCompleted) { /* … */ }
}
The Event Publication Registry
Spring Modulith ships with an event publication registry that hooks into the core event publication mechanism of Spring Framework. On event publication, it finds out about the transactional event listeners that will get the event delivered and writes entries for each of them (dark blue) into an event publication log as part of the original business transaction.
Each transactional event listener is wrapped into an aspect that marks that log entry as completed if the execution of the listener succeeds.
In case the listener fails, the log entry stays untouched so that retry mechanisms can be deployed depending on the application’s needs.
Automatic re-publication of the events can be enabled via the spring.modulith.republish-outstanding-events-on-restart
property.
Managing Event Publications
Event publications may need to be managed in a variety of ways during the runtime of an application.
Incomplete publications might have to be re-submitted to the corresponding listeners after a given amount of time.
Completed publications on the other hand, will likely have to be purged from the database or moved into an archive store.
As the needs for that kind of housekeeping strongly vary from application to application, Spring Modulith offers API to deal with both kinds of publications.
That API is available through the spring-modulith-events-api
artifact, that you can add to your application:
-
Maven
-
Gradle
<dependency>
<groupId>org.springframework.modulith</groupId>
<artifactId>spring-modulith-events-api</artifactId>
<version>1.1.10</version>
</dependency>
dependencies {
implementation 'org.springframework.modulith:spring-modulith-events-api:1.1.10'
}
This artifact contains two primary abstractions, that are available to application code as Spring Beans:
-
CompletedEventPublications
— This interface allows accessing all completed event publications, and provides API to immediately purge all of them from the database or the completed publications older that a given duration (for example, 1 minute). -
IncompleteEventPublications
-- This interface allows accessing all incomplete event publications to resubmit either the ones matching a given predicate or older than a givenDuration
relative to the original publishing date.
Event Publication Repositories
To actually write the event publication log, Spring Modulith exposes an EventPublicationRepository
SPI and implementations for popular persistence technologies that support transactions, like JPA, JDBC and MongoDB.
You select the persistence technology to be used by adding the corresponding JAR to your Spring Modulith application.
We have prepared dedicated starters to ease that task.
The JDBC-based implementation can create a dedicated table for the event publication log when the respective configuration property (spring.modulith.events.jdbc.schema-initialization.enabled
) is set to true
.
For details, please consult the schema overview in the appendix.
Event Serializer
Each log entry contains the original event in serialized form.
The EventSerializer
abstraction contained in spring-modulith-events-core
allows plugging different strategies for how to turn the event instances into a format suitable for the datastore.
Spring Modulith provides a Jackson-based JSON implementation through the spring-modulith-events-jackson
artifact, which registers a JacksonEventSerializer
consuming an ObjectMapper
through standard Spring Boot auto-configuration by default.
Customizing the Event Publication Date
By default, the Event Publication Registry will use the date returned by the Clock.systemUTC()
as event publication date.
If you want to customize this, register a bean of type clock with the application context:
@Configuration
class MyConfiguration {
@Bean
Clock myCustomClock() {
return … // Your custom Clock instance created here.
}
}
Externalizing Events
Some of the events exchanged between application modules might be interesting to external systems. Spring Modulith allows publishing selected events to a variety of message brokers. To use that support you need to take the following steps:
-
Add the broker-specific Spring Modulith artifact to your project.
-
Select event types to be externalized by annotating them with either Spring Modulith’s or jMolecules'
@Externalized
annotation. -
Specify the broker-specific routing target in the annotation’s value.
To find out how to use other ways of selecting events for externalization, or customize their routing within the broker, check out Fundamentals of Event Externalization.
Supported Infrastructure
Broker | Artifact | Description |
---|---|---|
Kafka |
|
Uses Spring Kafka for the interaction with the broker. The logical routing key will be used as |
AMQP |
|
Uses Spring AMQP for the interaction with any compatible broker. Requires an explicit dependency declaration for Spring Rabbit for example. The logical routing key will be used as AMQP routing key. |
JMS |
|
Uses Spring’s core JMS support. Does not support routing keys. |
SQS |
|
Uses Spring Cloud AWS SQS support. The logical routing key will be used as SQS message group id. When routing key is set, requires SQS queue to be configured as a FIFO queue. |
SNS |
|
Uses Spring Cloud AWS SNS support. The logical routing key will be used as SNS message group id. When routing key is set, requires SNS to be configured as a FIFO topic with content based deduplication enabled. |
Fundamentals of Event Externalization
The event externalization performs three steps on each application event published.
-
Determining whether the event is supposed to be externalized — We refer to this as “event selection”. By default, only event types located within a Spring Boot auto-configuration package and annotated with one of the supported
@Externalized
annotations are selected for externalization. -
Mapping the event (optional) — By default, the event is serialized to JSON using the Jackson
ObjectMapper
present in the application and published as is. The mapping step allows developers to either customize the representation or even completely replace the original event with a representation suitable for external parties. Note, that the mapping step precedes the actual serialization of the to be published object. -
Determining a routing target — Message broker clients need a logical target to publish the message to. The target usually identifies physical infrastructure (a topic, exchange, or queue depending on the broker) and is often statically derived from the event type. Unless defined in the
@Externalized
annotation specifically, Spring Modulith uses the application-local type name as target. In other words, in a Spring Boot application with a base package ofcom.acme.app
, an event typecom.acme.app.sample.SampleEvent
would get published tosample.SampleEvent
.Some brokers also allow to define a rather dynamic routing key, that is used for different purposes within the actual target. By default, no routing key is used.
Annotation-based Event Externalization Configuration
To define a custom routing key via the @Externalized
annotations, a pattern of $target::$key
can be used for the target/value attribute available in each of the particular annotations.
The key can be a SpEL expression which will get the event instance configured as root object.
-
Java
-
Kotlin
@Externalized("customer-created::#{#this.getLastname()}") (2)
class CustomerCreated {
String getLastname() { (1)
// …
}
}
@Externalized("customer-created::#{#this.getLastname()}") (2)
class CustomerCreated {
fun getLastname(): String { (1)
// …
}
}
The CustomerCreated
event exposes the lastname of the customer via an accessor method.
That method is then used via the #this.getLastname()
expression in key expression following the ::
delimiter of the target declaration.
If the key calculation becomes more involved, it is advisable to rather delegate that into a Spring bean that takes the event as argument:
-
Java
-
Kotlin
@Externalized("…::#{@beanName.someMethod(#this)}")
@Externalized("…::#{@beanName.someMethod(#this)}")
Programmatic Event Externalization Configuration
The spring-modulith-events-api
artifact contains EventExternalizationConfiguration
that allows developers to customize all of the above mentioned steps.
-
Java
-
Kotlin
@Configuration
class ExternalizationConfiguration {
@Bean
EventExternalizationConfiguration eventExternalizationConfiguration() {
return EventExternalizationConfiguration.externalizing() (1)
.select(EventExternalizationConfiguration.annotatedAsExternalized()) (2)
.mapping(SomeEvent.class, event -> …) (3)
.routeKey(WithKeyProperty.class, WithKeyProperty::getKey) (4)
.build();
}
}
@Configuration
class ExternalizationConfiguration {
@Bean
fun eventExternalizationConfiguration(): EventExternalizationConfiguration {
EventExternalizationConfiguration.externalizing() (1)
.select(EventExternalizationConfiguration.annotatedAsExternalized()) (2)
.mapping(SomeEvent::class.java) { event -> … } (3)
.routeKey(WithKeyProperty::class.java, WithKeyProperty::getKey) (4)
.build()
}
}
1 | We start by creating a default instance of EventExternalizationConfiguration . |
2 | We customize the event selection by calling one of the select(…) methods on the Selector instance returned by the previous call.
This step fundamentally disables the application base package filter as we only look for the annotation now.
Convenience methods to easily select events by type, by packages, packages and annotation exist.
Also, a shortcut to define selection and routing in one step. |
3 | We define a mapping step for SomeEvent instances.
Note, that the routing will still be determined by the original event instance, unless you additionally call ….routeMapped() on the router. |
4 | We finally determine a routing key by defining a method handle to extract a value of the event instance.
Alternatively, a full RoutingKey can be produced for individual events by using the general route(…) method on the Router instance returned from the previous call. |
Testing published events
The following section describes a testing approach solely focused on tracking Spring application events.
For a more holistic approach on testing modules that use @ApplicationModuleListener , please check out the Scenario API.
|
Spring Modulith’s @ApplicationModuleTest
enables the ability to get a PublishedEvents
instance injected into the test method to verify a particular set of events has been published during the course of the business operation under test.
-
Java
-
Kotlin
@ApplicationModuleTest
class OrderIntegrationTests {
@Test
void someTestMethod(PublishedEvents events) {
// …
var matchingMapped = events.ofType(OrderCompleted.class)
.matching(OrderCompleted::getOrderId, reference.getId());
assertThat(matchingMapped).hasSize(1);
}
}
@ApplicationModuleTest
class OrderIntegrationTests {
@Test
fun someTestMethod(events: PublishedEvents events) {
// …
val matchingMapped = events.ofType(OrderCompleted::class.java)
.matching(OrderCompleted::getOrderId, reference.getId())
assertThat(matchingMapped).hasSize(1)
}
}
Note, how PublishedEvents
exposes API to select events matching a certain criteria.
The verification is concluded by an AssertJ assertion that verifies the number of elements expected.
If you are using AssertJ for those assertions anyway, you can also use AssertablePublishedEvents
as test method parameter type and use the fluent assertion APIs provided through that.
AssertablePublishedEvents
to verify event publications-
Java
-
Kotlin
@ApplicationModuleTest
class OrderIntegrationTests {
@Test
void someTestMethod(AssertablePublishedEvents events) {
// …
assertThat(events)
.contains(OrderCompleted.class)
.matching(OrderCompleted::getOrderId, reference.getId());
}
}
@ApplicationModuleTest
class OrderIntegrationTests {
@Test
fun someTestMethod(events: AssertablePublishedEvents) {
// …
assertThat(events)
.contains(OrderCompleted::class.java)
.matching(OrderCompleted::getOrderId, reference.getId())
}
}
Note, how the type returned by the assertThat(…)
expression allows to define constraints on the published events directly.
Spring Boot Event Registry Starters
Using the transactional event publication log requires a combination of artifacts added to your application.
To ease that task, Spring Modulith provides starter POMs that are centered around the persistence technology to be used and default to the Jackson-based EventSerializer
implementation.
The following starters are available:
-
spring-modulith-starter-jpa
— Using JPA as persistence technology. -
spring-modulith-starter-jdbc
— Using JDBC as persistence technology. Also works in JPA-based applications but bypasses your JPA provider for actual event persistence. -
spring-modulith-starter-mongodb
— Using MongoDB behind Spring Data MongoDB. Also enables MongoDB transactions and requires a replica set setup of the server to interact with. The transaction auto-configuration can be disabled by setting thespring.modulith.events.mongobd.transaction-management.enabled
property tofalse
. -
spring-modulith-starter-neo4j
— Using Neo4j behind Spring Data Neo4j.