[Questions] OptionalDataException when converting received javax.jms.StreamMessage

[rcisyk]

Community Support Policy

• I have read RabbitMQ's Community Support Policy
• I agree to provide all relevant information (versions, logs, rabbitmq-diagnostics output, detailed reproduction steps)

RabbitMQ version used

3.13.7

Erlang version used

26.2.x

Operating system (distribution) used

Debian Linux

How is RabbitMQ deployed?

Generic binary package

rabbitmq-diagnostics status output

See https://www.rabbitmq.com/docs/cli to learn how to use rabbitmq-diagnostics

Logs from node 1 (with sensitive values edited out)

See https://www.rabbitmq.com/docs/logging to learn how to collect logs

Logs from node 2 (if applicable, with sensitive values edited out)

See https://www.rabbitmq.com/docs/logging to learn how to collect logs

Logs from node 3 (if applicable, with sensitive values edited out)

See https://www.rabbitmq.com/docs/logging to learn how to collect logs

rabbitmq.conf

See https://www.rabbitmq.com/docs/configure#config-location to find rabbitmq.conf file location

Steps to deploy RabbitMQ cluster

RabbitMQ server is running as a standalone process, single instance, default configuration.

Steps to reproduce the behavior in question

I am trying to use RabbitMQ to send and receive javax.jms.StreamMessages. The message I am having issues with is an application object that contains

• String

• Long

• Array of other simple objects, where each object has two ints and a double
  On sending I use StreamMessage writeString, writeLong, writeInt (size of the array) and then writeInt/writeInt/writeDouble to convert each array object.
  Upon receiving I do the following

• readString

• readLong

• readInt (size of the array)

• readInt/readInt/readDouble to read each array object

All of this works just fine with 39 elements (or less) in the array. When I try to send 40 elements (or more), upon receiving the message 39 of these elements convert just fine but converting the 40th element fails with the following exception

MessageConversionException: Unable to convert BulkSignal to a Message
        at JMSStreamableConverter.convertFromMessage(JMSStreamableConverter.java:89)
        at PubSubDestination.convertMessage(PubSubDestination.java:515)
        at TopicDestination.convertMessage(TopicDestination.java:687)
        at PubSubDestination.runSubscriberLoop(PubSubDestination.java:453)
        at PubSubDestination$SubscriberThread.run(PubSubDestination.java:292)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: com.rabbitmq.jms.util.RMQJMSException
        at com.rabbitmq.jms.client.message.RMQStreamMessage.readPrimitiveType(RMQStreamMessage.java:211)
        at com.rabbitmq.jms.client.message.RMQStreamMessage.readDouble(RMQStreamMessage.java:288)
        at TwoKeyOneValueSignal.convertFromStreamMessage(TwoKeyOneValueSignal.java:79)
        at BulkSignal.convertFromStreamMessage(BulkSignal.java:225)
        at JMSStreamableConverter.convertFromStreamMessage(JMSStreamableConverter.java:118)
        at JMSStreamableConverter.convertFromMessage(JMSStreamableConverter.java:66)
        ... 5 more
Caused by: java.io.OptionalDataException
        at java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1699)
        at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:540)
        at java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:498)
        at com.rabbitmq.jms.client.RMQMessage.readPrimitive(RMQMessage.java:1344)
        at com.rabbitmq.jms.client.message.RMQStreamMessage.readPrimitiveType(RMQStreamMessage.java:94)

All of this works without issues with Tibco EMS or Solace message brokers, regardless of the number of elements in the array. For the life of me I cannot figure out why sending more than 39 elements fails. If someone can point me to the right direction it would be very much appreciated.

advanced.config

See https://www.rabbitmq.com/docs/configure#config-location to find advanced.config file location

Application code

# relevant messaging-related parts of your code go here

Kubernetes deployment file

# Relevant parts of K8S deployment that demonstrate how RabbitMQ is deployed

[michaelklishin]

@rcisyk I have moved this to the JMS client repo. What JMS client version do you use? Can you put together an executable example we can run to reproduce this behavior?

@acogoluegnes I don't recall seeing something like that. Do you?

[acogoluegnes]

@rcisyk I pushed a fix, can you try out the latest snapshot? You can download it from here.

[rcisyk]

@acogoluegnes Thank you! Will try shortly. Can you provide some context on the reason behind this error/exception?

[michaelklishin]

@rcisyk the payload was not read correctly (fully), in fact, more than in one place.

[rcisyk]

Confirmed that with the fix everything works as expected. No more exception. Thank you all for fixing this issue so quickly!

[michaelklishin]

No, thank you for providing an executable way to reproduce!