SchemaRegistrySerde: Avro deserialization without magic byte using lookup by topic name as fallback like in serialization #4520
Description
Issue submitter TODO list
- I've searched for an already existing issues here
- I'm running a supported version of the application which is listed here and the feature is not present there
Is your proposal related to a problem?
I have a producer on Kafka. I have no control about the producer and the producer does not set the magic byte and schema id in avro that would tell a consumer what schema to use. However I want to inspect the messages in Kafka UI.
Describe the feature you're interested in
I want to be able to set the correct schema.
When Serializing messages the code in SchemaRegistrySerde has a look into the registry using the topic name.
Suggestion:
When Deserializing:
- Have a look at magic byte and schema ID
- If no schema ID set have a look in the registry using the topic name and try this schema
- Fail otherwise
-> Suggestion add step 2
Describe alternatives you've considered
Setting the magic bytes and schema ids in messages. However in a lot of cases the read does not control the producer.
Setting the correct schema via UI.
Version you're running
Applies to all versions
Additional context
Currently only reads the schema from the message it-self