This website uses cookies. By continuing to browse or login to this website, you consent to the use of cookies. Learn more.
OK
brettpladna81
Ensign Ensign
Ensign
‎2021-01-13 20:49
152 views

Is there a way to set the max.request.size for kafka destiantions?

We are seeing this error on the connector

Is there a setting in agent.default.properties that I am not seeing? I was unable to see anything related to max.size.request. The cefkafka settings for kafka destination all like they would allow large messages without this error showing up.

 

Connector sending to kafka:

ERROR: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors. RecordTooLargeException: The message is 1105463 when serialized which is larger than the maximum request size you have configured with the max.request.size configuration

 

The event is still making it in full to the broker as well as ESM.

 

This is also a custom kafka setup, not transformation hub.

Labels (1)
Labels
Reply
Report Inappropriate Content
1 Reply
Ionut Daniel Mosoiu
Fleet Admiral
Fleet Admiral
Monday

Hello, 

 

the in agent.properties of the SM you should be able to configure the following parameters:

transport.cefkafka.extra.prod.props=max.request.size
transport.cefkafka.extra.prod.values=VALUE_DESIRED

 

but those are introduced starting with Smart Connector version 7.10. 

Verify which version did you have and if is lower then this version try to upgrade at least to SM 7.10.

 

Best Regards, 

 

Daniel

0 Likes
Reply
Report Inappropriate Content
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.