In T348536, we tested the kserve batcher on RR-language-agnostic in staging and confirmed its effectiveness. For this test, I used my branch of knowledge integrity, which adds new functions to RR-language-agnostic to support batch feature extraction and classification.
To deploy the RR-language-agnostic batch version to production, we need to merge these changes into the latest knowledge integrity release, v0.6.0. However, this is currently on hold due to a problem with Pydantic (see T355742). We will start this task once the issue is resolved.