Transient Data corrupting the XML

Proxy data-TRANSIENT corrupt-xml

[MasterKing]

Hi!
I have this strange problem and can't find a reason for that. Our website interacts with a number of Third Party site which feeds XML back to us and we parse it at WebLogic. Soemtimes there are some extra charaters are added by Apache-proxy in XML, which causes our parser to fail.
I was using Apache 2.2.4 earlier and so I moved back to Apache 2.0.61, but still face the same problem. I turned on the dumpio module and here is what I see :
. . . .
[Tue Nov 13 13:33:16 2007] [debug] mod_dumpio.c(139): mod_dumpio: dumpio_out
[Tue Nov 13 13:33:16 2007] [debug] mod_dumpio.c(55): mod_dumpio: dumpio_out (data-TRANSIENT): 5 bytes
[Tue Nov 13 13:33:16 2007] [debug] mod_dumpio.c(71): mod_dumpio: dumpio_out (data-TRANSIENT): 71c\r\n
[Tue Nov 13 13:33:16 2007] [debug] mod_dumpio.c(55): mod_dumpio: dumpio_out (data-HEAP): 1820 bytes
[Tue Nov 13 13:33:16 2007] [debug] mod_dumpio.c(71): mod_dumpio: dumpio_out (data-HEAP): <param name="ph_open_sat"></param>\n <param .
. . . .
My problem is that the data-TRANSIENT ( 71c in above example) is sometime getting written to data stream and that's causing parser to fail. Anyone have any idea what data-TRANSIENT is or solution to above issue?

[DamonHD]

Looks like the data is being sent to you in "chunked" format and not properly handled.

You may be able to tell the sender not to use chunked format, or upgrade your Apache and/or module to handle it, or use a "Cache-Control: no-cache,no-transform, no-store" HTTP header to prevent the proxy trying to do anything clever with the data.

Rgds

Damon

[MasterKing]

HI! Damon,

Thanks for the reply. Yes I understand the data seems to be comming in chunks. I can't ask the sender to update this as he is serving to many clients. I suspected the Cache, and no did rebuild the Apache without cache modules ( --enable-mem-cache --enable-cache removed. I still get the problem.

As I was using Apache 2.2.4 and then tried with Apache2.0.61, I don't see upgrading to solve this. Also as the request URL is also been made using Third Party supplied libraries, I have to explore how to do that. Is there anything else I can configure in Apache-proxy itselef to turn he cache off.

Regards
Ajay

[DamonHD]

Hi,

Sorry, I don't know specifically how to help. I know that chunked-encoding is still new enough to trip up various clients.

Is it possible that you could relay your request and response via another proxy such as Squid, or a little Java app, that you can force to use a non-chunked encoding to talk to your application? Ie, use an extra proxy to switch to a simpler encoding.

Rgds

Damon