back to forum.

Topic: How you are exporting csv file

Topic by
kanthuuuu

2012-05-24
14:49

How you are exporting csv file

Hi Kasper,

My question is :how you are fetching more than four million records of data and exporting to csv file.

My problem: when i am trying to fetch more than four million records by organizing full amount of data by row wise but error showing as Java heap mermory full

Reply by
kasper

2012-05-24
15:32
Hi Kanthuuu,

You mean DataCleaner is having this issue, or are you seeing this issue in some other tool? DataCleaner should be perfectly able of handling four million records (internally we test with 160 million on a regular basis), so I wonder what your question is about. The key to handling such amounts of course is that you stream the data. Never try to hold that much data in memory.

And another thing. Please do not post questions directed to me on this forum. This is a public forum, not a personal hotline.

Reply by
kanthuuuu

2012-05-24
16:55
Hi,

Thanks for reply.
I am working on the same datacleaner tool, to customize in our requirement.

You need to be logged in to participate

In order to post your own comments on this topic, you need to be logged in.

Username:

Log in by clicking the login link at the top of the screen