Topic Out of Memory

Yasir started the topic:
2017-08-17 14:26

Out of Memory

Hi,

I think your product is lovely. I am trying to de-dup my customer master records using this tool. I am just using demo version to get the look and feel. When I tried to process 20k records, the tool gave me out of memory exception. So I increased the java heap size to 4096m. Now I am able to process 50k records in de-duplication task but when I connect the merge task, I am again getting out of memory exception.

Any thoughts?

-Y
Dennis replied:
2017-08-18 08:19
That sounds extreme for so few records. Are the records very large, or are your criteria very wide so they end up as only a very few groups (very large groups are rather expensive, memory-wise)?

Best regards,
Dennis
You are not signed in.
You need to be signed in to participate in the discussion.