This site has been archived and you can no longer log in or post new messages. For up-to-date community resources please visit ezplatform.com

eZ Community » Forums » Developer » Extract info about 20000 nodes in...
expandshrink

Extract info about 20000 nodes in excel - perf issue

Extract info about 20000 nodes in excel - perf issue

Friday 20 June 2014 10:34:55 am - 4 replies

Hello all,

I am running a legacy instance on ez publish 5.

I need to extract some excel files. Some of them contains up to 20.000 nodes. The extract has perf issues (not enough memory, slow down the site, ....).

I would like to know how you would handle this ? Is there any best practice or tips I could use ?

I have only one server available.

Thank you very much for your advices

Friday 20 June 2014 10:47:00 am

This could  be helpful then, Paul: https://jira.ez.no/browse/EZP-23021.

Do not hesitate to provide extra feedback !

Modified on Friday 20 June 2014 10:47:29 am by Bertrand Dunogier

Friday 20 June 2014 11:32:57 am

Thank you for the advice.

I will provide feedback when I handle this.

Friday 20 June 2014 4:32:13 pm

also

- do not wrap the whole import in a single db/repo transaction, use one-per-content or one-per-N-content

- could set delayedindexiing on, then run indexation after import finishes

- worst-case scenario: main import scripts call 1 import cli sub-script per line of the spreadhseet. slower but guarantees no memleaks

Sunday 22 June 2014 5:38:17 pm

Check if there is a time when the server is not as busy - such as overnight and run the scripts then.

expandshrink

You must be logged in to post messages in this topic!

36 542 Users on board!

Forums menu

Proudly Developed with from