import / memory issue

[medicalhumor]

I'm trying to import a merchant datafeed and I'm getting some errors.

the datafeed has 13k records, so I broke it up into smaller chunks.

I got about 6k records imported (4 separate .csv files) and then I started getting the following error with the 5 file:

Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 1966080 bytes) in /home/xxxxx/public_html/wp-includes/wp-db.php on line 491

I bumped up my max_memory from 32 to 64, then 128 and still getting the same error.

Funny thing is, it shows I have an allowed memory size of 128mb and exhausted trying to allocate only 1.8mb

Any suggestions?

[ryan]

Do you have any other plugins enabled? Are these posts being imported for past dates or future publishing?

[medicalhumor]

no other plugins being used.

I'm importing for both past and future together. I'll try present only, future only and past only to see if that makes a difference.

Do you have any other plugins enabled? Are these posts being imported for past dates or future publishing?

[medicalhumor]

looks like it's having issues when I try to put past and future imports.
If I set them to post all on today's date, it works.

When I imported the first 6,000 or so posts, I had them stretched out over a 12 month range, past to future. I wonder if there's a limit on how many can be set for future posting.

[ryan]

Much of the memory problem lies within WordPress's internals when creating new posts. WordPress isn't very good about garbage collection... although I doubt they ever expected 13k posts to be created within the same process at one time.

I'll do some debugging and follow-up. If you can PM with a sample of your data, that'd be helpful.

[nickmattern]

Sounds like either the wrong version of phpBB for this import script or you have a modification to phpBB that is causing this. Which version are you importing?


FYI, this thread is 7 months and 2 versions old!