[pybsddb] Batch import is slowing down

Amirouche Boubekki amirouche at hypermove.net
Wed Jun 24 22:56:23 CEST 2015


On 2015-06-24 22:46, Amirouche Boubekki wrote:
> On 2015-06-24 22:30, Amirouche Boubekki wrote:
>> On 2015-06-24 18:56, Jesus Cea wrote:
>>> On 24/06/15 12:09, Amirouche Boubekki wrote:
>>>> Indeed the documentation is very good, you did a very good job with 
>>>> that.
>>> 
>>> I didn't write it :-). In fact neither Oracle did. It was mostly 
>>> written
>>> in the SleepyCat era :), before Oracle bought them.
>>> 
>>> Anyway I am not related to Oracle in any way at all.
>>> 
>>>> - The first set of 10 000 entries took 3 seconds to load.
>>>> - 49th set took 2 minutes
>>> 
>>> If could be a cache size issue. I can't really tell without checking 
>>> it
>>> myself. What does "db_stat -m" show?. Initialize the stats with 
>>> "db_stat
>>> -mZ" from time to time and compare results between the beginning and 
>>> the
>>> slow part.
>> 
>> I see nothing suspicious in the log. They are attached. I'll be very
>> happy if you can help me.


Sorry the timings are the same, I did not compute the correct timing the 
first time. I'm lost.
-- 
Amirouche ~ amz3 ~ http://www.hyperdev.fr


More information about the pybsddb mailing list