[pybsddb] Bulk Data load into a DB

[Joepaul Puthenangadi]

May be I am not reading it right from the documentation.

As per the documentation, to use the open method for db.open, the format to use is
open(filename, dbname=None, dbtype=DB_UNKNOWN, flags=0, mode=0660, txn=None)

so here I would think this is what I need to do to open a new db right.?
db1.open("Temp.db", None, db.DB_BTREE, db.DB_CREATE)

here dbtype is DB_BTREE and flags is db.DB_CREATE right.?
http://www.jcea.es/programacion/pybsddb_doc/db.html

I understand that if there are more than 2 flags we might need to provide it with a bitOR operator like DB_CREATE | DB_AUTO_COMMIT

-----
On the second email from the documentation, don't know C, so I don't know how to approach it. For now I think will stick with loading and retrieving one value at a time.

Thanks for all your help and thoughts.

Thanks

--- On Sat, 3/27/10, hasanyasin <hasanyasin at cubicpen.com> wrote:

From: hasanyasin <hasanyasin at cubicpen.com>
Subject: Re: [pybsddb] Bulk Data load into a DB
To: "Python bindings for Oracle Berkeley DB" <pybsddb at jcea.es>
Date: Saturday, March 27, 2010, 7:10 PM




  
Flags are integers in fact and we operate "bitwise or" ie. | operator,
on them to create one integer. So, instead of writing db.DB_BTREE,
db.DB_CREATE you need to write db.DB_BTREE|db.DB_CREATE. The code you
provided at your mail would work but not as aimed.



I DB_MULTIPLE is defined in module bsddb3.db, so in order to use it you
need to type db.DB_MULTIPLE in your case since you have imported db
from bsddb3.



The real exception we get here is TypeError complaining as: "string or
integer object expected for key, tuple found." So, it seems current
interface does not yet support this feature.



hasanyasin





On 27.03.2010 20:41, Joepaul Puthenangadi wrote:

  
    
      
        Sorry about that. Should have been more verbose. My bad.

        

############

This is what I did initially

        

from bsddb3 import db

        

db1 = db.DB()

        

db1.open("Temp.db", None, db.DB_BTREE, db.DB_CREATE)

        

db1.put('abc%200105%Key1','jp1p')

db1.put('abc%200105%Key2','jp2p')

        

db1.close()

        

Worked  great

############

Then, was trying to add more keys to it in  the bulk format. And was
trying to think that a tuple of keys and tuple of values in one put
will be the way to get the bulk data loaded. That was the code pasted
earlier. This is command i used from the last post

        

db1.put(keys, val, None, DB_MULTIPLE)

        

Then you get this error message 

NameError: name 'DB_MULTIPLE' is not defined

        

So my thought was may be this feature is still not implemented. Just
want to see what members here thought.

        

Appreciate all your help and discussions.

Thanks

        

        

--- On Sat, 3/27/10, hasanyasin <hasanyasin at cubicpen.com>
wrote:

        

From: hasanyasin <hasanyasin at cubicpen.com>

Subject: Re: [pybsddb] Bulk Data load into a DB

To: "Python bindings for Oracle Berkeley DB" <pybsddb at jcea.es>

Date: Saturday, March 27, 2010, 1:57 AM

          

           Hi,

I am not sure if that feature is interfaced in pybsddb yet; but before
that, I will ask you some other things: When you are opening a db, it
would be better to provide dbtype and flags so we can see what the
dbtype and flags of it are. Also, if that db did not exist already, it
won't open without DB_CREATE flag. The name "DB_MULTIPLE" is not
importad to global scope so you can access it via "db" module name as
db.DB_MULTIPLE.

          

In addition to these, saying "this didn't work" does not give any clues
to us. Please provide the exceptions throwed.

          

Have a good day,

hasanyasin

          

On 27.03.2010 00:38, Joepaul Puthenangadi wrote:
          
            
              
                
                  Hi
there,

                  

                  Was
reading
through the documentation and found something on the oracle
website about the possibility of loading bulk key and values into a
hash or btree db using the flag = DB_MULTIPLE.
Not
trying to be picky or anything just wanted to know whether that is
something yet to be implemented to bsddb3 module.?

                  

                  Again
thanks
a lot for the wonderful module.

                  

                  Thanks
again

                  

#Sample code

                  

                  from bsddb3 import db

                  

db1 = db.DB()

db1.open("Temp.db")

                  

keys = ('key1','key2','key3')

val = ('10','15','20')

                  

db1.put(keys, val, None, DB_MULTIPLE)

        

db1.close()

                  

###

This did not work. Any thoughts.?

                  

Thanks

                  
                
              
            
            

            
_______________________________________________
pybsddb mailing list
pybsddb at jcea.es
https://mailman.jcea.es:28443/listinfo/pybsddb
http://www.jcea.es/programacion/pybsddb.htm
          
          
          

-----Inline Attachment Follows-----

          

          _______________________________________________

pybsddb mailing list

          pybsddb at jcea.es

          https://mailman.jcea.es:28443/listinfo/pybsddb

          http://www.jcea.es/programacion/pybsddb.htm
        
        
      
    
  
  

  
_______________________________________________
pybsddb mailing list
pybsddb at jcea.es
https://mailman.jcea.es:28443/listinfo/pybsddb
http://www.jcea.es/programacion/pybsddb.htm

 

-----Inline Attachment Follows-----

_______________________________________________
pybsddb mailing list
pybsddb at jcea.es
https://mailman.jcea.es:28443/listinfo/pybsddb
http://www.jcea.es/programacion/pybsddb.htm


      
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.jcea.es/pipermail/pybsddb/attachments/20100329/99a28af6/attachment.htm>