MemoryError odoo.db.dump #4
Comments
|
Hi, Are you running on a 32 bits system? |
|
It is difficult to say what is happening, maybe that a JSON-RPC query is not optimal for such volume of data. The web client does a standard HTTP query on /web/database/backup (on 8.0) but this approach requires a token to be performed. So now, I've no immediate solution... Maybe test on Python 3 to see if the memory consumption is better? |
|
Confirmed Python 3 memory consumption is way better. Our backup process started taking more CPU time and 16x to 18x the memory size as the zipped backup increased in size (was at ~ 185 MB when the problem occurred). Part of it was related to Python 2 inefficient memory model in its On Python 64-bit 2.7.12, it reached 3.2 GB for 185 MB zipped backup size. On the backup machine, please remember to increase the swap space to handle future spikes in your backup process memory usage and upgrade to Python 3 64-bit. Please close this issue. Thanks. |
From @eqms on October 7, 2016 16:30
Hi,
with small databases the dump function runs very good.
But if I try to backup a bigger system (zip file over the front end has 1.6 GB) I get this memory error.
Traceback (most recent call last):
File "./backup_odoorpc.py", line 62, in
dump = odoo.db.dump(mydbpwd, mydb,'zip')
File "/usr/local/lib/python2.7/dist-packages/odoorpc/db.py", line 131, in dump
'args': args})
File "/usr/local/lib/python2.7/dist-packages/odoorpc/odoo.py", line 264, in json
data = self._connector.proxy_json(url, params)
File "/usr/local/lib/python2.7/dist-packages/odoorpc/rpc/jsonrpclib.py", line 94, in call
return json.load(decode_data(response))
File "/usr/lib/python2.7/json/init.py", line 290, in load
**kw)
File "/usr/lib/python2.7/json/init.py", line 338, in loads
return _default_decoder.decode(s)
File "/usr/lib/python2.7/json/decoder.py", line 366, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "/usr/lib/python2.7/json/decoder.py", line 382, in raw_decode
obj, end = self.scan_once(s, idx)
MemoryError
Is there a way to increase the memory?
Copied from original issue: osiell/odoorpc#31
The text was updated successfully, but these errors were encountered: