Use SQLite to store our internal copy of the source catalogs.
This allows to implement an in-memory array with the capabilities to spill-to-disk and also hash-table like lookup operations, and with good multi-process concurrency handling. Using SQLite internally will allow reducing the memory usage of pgcopydb and make it possible to address databases with more than a million of tables defined.
parent
b37f86d2
Please register or sign in to comment