RootsWeb.com Mailing Lists
Total: 3/3
    1. Re: [RMagic] Maximum Size for a RootsMagic -database
    2. Tom Holden
    3. There is no definitive answer, Jose, except some hard limits somewhere out there in a 64bit number limiting the size of a table and/or the operating system itself limiting the size of the file. RootsMagic4+ uses the SQLite3 database engine. Here's what its limits are: http://www.sqlite.org/limits.html and reading down to the last paragraph: "The theoretical maximum number of rows in a table is 2^64 (18446744073709551616 or about 1.8e+19). This limit is unreachable since the maximum database size of 140 terabytes will be reached first. A 140 terabytes database can hold no more than approximately 1e+13 rows, and then only if there are no indices and if each row contains very little data." That's 10,000,000,000,000 or 10 trillion rows. That said, there is the question of how long does it take the application, operating system and computer hardware to execute some procedure - all three of these are highly variable: the application on how much is done in SQL versus how much is done in the higher level application development language and with what granularity (i.e., how many calls to the database); the OS on which version and how it is configured; the hardware on disk speed (solid state disks offering a big advantage) and on caching in RAM... and then there is the question of how long a delay we are willing to tolerate. Some RM operations slow down seemingly exponentially with the number of persons in the database, e.g., Duplicate Search Merge. I'm curious to know how many persons are in your 930MB database and why??? Tom

    01/05/2013 05:09:49
    1. Re: [RMagic] Maximum Size for a RootsMagic -database
    2. José Verheecke
    3. Hi Tom Thanks for you answer:I had to read it a few times,not being a very technically gifted one. There are >1410000 individuals in my file. As I explained in the Facebook group Technology for Genealogy my own family is but a very small part of my main file,which contains the combined ancestry of most of Europe's crowned heads, American presidents,movie stars (and so on),descendants of king James I/VI of England/Scotland and the genealogists who study all of that.Is it all proven? I spend my days adding,correcting &reviewing data. Well,there is allso a 'fun part' in my file (Irish kinds,Biblical lineages and other hallucinations) -I don't believe anything of it.... I'm co-author of 4 books on the ancestors of tne king of the Belgians,the crown prince,and their wives.That's how I got into it. They arent' related to me,but,why should a genealogist limit himself to this own family? Tou can view a sample of my work here: http://users.telenet.be/JoseVerheecke/index.html I started my computerized files 20 years ago - a dozen others joined in -it did get a bit out of hand,I presume.. José jose.verheecke@telenet.be Errare humanum est, perseverare, diabolicum ----- Original Message ----- From: Tom Holden To: rootsmagic-users@rootsweb.com Sent: Saturday, January 05, 2013 6:09 PM Subject: Re: [RMagic] Maximum Size for a RootsMagic -database There is no definitive answer, Jose, except some hard limits somewhere out there in a 64bit number limiting the size of a table and/or the operating system itself limiting the size of the file. RootsMagic4+ uses the SQLite3 database engine. Here's what its limits are: http://www.sqlite.org/limits.html and reading down to the last paragraph: "The theoretical maximum number of rows in a table is 2^64 (18446744073709551616 or about 1.8e+19). This limit is unreachable since the maximum database size of 140 terabytes will be reached first. A 140 terabytes database can hold no more than approximately 1e+13 rows, and then only if there are no indices and if each row contains very little data." That's 10,000,000,000,000 or 10 trillion rows. That said, there is the question of how long does it take the application, operating system and computer hardware to execute some procedure - all three of these are highly variable: the application on how much is done in SQL versus how much is done in the higher level application development language and with what granularity (i.e., how many calls to the database); the OS on which version and how it is configured; the hardware on disk speed (solid state disks offering a big advantage) and on caching in RAM... and then there is the question of how long a delay we are willing to tolerate. Some RM operations slow down seemingly exponentially with the number of persons in the database, e.g., Duplicate Search Merge. I'm curious to know how many persons are in your 930MB database and why??? Tom =================================== RM list Archives: http://archiver.rootsweb.com/th/index/ROOTSMAGIC-USERS/ http://archiver.rootsweb.com/cgi-bin/search?path=ROOTSMAGIC-USERS WISH LIST: http://www.rootsmagic.com/forums/ BLOG: http://blog.rootsmagic.com/ ------------------------------- To unsubscribe from the list, please send an email to ROOTSMAGIC-USERS-request@rootsweb.com with the word 'unsubscribe' without the quotes in the subject and the body of the message

    01/05/2013 12:08:59
    1. Re: [RMagic] Maximum Size for a RootsMagic -database
    2. Tom Holden
    3. Apparently there is a definitive limit, José. That's the 2TB that Bruce stated. As he is the chief architect and author of the software, he should know better than I. That has to do with the application development system Delphi and the compilation of SQLite3 he uses with it, DISQLite3, which has a published limit of 2TB, per http://www.yunqa.de/delphi/doku.php/products/sqlite3/feature_chart . If you can't have a bit of fun with genealogy, it would be a little dry ;-) Tom On 2013-01-05, at 1:08 PM, José Verheecke <jose.verheecke@telenet.be> wrote: > Hi Tom > Thanks for you answer:I had to read it a few times,not > being a very technically gifted one. > > There are >1410000 individuals in my file. > As I explained in the Facebook group Technology for Genealogy > my own family is but a very small part of my main file,which contains the > combined ancestry of most of Europe's crowned heads, American > presidents,movie stars (and so on),descendants of king James I/VI of > England/Scotland and the genealogists who study all of that.Is it all > proven? I spend my days adding,correcting &reviewing data. Well,there is > allso a 'fun part' in my file (Irish kinds,Biblical lineages and other > hallucinations) -I don't believe anything of it.... > I'm co-author of 4 books on the ancestors of tne king of the Belgians,the > crown prince,and their wives.That's how I got into it. They arent' related > to me,but,why should a genealogist limit himself to this own family? Tou can > view a sample of my work here: > http://users.telenet.be/JoseVerheecke/index.html > I started my computerized files 20 years ago - > a dozen others joined in -it did get a bit out of hand,I presume.. > José > jose.verheecke@telenet.be > Errare humanum est, > perseverare, diabolicum > > > > ----- Original Message ----- > From: Tom Holden > To: rootsmagic-users@rootsweb.com > Sent: Saturday, January 05, 2013 6:09 PM > Subject: Re: [RMagic] Maximum Size for a RootsMagic -database > > > There is no definitive answer, Jose, except some hard limits somewhere out > there in a 64bit number limiting the size of a table and/or the operating > system itself limiting the size of the file. RootsMagic4+ uses the SQLite3 > database engine. Here's what its limits are: > http://www.sqlite.org/limits.html and reading down to the last paragraph: > "The theoretical maximum number of rows in a table is 2^64 > (18446744073709551616 or about 1.8e+19). This limit is unreachable since the > maximum database size of 140 terabytes will be reached first. A 140 > terabytes database can hold no more than approximately 1e+13 rows, and then > only if there are no indices and if each row contains very little data." > That's 10,000,000,000,000 or 10 trillion rows. > > That said, there is the question of how long does it take the application, > operating system and computer hardware to execute some procedure - all three > of these are highly variable: the application on how much is done in SQL > versus how much is done in the higher level application development language > and with what granularity (i.e., how many calls to the database); the OS on > which version and how it is configured; the hardware on disk speed (solid > state disks offering a big advantage) and on caching in RAM... and then > there is the question of how long a delay we are willing to tolerate. Some > RM operations slow down seemingly exponentially with the number of persons > in the database, e.g., Duplicate Search Merge. > > I'm curious to know how many persons are in your 930MB database and why??? > > Tom > > > > =================================== > RM list Archives: http://archiver.rootsweb.com/th/index/ROOTSMAGIC-USERS/ > http://archiver.rootsweb.com/cgi-bin/search?path=ROOTSMAGIC-USERS > WISH LIST: http://www.rootsmagic.com/forums/ BLOG: > http://blog.rootsmagic.com/ > > > ------------------------------- > To unsubscribe from the list, please send an email to > ROOTSMAGIC-USERS-request@rootsweb.com with the word 'unsubscribe' without > the quotes in the subject and the body of the message > > > > =================================== > RM list Archives: http://archiver.rootsweb.com/th/index/ROOTSMAGIC-USERS/ > http://archiver.rootsweb.com/cgi-bin/search?path=ROOTSMAGIC-USERS > WISH LIST: http://www.rootsmagic.com/forums/ BLOG: http://blog.rootsmagic.com/ > > > ------------------------------- > To unsubscribe from the list, please send an email to ROOTSMAGIC-USERS-request@rootsweb.com with the word 'unsubscribe' without the quotes in the subject and the body of the message

    01/05/2013 06:35:18