Large DB storage and querying question
by Raider9021 - 01-18-2019, 10:38 PM
#1
Where is everyone storing their personal data bases? When you add all of the combolists/compilations together, etc the size is massive.

Have you found a good way to store, index and query the data? AWS and Logstash or something?

Is there a cheap way of doing this that will give maximum storage and eficiency in searching?
Reply
#2
(01-18-2019, 10:38 PM)Raider9021 Wrote: Where is everyone storing their personal data bases? When you add all of the combolists/compilations together, etc the size is massive.

Have you found a good way to store, index and query the data? AWS and Logstash or something?

Is there a cheap way of doing this that will give maximum storage and eficiency in searching?

comma-separated values
Reply
#3
Nice one.. I've played with clickhouse (clickhouse.yandex) and elasticsearch. MongoDB is not working since it does not scale on multiple servers.
Reply
#4
just store them as text files and grep
Reply

Possibly Related Threads…
Thread Author Replies Views Last Post
1.7K Mediafire accounts (personal cloud storage) GreatGandalf 0 156 05-16-2019, 11:28 PM
Last Post: GreatGandalf
Large Collection of Gaming Combos hifidelity88 2 666 10-03-2018, 01:22 AM
Last Post: oussama11

 Users browsing this thread: 1 Guest(s)