Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Large DB storage and querying question
#1
Where is everyone storing their personal data bases? When you add all of the combolists/compilations together, etc the size is massive.

Have you found a good way to store, index and query the data? AWS and Logstash or something?

Is there a cheap way of doing this that will give maximum storage and eficiency in searching?
Reply
#2
(01-18-2019, 10:38 PM)Raider9021 Wrote:  Where is everyone storing their personal data bases? When you add all of the combolists/compilations together, etc the size is massive.

Have you found a good way to store, index and query the data? AWS and Logstash or something?

Is there a cheap way of doing this that will give maximum storage and eficiency in searching?

comma-separated values
Reply
#3
Nice one.. I've played with clickhouse (clickhouse.yandex) and elasticsearch. MongoDB is not working since it does not scale on multiple servers.
Reply
#4
just store them as text files and grep
Reply
 


Possibly Related Threads...
Thread Author Replies Views Last Post
  WPA and WPA2 and clean wordlists for any jobs gh4d3r 3 683 02-03-2019, 11:44 PM
Last Post: roundup
  Large Collection of Gaming Combos hifidelity88 2 608 10-03-2018, 01:22 AM
Last Post: oussama11



Users browsing this thread: 1 Guest(s)