Poll: How do you do it?
You do not have permission to vote in this poll.
Grep + flat text files

4 40.00%
MySQL/Other Database

3 30.00%
Custom search tool + flat text files

0 0%
Something else

3 30.00%
Total 10 vote(s) 100%
* You voted for this item. [Show Results]


Thread Rating:
  • 2 Vote(s) - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How do you search your DBs?
#1
Information 
I've been trying to come up with a good solution to make my DB collection searchable, semi-portable, and take as little disk space as possible.  

How do you do it?
Reply
#2
I use grep, which runs through my 350gbs in minutes.
Reply
#3
(06-16-2017, 10:00 PM)NeoNazi Wrote:  I use grep, which runs through my 350gbs in minutes.

That's much faster than my 80GB. You must not have any sort of compression on the files?
Reply
#4
No all uncompressed .txt .sql .db files
Reply
#5
I use EmEditor to open the mega txt files.
Reply
#6
(06-16-2017, 10:59 PM)gall Wrote:  I use EmEditor to open the mega txt files.

same dude so do most people tbh free reliable and always opens it.
Reply
#7
I use RipGrep. Much faster than Grep and do what I want.
Reply
#8
(06-17-2017, 09:47 AM)mrzogs Wrote:  I use RipGrep. Much faster than Grep and do what I want.

Hmm. Never used this before but it looks really cool

(06-16-2017, 11:02 PM)STARTEXMISLEAD Wrote:  
(06-16-2017, 10:59 PM)gall Wrote:  I use EmEditor to open the mega txt files.

same dude so do most people tbh free reliable and always opens it.

How does it compare to UltraEdit?
Reply
#9
I use ripgrep
I plan on parsing all my dbs and importing them to PostgreSQL
Reply
#10
(06-17-2017, 06:50 PM)Stuxnet Wrote:  I use ripgrep
I plan on parsing all my dbs and importing them to PostgreSQL

I've been thinking about importing them all into a MySQL db. I'm not sure it'll be worth the effort, though
Reply
#11
(06-17-2017, 06:56 PM)aha Wrote:  
(06-17-2017, 06:50 PM)Stuxnet Wrote:  I use ripgrep
I plan on parsing all my dbs and importing them to PostgreSQL

I've been thinking about importing them all into a MySQL db. I'm not sure it'll be worth the effort, though

It would be so convenient to have them all in one place and the search would be a lot faster than RipGrep
But it would take a lot of effort to parse them all
Reply
#12
(06-17-2017, 07:00 PM)Stuxnet Wrote:  
(06-17-2017, 06:56 PM)aha Wrote:  
(06-17-2017, 06:50 PM)Stuxnet Wrote:  I use ripgrep
I plan on parsing all my dbs and importing them to PostgreSQL

I've been thinking about importing them all into a MySQL db. I'm not sure it'll be worth the effort, though

It would be so convenient to have them all in one place and the search would be a lot faster than RipGrep
But it would take a lot of effort to parse them all


The thing I couldn't really wrap my head around was how to organize it and create a universal search.  Like, I guess you'd just create 1 table for every DB you load in, but then how to do you say "I'd like to search for email: [email protected]".  Since all the tables would have completely different columns, you couldn't do a UNION and a JOIN wouldn't be easy.
Reply
 


Possibly Related Threads...
Thread Author Replies Views Last Post
Lightbulb [Open Source] Leaker Searcher - Search for datas in your leaks in a fast way! Virgula 17 2,076 02-06-2018, 08:11 PM
Last Post: Jabu2
  Search multiple tables form different mysql databases? Hacker6969 4 625 09-09-2017, 10:38 AM
Last Post: maha678



Users browsing this thread: 1 Guest(s)