Advertisements:

Poll: How do you do it?
This poll is closed.
Grep + flat text files

4 40.00%
MySQL/Other Database

3 30.00%
Custom search tool + flat text files

0 0%
Something else

3 30.00%
Total 10 vote(s) 100%
* You voted for this item. [Show Results]


Thread Rating:
  • 2 Vote(s) - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How do you search your DBs?
#13
(06-17-2017, 07:00 PM)Stuxnet Wrote:  
(06-17-2017, 06:56 PM)aha Wrote:  
(06-17-2017, 06:50 PM)Stuxnet Wrote:  I use ripgrep
I plan on parsing all my dbs and importing them to PostgreSQL

I've been thinking about importing them all into a MySQL db. I'm not sure it'll be worth the effort, though

It would be so convenient to have them all in one place and the search would be a lot faster than RipGrep
But it would take a lot of effort to parse them all

I was thinking doing the same. Will take a load of efforts. Especially for SQL dump. But in the long term it will be worth it.
Reply
#14
(06-17-2017, 06:38 PM)aha Wrote:  
(06-17-2017, 09:47 AM)mrzogs Wrote:  I use RipGrep. Much faster than Grep and do what I want.

Hmm. Never used this before but it looks really cool

(06-16-2017, 11:02 PM)STARTEXMISLEAD Wrote:  
(06-16-2017, 10:59 PM)gall Wrote:  I use EmEditor to open the mega txt files.

same dude so do most people tbh free reliable and always opens it.

How does it compare to UltraEdit?

never used ultraedit sorry cant give you advise on that.
Reply
#15
(06-17-2017, 09:46 PM)STARTEXMISLEAD Wrote:  
(06-17-2017, 06:38 PM)aha Wrote:  
(06-17-2017, 09:47 AM)mrzogs Wrote:  I use RipGrep. Much faster than Grep and do what I want.

Hmm. Never used this before but it looks really cool

(06-16-2017, 11:02 PM)STARTEXMISLEAD Wrote:  
(06-16-2017, 10:59 PM)gall Wrote:  I use EmEditor to open the mega txt files.

same dude so do most people tbh free reliable and always opens it.

How does it compare to UltraEdit?

never used ultraedit sorry cant give you advise on that.

It's super stable while opening giant text files. Also does freaky fast find-and-replace
Reply
#16
Quote:It's super stable while opening giant text files. Also does freaky fast find-and-replace

If you are on Linux I can advise JOE Editor (http://joe-editor.sourceforge.net/). Can handle pretty big files.
Reply
#17
I use mysql geospatial indexing to search.

It takes a long time to index & convert but def worth it.
Reply
#18
(06-18-2017, 12:12 PM)retasha Wrote:  I use mysql geospatial indexing to search.

It takes a long time to index & convert but def worth it.

How do you go about searching each DB you've loaded? Is it a separate SELECT statement for every single table?
Reply
#19
(06-18-2017, 12:20 PM)aha Wrote:  How do you go about searching each DB you've loaded? Is it a separate SELECT statement for every single table?

depends on the situation.(if the column names are the same, If I could use merger union etc. for basic queries on all tablaes I use this simple tool:

https://www.rarst.net/code/anywhereindb/
Reply
#20
(06-18-2017, 12:45 PM)retasha Wrote:  
(06-18-2017, 12:20 PM)aha Wrote:  How do you go about searching each DB you've loaded? Is it a separate SELECT statement for every single table?

depends on the situation.(if the column names are the same, If I could use merger union etc. for basic queries on all tablaes I use this simple tool:

https://www.rarst.net/code/anywhereindb/

Wow, this looks really useful. I might have to try it out after I load up a few more DBs. Just wish it didn't take SO long to import a csv into a table
Reply
#21
If you have a lot of free time you can try to import it in Elastic Search. Would be awesome.
Reply
#22
(06-18-2017, 02:20 PM)mrzogs Wrote:  If you have a lot of free time you can try to import it in Elastic Search. Would be awesome.

All I know is that importing into MySQL with MySQLWorkbench is taking ages. It's taken 1.5+ hrs to get a 250MB CSV imported to 50%. Maybe I just have it on a slow disk
Reply
#23
I use alt+f7 Smile in my total commander
Reply
#24
sift, never used anything else, sometimes if its a single db its Glogg.
Reply
 


Possibly Related Threads...
Thread Author Replies Views Last Post
Lightbulb [Open Source] Leaker Searcher - Search for datas in your leaks in a fast way! Virgula 16 1,519 01-11-2018, 10:07 PM
Last Post: Tac
  Search multiple tables form different mysql databases? Hacker6969 4 508 09-09-2017, 10:38 AM
Last Post: maha678



Users browsing this thread: 1 Guest(s)