Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Data Harvesting
#1
Alright, so there are an insane number of DB's and accounts on this site. I've used SQL, powershell, and C++ to work through some of it, but I'm wondering what methods you guys use to parse, store, and verify the data you get? How do you deal with old data for example? 

Just open to ideas.
Reply
#2
Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm
Reply
#3
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?
Reply
#4
(11-19-2018, 05:26 AM)SteveTheBeaver Wrote:  
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?

Left click x2
Reply
#5
(11-19-2018, 05:30 AM)Moot Wrote:  
(11-19-2018, 05:26 AM)SteveTheBeaver Wrote:  
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?

Left click x2

I tried that and now my dick hurts
Reply
#6
CAT and GREP baby. Best way
Reply
#7
Im more of a hoarder. Haven't thought about what to do with the data long term yet.
Reply
#8
backup and linux-grep nothing else!
Reply
#9
(11-19-2018, 05:48 AM)BoringApe Wrote:  
(11-19-2018, 05:30 AM)Moot Wrote:  
(11-19-2018, 05:26 AM)SteveTheBeaver Wrote:  
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?

Left click x2

I tried that and now my dick hurts

I would, but that won't work unless the data is newline delimited as far as I've seen.
Reply
#10
emeditor + regular expressions

emeditor has a trial, you might be able to find some keys around, but it's very good for managing huge files
Reply
#11
Good to know about this. Been thinking same
Reply
#12
if you are good at programming you can make a script to dump necessary data to another file.
otherwise if file is small notepad++ it supports regex,
if file is large emditor .
Reply
 


Possibly Related Threads...
Thread Author Replies Views Last Post
  nice list of recent data breaches in nov 2018 tornic 68 2,712 Yesterday, 12:51 AM
Last Post: Stiffler1
  How come we ain’t able to connect to rf on data? frost 7 211 12-13-2018, 11:40 PM
Last Post: DasSilky
  How useful are data dumps? ashayc 14 531 12-13-2018, 11:28 PM
Last Post: rf6686rf
  Looking for fresh italian email/phone data! leande1989Lee 0 69 12-12-2018, 12:46 AM
Last Post: leande1989Lee
  [REQUEST] Looking for US mobile data leande1989Lee 1 161 12-08-2018, 03:23 AM
Last Post: malamutes



Users browsing this thread: 1 Guest(s)