Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Data Harvesting
#1
Alright, so there are an insane number of DB's and accounts on this site. I've used SQL, powershell, and C++ to work through some of it, but I'm wondering what methods you guys use to parse, store, and verify the data you get? How do you deal with old data for example? 

Just open to ideas.
#2
Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm
#3
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?
#4
(11-19-2018, 05:26 AM)SteveTheBeaver Wrote:  
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?

Left click x2
#5
(11-19-2018, 05:30 AM)Moot Wrote:  
(11-19-2018, 05:26 AM)SteveTheBeaver Wrote:  
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?

Left click x2

I tried that and now my dick hurts
#6
CAT and GREP baby. Best way
#7
Im more of a hoarder. Haven't thought about what to do with the data long term yet.
#8
backup and linux-grep nothing else!
#9
(11-19-2018, 05:48 AM)BoringApe Wrote:  
(11-19-2018, 05:30 AM)Moot Wrote:  
(11-19-2018, 05:26 AM)SteveTheBeaver Wrote:  
(11-19-2018, 05:13 AM)Moot Wrote:  Download it then use a hacker program such as Notepad++

@September_11_2001

Can confirm

I will try that! How do you open .txt files btw?

Left click x2

I tried that and now my dick hurts

I would, but that won't work unless the data is newline delimited as far as I've seen.
#10
emeditor + regular expressions

emeditor has a trial, you might be able to find some keys around, but it's very good for managing huge files
#11
Good to know about this. Been thinking same
#12
if you are good at programming you can make a script to dump necessary data to another file.
otherwise if file is small notepad++ it supports regex,
if file is large emditor .
 


Possibly Related Threads...
Thread Author Replies Views Last Post
  The one DropBox that had most data? fruitpuncher 0 67 05-18-2019, 09:09 PM
Last Post: fruitpuncher
  California Voter and Consumer Data Usage Notice Crazyoldfart 2 193 04-10-2019, 01:13 AM
Last Post: Crazyoldfart
  List od Data breaches CorelDraw 8 302 04-08-2019, 12:29 PM
Last Post: DBlist
  Do you have access data that you have not leaked? vkad 18 1,121 04-02-2019, 10:55 AM
Last Post: rctrapdoor
  TELEGRAM DATA BASE MindExpand44 7 397 03-04-2019, 12:50 AM
Last Post: azetoz



Users browsing this thread: 1 Guest(s)