Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
web-scraping know-how
#1
i am searching for help regarding the know-how on how to build a web-scraping solution. any help is welcome, as i am not very familiar with this particular topic, but would need it for an application that has to be done as part of a comprehensive university task. 

are here any web-scraping specialists, that could give me an overview, which techniques or methods are best-practice or which tools (not so good for me, as i have to do it on my own) i should look at? 

a lot of thanks to the admins to accept me to this forum.
Reply
#2
(04-18-2018, 01:57 PM)westberlin Wrote:  i am searching for help regarding the know-how on how to build a web-scraping solution. any help is welcome, as i am not very familiar with this particular topic, but would need it for an application that has to be done as part of a comprehensive university task. 

are here any web-scraping specialists, that could give me an overview, which techniques or methods are best-practice or which tools (not so good for me, as i have to do it on my own) i should look at? 

a lot of thanks to the admins to accept me to this forum.

Selenium is easiest route to get started: https://www.seleniumhq.org/
Reply
#3
Hey bro! Do you know programming? If you have knowledge about it you can do some bots with C# with web browser or Javascript frameworks like phantomjs. If you don't, you can use some scraping tool like ubot, or chrome or Firefox add-on on their market.
Reply
#4
I can help you code your own custom scraper with python.
Reply
#5
If you want to roll your own thing, look into Scrapy and Beautifulsoup for Python.
Reply
#6
python and BS4 mate all you need
Reply
 


Possibly Related Threads...
Thread Author Replies Views Last Post
  Advanced Web Scraping with Headless Chromium booloop 0 150 07-28-2018, 11:27 PM
Last Post: booloop



Users browsing this thread: 1 Guest(s)