Author Topic: scrape website information that needs user/pass  (Read 1866 times)

0 Members and 2 Guests are viewing this topic.

IKROWNI

  • $upporter
  • Sr. Member
  • *****
  • Posts: 146
  • Karma: 2
    • View Profile
scrape website information that needs user/pass
« on: June 09, 2017, 04:06:43 PM »
i just recently bought a 2017 chevy cruze and they have a website that the car updates information about the vehicle stats. I was wanting to grab that information into a txt file to use for other things. Is vox capable of doing this and if so could you show me an example to get started?

EDIT: here is the site

https://my.chevrolet.com/ovd
« Last Edit: June 09, 2017, 04:13:47 PM by IKROWNI »

Kalle

  • $upporter
  • Hero Member
  • *****
  • Posts: 2320
  • Karma: 47
    • View Profile
Re: scrape website information that needs user/pass
« Reply #1 on: June 09, 2017, 05:22:44 PM »
Maybe, but this is outside of my knowledge about RegEx and it needs a account - try it with the RegEx tool in VC.
I think RoboBrowser can also help.


Kalle

***********  get excited and make things  **********

jitterjames

  • Administrator
  • Hero Member
  • *****
  • Posts: 7714
  • Karma: 116
    • View Profile
    • VoxCommando
Re: scrape website information that needs user/pass
« Reply #2 on: June 09, 2017, 05:55:59 PM »
VoxCommando can almost certainly do this but you'll probably need to learn to use RoboBrowser.

IKROWNI

  • $upporter
  • Sr. Member
  • *****
  • Posts: 146
  • Karma: 2
    • View Profile
Re: scrape website information that needs user/pass
« Reply #3 on: June 09, 2017, 10:54:45 PM »
VoxCommando can almost certainly do this but you'll probably need to learn to use RoboBrowser.

Cool ill take a look at it and see what i can come up with. I use roboB for my security cameras right now since they arent ip cameras. It allows me to setup when vox turns on it goes to the local ip of the cameras and logs in automatically. I just dont know how to grab all the text from a page and put it into a txt file.

jitterjames

  • Administrator
  • Hero Member
  • *****
  • Posts: 7714
  • Karma: 116
    • View Profile
    • VoxCommando
Re: scrape website information that needs user/pass
« Reply #4 on: June 10, 2017, 02:29:33 PM »
First use ElementBy*** to select whatever contains the info you need and then GetHTML

http://voxcommando.com/mediawiki/index.php?title=Plugin_RoboB#GetHTML

Or you might find it easier to use GetText. It depends on what you want to do with it afterwards.
« Last Edit: June 10, 2017, 02:59:36 PM by nime5ter »