Skip to main content

Scraping

Where do I start a scrape?​

On Scraping, use Scrape for one account or Scrape all for every account that can be queued. On the Dashboard and the Accounts page, point at the yellow Pending pill and choose Validate Now to run that account's full first sync. From an account opened on the Dashboard, Scrape this account queues that person.

Why is Scrape all unavailable?​

No account on your login can be queued. Add a password, or fix an account marked Invalid or Missing.

Why was one account skipped?​

It has no password, the password is marked Invalid, it is still Pending, or it already has a job pending or running. Scrape all skips that account and still runs the others. Use Validate for a Pending account.

The queue says Failed​

Open the result for the full message. A rejected portal password marks the account Invalid until you save a new one. Run again is offered after that password is saved. If the message says the browser is missing, the app's browser has not been installed on the machine that runs scrapes, and Run again starts the same scrape.

The queue says Partial​

Some of the scrape was saved and some was not, or a draw list or licenses page was incomplete. The saved part stays. Retry unfinished sections runs only the rest, as a new job. The original job stays Partial. A login that was rejected is not Partial. Save a new password, then use Run again.

The queue says the account has no bonus points​

That job succeeded. The portal reported no bonus points, and that empty result is saved. It is not a failure.

How often does the queue update?​

It updates while a scrape is running. You do not need to reload the page. Scraping in the header opens the log again. Logs on the Scraping page lists older ones.

Does a scrape also update draw applications?​

After the account is validated, include Applications in the scrape. See Scrape modes. If the portal asks for a texted code, a dialog opens on the page you are on. Enter it and choose Continue. A job that was not started from the site skips an account that has SMS two-factor turned on.