Skip to main content

Scraping

Scraping is where you add an Arizona Game and Fish account, start a scrape, and read the queue. The latest bonus points on this page are the same tables as on the Dashboard and on Bonus Points.

Accounts​

Scrape all queues every account that can be scraped. It is unavailable when none can. Add account opens the same form as on the Accounts page.

Each validated account row has Scrape for that person only. A Pending account uses the yellow Pending pill, which says Validate Now when you point at it and runs the full first sync. An account is skipped when its password is missing, marked invalid, or still Pending. An account that already has a pending or running job is not queued a second time. Scrape all skips those accounts and still starts the others. If a scrape stops because its worker died, that job ends on its own after a little over two minutes. Sections that were already saved stay saved, and the job is Partial. If nothing was saved, the job fails. Opening this page clears those jobs, and the account can be queued again. A scrape that is still running is left alone.

Choose the sections to read. Staff can also save the HTML. See Scrape modes. Starting a scrape stays on the page and opens the log. Closing the log does not stop the scrape. While one is running, Scraping in the header has a pulsing dot. Choose it to open the newest log again.

If the portal asks for a texted code, a dialog opens on the page you are on. Type the code and choose Continue. Cancel this account stops only that account. The others in the batch continue. If the log is closed, you can open it from the next dialog.

Scrape queue​

The queue shows the latest jobs for your accounts. It updates while a scrape is running, without reloading the page. Logs lists older batches, with the time and the account names. You can delete one, delete the ones you select, or delete all of them. Delete all asks you to confirm. A scrape that is still running cannot be deleted.

ResultMeaning
Pending or RunningThe job has not finished
Needs codeThe portal asked for a texted code. The dialog on the page is where you type it
Success, New bonus pointsThe points changed and a new set was saved
Success, UnchangedThe points matched the set already saved
Complete, with a warningThe account has no bonus points. That empty result is saved. This is not a failure
PartialSome sections were saved and some were not, or a saved draw list or licenses page was incomplete. Each section is named. Saved draws and licenses that could not be confirmed were kept. Retry unfinished sections queues a new job for the sections that did not finish. The original job stays Partial
CancelledThat account was cancelled while it waited for a code
FailedOpen the result to read the full message. A rejected portal password asks you to save a new one before Run again. A missing browser offers Run again. A section that was not saved offers Retry unfinished sections

The same failure text is also on the job in the admin site, for staff.