Improvement to the Social Club scanner...

[toobsock]

Starting with Tomorrow's scan in a few hours, we are going to be trying a more intelligent scanner. It will try and catch the times when the Social Club serves up 0's for a character's data, wait a certain amount of time and rescan that character and see if "real data" is available.

After 3 fails, I think we should give up... but what should we record for that character for that day if anything?

We're always making improvements to the underlying code of the website and scanner, but we felt this was something significant to try and figure out.

The best we can do of course is to compare the new data to existing data in our database, so we look at 5 fields for the statistic to be the same or increase, if any of them fail, we consider all of the data grabbed at that time to be bad.

I know the Social Club statistics aren't perfect, but we can at least try to improve what we present to the user.

[toobsock]

In addition, we've thought about scanning all of the data we've already scanned and looking for times when 0's were grabbed instead of real data (thanks Social Club).

If we do that, again, should we delete the data from that day's scans or carry over the previous day's numbers or what?

[toobsock]

So the scan went well Today... it caught quite a few characters that were being served up 0's on the Social Club.

The scan is done for the most part, there are (at this moment) 17 characters that are still not updated for Today and are being re-scanned until they do.

Not all of them are being served up as 0's, there are a few that have fields that have gone backwards instead of forwards, and those are included in the same group.

Will update this post later.

Update @ 7:18 (approximately 2 hours later): The number of characters being rescanned is down from 17 to 14.

Update @ 11:20: The number of characters being rescanned is down from 14 to 10. Let's go Social Club!

Update @ 14:53: Down to 7...

Update @ 21:00: Down to 6... will stop it in a couple of hours and no stats will be recorded for those characters.

Update @ 23:45: Ok, stopped it for the day... 5 players that didn't have "updated" stats on their Social Club, and here they are:

maggardxx
bitpiestudios
saimriaz
thekoolaid08
kingmaxican

Better luck in a few hours when we do our daily scan.

[toobsock]

4 players ultimately didn't have updated stats for Yesterday's scan, 2 are left over from the previous day.

killermullac
bitpiestudios
deezy813
thekoolaid08

[toobsock]

10 players didn't update Today, including all 4 from Yesterday:

excesscrescent
killermullac
roguestatus50
bitpiestudios
lookbrozombies
dontfeckwithme
alphaanimal187
brendanmurphy
deezy813
mshing80

[toobsock]

14 players didn't update Today, including several from the previous day:

killermullac
bitpiestudios
lookbrozombies
alphaanimal187
deezy813
mshing80
dirtymarko
dizzlethedawg
g-nasty-617
hiroshio
joshardron
legion_judianer
lkrook
m4tr1x_pro

[toobsock]

Dedicated a page to the "Re-scanner" on the site, http://GTAonlinestats.com/rescans