Code Caching: Track pages before hashing
.. to avoid a race condition around stale caches.

Possibly best implemented via #1961

Follow up from #1842