Here is a copy of the Zoom and IIS logs (in spider mode):
Code:
Zoom Log:
02|01/19/09 11:51:08|Spider from: http://nt1-v/intranet/default.asp
02|01/19/09 11:51:08|Web site URL: http://nt1-v/
02|01/19/09 11:51:08|Estimated RAM required during index process: 313733 KB
02|01/19/09 11:51:09|Initiating HTTP session (thread #1) ...
14|01/19/09 11:51:09|DL Thread #1, got URL (http://nt1-v/intranet/default.asp) off queue
04|01/19/09 11:51:09|Downloading file http://nt1-v/intranet/default.asp
09|01/19/09 11:51:09|Could not download file: http://nt1-v/intranet/default.asp (401 HTTP Error)
IIS Log:
2009-01-19 17:07:02 192.168.1.200 - 192.168.1.136 80 GET /robots.txt - 401 4625 214 0 -
2009-01-19 17:07:02 192.168.1.200 BI\spider 192.168.1.136 80 GET /robots.txt - 404 4622 1806 0 -
2009-01-19 17:07:02 192.168.1.200 - 192.168.1.136 80 GET /intranet/default.asp - 401 4611 234 0 -
Now the wierd part. If I stop the indexing and start it again without closing the applications it works!? The site is running IIS 5.0 on W2K server.
Here is the log from the second time:
Code:
2009-01-19 18:22:28 192.168.1.200 - 192.168.1.136 80 GET /robots.txt - 401 4644 228 0 -
2009-01-19 18:22:28 192.168.1.200 BI\spider 192.168.1.136 80 GET /robots.txt - 404 4641 1837 0 -
2009-01-19 18:22:28 192.168.1.200 - 192.168.1.136 80 GET /intranet/default.asp - 401 4630 248 0 -
2009-01-19 18:22:28 192.168.1.200 spider 192.168.1.136 80 GET /intranet/default.asp - 200 12469 191 591 -
It seems like the second time the page was first requested with no credentials and then supplied bi\spider as the user. I noticed that when I had the server set to integrated authentication every page was requested twice: once without a user and then once with. Anonymous authentication is not enabled in either scenario.
Here is a part of the IIS log when in integrated mode:
Code:
2009-01-18 17:07:08 192.168.1.200 - 192.168.1.136 80 GET /intranet/Technical/TestResults/QualityTestCrossReference.asp - 401 4625 314 0 -
2009-01-18 17:07:08 192.168.1.200 - 192.168.1.136 80 GET /intranet/Technical/TestResults/CertsOfAnalysis.asp - 401 4625 294 10 -
2009-01-18 17:07:08 192.168.1.200 - 192.168.1.136 80 GET /intranet/Maintenance/Default.asp - 401 4625 258 0 -
2009-01-18 17:07:08 192.168.1.200 BI\spider 192.168.1.136 80 GET /intranet/Technical/TestResults/Default.asp - 200 0 1838 390 -
2009-01-18 17:07:08 192.168.1.200 - 192.168.1.136 80 GET /intranet/Maintenance/Equipment.asp - 401 4625 262 0 -
2009-01-18 17:07:08 192.168.1.200 BI\spider 192.168.1.136 80 GET /intranet/Technical/TestResults/RetrieveSavedData.asp - 200 0 1848 450 -
2009-01-18 17:07:09 192.168.1.200 - 192.168.1.136 80 GET /intranet/Technical/ShopPaper/Default.asp - 401 4625 274 0 -
2009-01-18 17:07:09 192.168.1.200 BI\spider 192.168.1.136 80 GET /intranet/Maintenance/Default.asp - 200 0 1828 450 -
Finally, when interactively running Zoom I am not logged in as bi\spider so Zoom is supplying the right credentials to IIS. I'm confused.
Thanks,
Chris