Home » Forum
  • If this is your first visit, be sure to check out the FAQ by clicking the link above. You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.


No announcement yet.

Could not download file (Invalid URL or domain name)

  • Filter
  • Time
  • Show
Clear All
new posts

  • Could not download file (Invalid URL or domain name)

    Hi, hope someone can help with this - I'm having problems indexing my website (or any other website)...
    I have double-checked the configuration and tried other URLs, tried with firewall disabled and still no joy. Please can someone shed some light for me?

    Here is my log:

    15:07:30 - Start indexing (spider mode) at Fri Oct 18 15:07:30 2013
    15:07:30 - Maximum number of words: 15000
    15:07:30 - Maximum number of files: 50
    15:07:30 - Will scan files with extensions
    15:07:30 - .php
    15:07:30 - .asp
    15:07:30 - .cgi
    15:07:30 - .aspx
    15:07:30 - .pl
    15:07:30 - .php3
    15:07:30 - Spider from: http://www.mystudentcard.com/
    15:07:30 - Web site URL: http://www.mystudentcard.com/
    15:07:30 - Estimated RAM required during index process: 5249 KB
    15:07:30 - Initiating HTTP session (thread #1) ...
    15:07:30 - DL Thread #1, got URL (http://www.mystudentcard.com/) off queue
    15:07:30 - [DOWNLOAD] Downloading file http://www.mystudentcard.com/
    15:07:30 - [WARNING] Could not download file: http://www.mystudentcard.com/ (Invalid URL or domain name)
    15:07:44 - [ERROR] No files found to spider from http://www.mystudentcard.com/
    15:07:44 - Indexing failed
    15:07:44 - Waiting for threads to finish ...
    15:07:44 - Cleaning up memory used for index data... please wait.
    15:07:44 - Finished cleaning up memory.

  • #2
    At the moment you do not seem to be indexing .HTML nor .HTML files.

    The home page of your site is probably coming back with a HTML content type. So can you try adding these file types.