crawling intranet credentials issues

292 views Asked by At

I've been trying to crawl and index the intranet and the internet. But It doesn't work at all, I think it's due to proxy/security restrictions. I get the indexed parsed to true but the content length is -1 so it crawls nothing. Is there anyway I can put the credentiels I have on the intranet to crawl it in open search server knowing that it has only basic/Digest or NTLM authentication?

Is there anyway to configure the proxy on oss more than just on the one in the crawler tab? I have set the credentials but it doesn't seem like oss recognises the proxy of the company so it doesn't give me the box to enter the credentials.

1

There are 1 answers

0
Emmanuel Keller On

Since version 1.5.4, OpenSearchServer supports authentication on proxy.

Here is the GITHub issue: https://github.com/jaeksoft/opensearchserver/issues/589

For now, the v1.5.4 is only available as nightly build.

enter image description here