IBM WebSphere Portal Search Engine does not crawl all the web content items

Portal search engine fails to crawl same content that may reside in different site areas of the same library

By default the crawler considers the content to be same and will only crawl the content item once even if it resides under different site areas. To resolve this issue simply add search service property CHECK_DUPLICATES = false and create new search collection