Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add configuration for adjusting URL crawling order #2856

Closed
marevol opened this issue Nov 3, 2024 · 0 comments
Closed

Add configuration for adjusting URL crawling order #2856

marevol opened this issue Nov 3, 2024 · 0 comments
Assignees
Milestone

Comments

@marevol
Copy link
Contributor

marevol commented Nov 3, 2024

A new configuration setting (config.crawl.order) has been added to control the order in which URLs are processed during crawling. This setting allows for either "sequential" or "random" processing. By default, URLs are processed sequentially. To enable random ordering, set the config.crawl.order configuration parameter to “random” in the CrawlingConfig class. This modification affects the FessUrlQueueService class to implement the URL processing order based on the specified configuration.

@marevol marevol added this to the 15.0.0 milestone Nov 3, 2024
@marevol marevol self-assigned this Nov 3, 2024
@marevol marevol closed this as completed in 036ebd6 Nov 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant