[TASK] Take the no_search field into consideration when generating sitemaps to avoid jobs being shown twice

[FEATURE] Introduce the path_segment field that allows to give proper URLs yourself, Also a lot of cleanup was done