PR#2: Crawler entrypoint => sitemaps -

I changed the crawler entrypoint to a sitemap to be more search engine friendly.

Output: https://mymindstorm.fedorapeople.org/sitemap/
Spec: https://www.sitemaps.org/protocol.html

This is my first time writing python, so the code might be a bit ugly.

Thanks for the contribution!

This is my first time writing python, so the code might be a bit ugly.

Don't worry, I'm not a python person either :-) I chosed this language since it already is widely used by the Fedora infrastructure team.

A few notes:

2500 is a magic number here, please put it in a variable and link to the related section in the sitemap specification.
I am not found of itertool.count() and break -> please use a boolean variable instead to make it easier to read, especially to non-python people.

1 new commit added

May 10, 2020

1 new commit added

May 10, 2020

rebased onto 18bfd0a258e23d0be247480dcc2e07034149519b

Oct 30, 2020

Pull-Request has been merged by mymindstorm

Oct 30, 2020

Assignee

None

Tags

No Tags