5 Commits

Author	SHA1	Message	Date
wolfbeast	736d25cbec	Issue #447 - Improve the getHSTSPreloadList script ... - Use HEAD instead of GET for probe to avoid loading pages - Reduce retries to 2 - Reduce timeout to 10 s (since we're just getting a HEAD this is royal) - Identify ourselves to websites as an automated tool - Improve performance of list merging (O(n^2) was getting too expensive) - Add a total counter and perform GC every 200 requests	2019-11-09 13:10:23 +01:00
trav90	cef7fcb377	Restore clearly-delimited format for the HSTS preload list	2018-06-06 08:30:34 -05:00
trav90	3b7938d7a1	Increase concurrent lookups to 15 when generating HSTS preload list	2018-06-05 22:25:18 -05:00
trav90	a32e0cb8c7	Update HSTS preload list generation script ... Previous behavior: if an entry was in the previously-used list, and there would be an error connecting to or processing the host, it would adopt it using the previous status, with a new minimum required max age TTL. New behavior: if an entry is in the previously-used list, and there is an error connecting to or processing the host, it will be dropped from the preload list. The old behavior would allow entries to persist on the HSTS preload list when they drop off the 'net. Considering domain churn, it would cause issues for new owners for having a persisted HSTS entry preloaded in the browser. Bonus: it keeps our HSTS preload list lean.	2018-06-05 22:23:30 -05:00
Matt A. Tobin	5f8de423f1	Add m-esr52 at 52.6.0	2018-02-02 04:16:08 -05:00