date range/post limit

[mattdawolf]

What is a good way to only have gallery-dl crawl the latest X amount of entries by either numberor date range?

gallery-dl --destination ~/naylor_gallerydl_scrapetest https://www.patreon.com/jaynaylor/posts --filename='/O'
If I were to run this daily in cron it would just needlessly crawl the entire thing and go back 10+ years.

[mikf]

  -A, --abort N               Stop current extractor run after N consecutive
                              file downloads were skipped

At least that's the intended way of updating an existing collection, but it has its flaws #5255 (comment).

---

You could also do

--filter "date >= datetime(2024, 3, 1) or abort()"

to stop after posts from March 1st.

---

Patreon also supports limiting posts to a specific month:

https://www.patreon.com/USER/posts?filters[month]=2024-3

[MarqFJA87]

What about the "opposite" - that is, to make the app only download stuff that's older than a certain date? I ask because lately, trying to download the entire media timeline from a Twitter account that has like 2000+ media tweets and isn't shadowbanned (which would limit gallery-dl's access to only the last ~1000 media tweets) would inevitably trip the site's security and forcibly but silently log out my account, thus interrupting the download; if there's a way to make gallery-dl continue the download from where it left off, it would be very helpful.