Weekly sample pages from public-records data feeds (tenders, grants, power projects)
View the Project on GitHub beingRealFrank/civic-data-feeds-samples
If a script downloads TED notice pages (the /xml, /pdf, /html or /detail links) and gets HTTP 202, an empty body and a x-amzn-waf-action: challenge header, the request was stopped by a web application firewall challenge, not by a missing notice. The status looks like success, so code that only checks for a 2xx will happily save an empty file.
From one machine with plain curl, all four of these returned 202, text/html, 0 bytes and the challenge header:
https://ted.europa.eu/en/notice/756345-2026/xmlhttps://ted.europa.eu/en/notice/756345-2026/pdfhttps://ted.europa.eu/en/notice/756345-2026/htmlhttps://ted.europa.eu/en/notice/-/detail/756345-2026In the same minute, six consecutive calls to the Search API (POST https://api.ted.europa.eu/v3/notices/search) all returned 200. Other people have reported the same notice links working from other networks, so the behaviour is intermittent and depends on where and how you call.
application/xml or application/pdf), and never accept an empty or HTML body as XML or PDF.publication-number, notice-title, buyer-name, deadline-receipt-tender-date-lot, classification-cpv and more) instead of downloading and parsing each notice page. See the TED API guide and publication numbers and links.https://ted.europa.eu/en/notice/-/detail/<publication-number> page opens fine in a normal browser.The EU & UK Public Tenders Monitor reads notices through the Search API, so it is not affected by the page challenge, and it returns the official notice link in the url field. See the weekly sample.
Data source: TED, © European Union.