From mboxrd@z Thu Jan 1 00:00:00 1970 Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail From: "Randy Brukardt" Newsgroups: comp.lang.ada Subject: Re: "Red" And The DoD Language Competition Date: Wed, 11 Sep 2024 23:57:33 -0500 Organization: A noiseless patient Spider Message-ID: References: Injection-Date: Thu, 12 Sep 2024 06:57:31 +0200 (CEST) Injection-Info: dont-email.me; posting-host="63a211bc0083a84961071e8a6410a533"; logging-data="107118"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX194HTsIkaTKn5PlYGBUuhWecWdbt/zrLEs=" Cancel-Lock: sha1:iWR/cISrvTzJJs+6cq0NXKzXVmI= X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.7246 X-Priority: 3 X-MSMail-Priority: Normal X-Newsreader: Microsoft Outlook Express 6.00.2900.5931 X-RFC2646: Format=Flowed; Original Xref: news.eternal-september.org comp.lang.ada:66337 List-Id: "Lawrence D'Oliveiro" wrote in message news:vbimad$1j26j$6@dont-email.me... ... > Hey, terrific. Don't you wonder why people insist on returning "403 > Forbidden" for those using a command-line tool like wget? No (as the operator of a web site). Most SEO tools and other useless/criminal scrapers like to fake their identification, and WGet is a favorite for that task. There are many owners that block that and many other abused user-agents. (The Ada-Auth.org blocks about 20 user-agents, but not WGet. See https://support.tigertech.net/error-blocked-user-agents for a better explanation than I can give as to why. I don't block all of these agents, but I do throttle some of them and block their access to parts of the site.) Additionally, some sites want to provide access to their documents, but not really to allow people to copy them (in order to get advertising revenue from reading them). I know the owners of the Red specification are in this category, as I offered to host a copy in the AdaIC archives, and they turned that down. Randy.