From mboxrd@z Thu Jan  1 00:00:00 1970
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: Lawrence D'Oliveiro <ldo@nz.invalid>
Newsgroups: comp.lang.ada
Subject: Re: "Red" And The DoD Language Competition
Date: Thu, 12 Sep 2024 22:27:54 -0000 (UTC)
Organization: A noiseless patient Spider
Message-ID: <vbvpta$esm6$8@dont-email.me>
References: <vbdndk$lt27$1@dont-email.me> <vbhvre$1eabl$1@dont-email.me>
	<vbimad$1j26j$6@dont-email.me> <vbtsbq$38je$1@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Fri, 13 Sep 2024 00:27:54 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="fe8eaca0c36637cab02c0b5baab677cf";
	logging-data="488134"; mail-complaints-to="abuse@eternal-september.org";	posting-account="U2FsdGVkX18BBoTpII/7a1ChoAlQBfnX"
User-Agent: Pan/0.160 (Toresk; )
Cancel-Lock: sha1:SunXMS52TqW29524HrhWJvMRvxw=
Xref: news.eternal-september.org comp.lang.ada:66352
List-Id: <comp.lang.ada>

On Wed, 11 Sep 2024 23:57:33 -0500, Randy Brukardt wrote:

> "Lawrence D'Oliveiro" <ldo@nz.invalid> wrote in message
> news:vbimad$1j26j$6@dont-email.me...
>>
>> Don't you wonder why people insist on returning "403
>> Forbidden" for those using a command-line tool like wget?
> 
> Most SEO tools and other
> useless/criminal scrapers like to fake their identification, and WGet is
> a favorite for that task. There are many owners that block that and many
> other abused user-agents.

That doesn’t make any sense, because anybody who knows how to use wget 
would know about its “--user-agent” option. So if they really were using 
wget to conduct their site abuse, you wouldn’t know, and blocking wget’s 
default user-agent setting wouldn’t help.

> (The Ada-Auth.org blocks about 20 user-agents, but not WGet.

Which kind of proves my point.