17 Sep
2025
17 Sep
'25
11:14 a.m.
On Wed, Sep 17, 2025 at 1:27 PM The Doctor via cctalk <cctalk(a)classiccmp.org>
wrote:
On Tuesday, September 16th, 2025 at 17:01, Bill Degnan
via cctalk <
cctalk(a)classiccmp.org> wrote:
I run a web services company, vintagecomputer.net is internally-supported.
vintagecomputer.net has been dealing with some sort of scrapers for 20
years. The site is privately hosted and has web scraping control measures,
built to detect a whole array of bot activity. Rather than block, I
believe it's better to detect and log, and then determine how best to
manage new types of bot probing and scraping on an ongoing basis, it's a
great way to learn white hat hacking.
I wonder how long the WWW will remain open, it
would be a bummer if I
found
copies of my site elsewhere.
I've been thinking about this myself. It does not please me.
What web server do you use for your site? I've got some pretty robust but
easy to admin
countermeasures set up on my own website that I'd be happy to share if
there is interest.