TwinTurbo.NET: Nissan 300ZX forum - Re: LLM crawlers we don't have a defense for.
Subject
Re: LLM crawlers we don't have a defense for.
Posted by
zquikone
on August 29, 2025 at 11:32 PM
This message has been viewed
8
times.
In Reply To
LLM crawlers we don't have a defense for.
posted by Dallas DamonZ
on August 26, 2025 at 05:11 PM
Message
Robots.txt to block/disallow ai agents like GPTBot?
Follow Ups
Just an observation...
-
Zeus
11:10:27 08/26/25
I saw that too
-
Polishzx
14:18:59 08/26/25
I wonder if an AI would know where's ash? (n/m)
-
zantar
18:36:25 08/26/25
ba-DUM! *tish* (n/m)
-
vorpalZed
15:50:03 08/27/25
LLM crawlers we don't have a defense for.
-
Dallas DamonZ
17:11:19 08/26/25
Got it. Thanks for the insight, Damon. (n/m)
-
Zeus
08:58:35 08/28/25
If it ever becomes overly burdensome from a cost standpoint
-
Zeus
10:29:34 08/28/25
Re: If it ever becomes overly burdensome from a cost standpoint
-
nate91Z
10:05:46 08/29/25
Re: LLM crawlers we don't have a defense for. -
zquikone
23:32:38 08/29/25
Post a
Followup
You cannot reply to this message because you are not
logged in
.