---
title: "Blocking AI web crawlers (update)"
date: "2024-04-20T22:14-08:00"
tags: ["tech", "ai"]
description: "AI companies crawl websites to train their large language models (LLMs). Aside from using copyrighted material that is not their’s to copy, there is the huge environmental cost¹ in the training and use of LLMs."
link: "https://underlap.org/blocking-ai-web-crawlers-vjp5"
---