gioia://news
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
psychothumbs@lemmy.world to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 2 years ago

The New York Times tried to block the Internet Archive: another reason to value the latter

walledculture.org

external-link
message-square
68
fedilink
  • cross-posted to:
  • technology@lemmy.world
1.18K
external-link

The New York Times tried to block the Internet Archive: another reason to value the latter

walledculture.org

psychothumbs@lemmy.world to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.comEnglish · 2 years ago
message-square
68
fedilink
  • cross-posted to:
  • technology@lemmy.world

Walled Culture has already written about the two–pronged attack by the copyright industry against the Internet Archive, which was founded by Brewster Kahle, whose Kahle/Austin Foundation supports this blog. The Intercept has an interesting article that reveals another reason why some newspaper publishers are not great fans of the site: The New York Times tried …

  • pootriarch@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    4
    ·
    2 years ago

    It exists, it’s called a robots.txt file that the developers can put into place, and then bots like the webarchive crawler will ignore the content.

    the internet archive doesn’t respect robots.txt:

    Over time we have observed that the robots.txt files that are geared toward search engine crawlers do not necessarily serve our archival purposes.

    the only way to stay out of the internet archive is to follow the process they created and hope they agree to remove you. or firewall them.

    https://blog.archive.org/2017/04/17/robots-txt-meant-for-search-engines-dont-work-well-for-web-archives/

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com

piracy@lemmy.dbzer0.com

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !piracy@lemmy.dbzer0.com
⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don’t request invites, trade, sell, or self-promote

3. Don’t request or link to specific pirated titles, including DMs

4. Don’t submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):

  • 🪶 Megathread
  • 🪶 FAQ
  • 🪶 ISP Complaints
  • 🪶 Rules
  • 🪶 Glossary

🏴‍☠️ Other communities

FUCK ADOBE!

  • !GenP@lemmy.dbzer0.com

Torrenting/P2P:

  • !seedboxes@lemmy.dbzer0.com
  • !trackers@lemmy.dbzer0.com
  • !qbittorrent@lemmy.dbzer0.com
  • !libretorrent@lemmy.dbzer0.com
  • !soulseek@lemmy.dbzer0.com

Gaming:

  • !steamdeckpirates@lemmy.dbzer0.com
  • !newyuzupiracy@lemmy.dbzer0.com
  • !switchpirates@lemmy.dbzer0.com
  • !3dspiracy@lemmy.dbzer0.com
  • !retropirates@lemmy.dbzer0.com

💰 Please help cover server costs.

Ko-Fi Liberapay
Ko-fi Liberapay

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 112 users / day
  • 1.67K users / week
  • 4.97K users / month
  • 11.4K users / 6 months
  • 1 local subscriber
  • 61.2K subscribers
  • 3.79K Posts
  • 93.2K Comments
  • Modlog
  • mods:
  • db0@lemmy.dbzer0.com
  • sunbrothersco@lemmy.dbzer0.com
  • Dataprolet@lemmy.dbzer0.com
  • Unruffled [they/them]@lemmy.dbzer0.com
  • RandomLegend [He/Him]@lemmy.dbzer0.com
  • Andromxda 🇺🇦🇵🇸🇹🇼@lemmy.dbzer0.com
  • CosmicTurtle0@lemmy.dbzer0.com
  • tenchiken@lemmy.dbzer0.com
  • BE: 0.19.9
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org