Celebrating 30 Years of the Web: A Cautionary Reflection
Written on
Chapter 1: The Birth of the World Wide Web
On April 30, 1993, Tim Berners-Lee, a pioneering computer scientist, made the source code for the World Wide Web available to the public. Thanks to CERN, the international scientific organization located in Switzerland, we can still view the first website, complete with fully functional hyperlinks.
However, many other links and sites have not enjoyed the same preservation. Three decades later, the phenomenon known as "link rot"—the gradual decay of hyperlinks—has become a significant issue, described by web developer Jeremy Keith as “the entropy of the web.” This issue is alarmingly widespread; for instance, a 2013 study by researcher Jonathan Zittrain revealed that nearly half of the links found in U.S. Supreme Court decisions were dead. Furthermore, a 2021 investigation indicated that a quarter of links from New York Times articles dating back to 1996 lead to pages that are now completely inaccessible.
At least institutions like SCOTUS and the Times have physical archives. Unfortunately, all-digital resources lack such backup, and I am painfully aware that my own blog, active since 2006, contains numerous links that result in “404 not found” errors. Despite my efforts to maintain link integrity, it often feels like an insurmountable challenge.
Section 1.1: The Causes of Link Rot
There are several reasons that contribute to link rot, including expired domains, website restructuring, dynamic content, and deleted pages.
Section 1.2: A Silver Lining Amidst the Decay
Despite the challenges posed by link rot, there are some encouraging developments. Over the past twelve years, many websites have transitioned from the less secure HTTP protocol to the safer HTTPS standard. In 2011, Jeremy Keith speculated that a specific URL he referenced wouldn’t last eleven years. In 2022, he humorously acknowledged that he had lost that bet, stating, “If I could tell my past self that most of the web would be using HTTPS by 2022, my past self would be very surprised.”
Another saving grace has been the Internet Archive, specifically its Wayback Machine, which offers snapshots of websites throughout history—allowing access to older versions of sites (Hello, my former website from July 2000!).
Chapter 2: Innovations for Preservation
One notable initiative aimed at combating link rot is Amber, originally known as Amberlink, a project developed by Harvard University’s Berkman Klein Center for Internet & Society. The center was co-founded by Jonathan Zittrain, who authored the 2021 Atlantic article, “The Internet Is Rotting,” which presents a grim outlook on knowledge decay.
Amber is a free, open-source plug-in designed to keep hyperlinks functional. By installing this tool, users can automatically save snapshots of every page linked to on their website, providing a fallback option should those links become inaccessible.
The concept of amber, which refers to fossilized tree resin that can preserve organic matter indefinitely, serves as an apt metaphor for this innovative tool. While Amber's capabilities are still somewhat limited and it won’t be the sole solution to an ailing internet, it represents a commendable effort to safeguard our digital landscape. As Keith aptly pointed out, “People used to say ‘once something is online it’s there forever!’, which infuriated me because the real problem is the exact opposite: if you put something online, you have to put in real effort to keep it online.”
Celebrating 30 years of the Web with Sir Tim Berners-Lee at the Science Museum. A look back at the creation and evolution of the World Wide Web.
The World Wide Web turns 30 years old. Reflecting on its impact, challenges, and the road ahead.
Happy 30th birthday to the World Wide Web! Let us strive to ensure it remains vibrant and accessible for many more years to come.