ed
ed@digipres.club
<p>Preservation is Access, in the future!<br />The web is a preservation medium. <br />What would we be without wishful thinking?</p><p>Salut, J'essaie d'apprendre le français!</p>
Posts
-
View post
hey, it's #BandcampFriday -- time to empty my shopping cart of things that have accumulated over the last month
-
View post
We got educational Claude accounts at $work, so I succumbed and spent better part of a day working on this #webarchiving thing I've had in the back of my mind for a while: https://github.com/edsu/rustyweb It is a Rust service that will index the contents of WACZs and make them available via the web like Wayback. Embedded search with tantivy, can index PDFs as well as HTML, and can index remotely accessible WACZ files too.
-
View post
I knew that Stanford&#39;s president was forced to resign due to documented evidence of him having falsified research on multiple occasions. What I somehow missed till now was that a student at Stanford led the investigative reporting. He now has a book about this story and the deep entanglement of the university with bigtech money &amp; power. Here he is being interviewed on the PBS News Hour this evening: https://www.youtube.com/live/DW1y7h6gm7Y?t=1994
-
View post
For a project at work we wanted to be able to generate &quot;Gold Rush&quot; keys for MARC records, to help identify shared library holdings. I found a Python implementation bundled up in some other code from Princeton University Library, and extracted the relevant bits to a new installable module. https://gitlab.com/pymarc/goldrush I gave them copyright credit, and contacted them to see if they are ok with it. If they don&#39;t like the idea I will reimplement it.
-
View post
I&#39;ve got a CD-R (actually quite a few) that theoretically contain backed up audio recordings from 2003. I don&#39;t know what software created it, and macOS doesnt identify it as ISO 9660, so it won&#39;t mount. Does anyone have any suggestions for things I could try to identify and access the data?
-
View post
RE: https://mastodon.palewi.re/@palewire/116585705331625419 I love this example of using Wayback Machine as a source for bringing a website back from the ashes in a more documentary form.
-
View post
@acdha for single page I really like Harvard LIL&#39;s Scoop, which I believe is used by their flagship perma.cc service via a celery job that talks to scoop-api, a (closed source?) web service that wraps Scoop: https://github.com/harvard-lil/scoop#readme For more than one page crawls I think that @webrecorder&#39;s browsertrix-crawler is still the best thing out there. I helped write this howto, which I stand by: https://sciop.net/docs/scraping/webpages/ PS. thanks for asking me abo...
-
View post
@acdha and yes, the llm bot defenses are a real problem for web archives. I saw in IIPC Slack yesterday that they are considering this as a topic for a technical meeting at the next conference in a few weeks (meeting may be open to remote participation). Cloudflare has a Verified Bot registry, which I think some web archiving orgs have gotten on? https://radar.cloudflare.com/bots#verified-bots e.g. https://radar.cloudflare.com/bots/directory/kb-dk-bot
-
View post
@acdha nice, happy to jump on a zoom sometime to chat about it -- browsertrix-crawler gets a lot of attention from Webrecorder since their https://webrecorder.net/browsertrix/ service depends on it.
-
View post
#SilentSunday (ok I lied, there is sound)
-
View post
I&#39;m fiddling around with the Altmetric API (since we have access at $work). I sampled 12,109 DOIs (not random) from our database of publications by Stanford authors. 8,797 (73%) have Altmetric data. Altmetric have different categories of citations that they track: facebook, blogs, twitter, bluesky, news, etc.
-
View post
@stuartyeates is that pointing at the same resource as https://viaf.org/en/viaf/158359701 ?
-
View post
@stuartyeates even more confusing!
-
View post
TIL that ORCID identifiers are available as #LinkedData : https://gist.github.com/edsu/9be9658f9c6d300c569bae9b1016e108
-
View post
Have we learned nothing? https://thedailyrecord.com/2026/03/27/coinbase-brings-token-backed-down-payments-to-housing-market/
-
View post
Bernie is smart to have AOC by his side, because she actually gets the political &amp; economic significance of AI. https://www.youtube.com/live/6B2x2FrJa6w?si=LAB2iHygiVi91n4A
-
View post
#TIL the word &quot;shad&quot; https://www.thefreedictionary.com/shad
-
View post
#TIL that Georges Perec worked as an archivist. https://en.wikipedia.org/wiki/Georges_Perec