Re: Preservation of Guix 2021-10-22

[zimoun]

Hi,

On Sat, 23 Oct 2021 at 11:55, Timothy Sample <samplet@ngyro.com> wrote:

> Download the database (there’s a button at the bottom of the report),
> and use SQLite to run the following queries.

Cool!  Thanks.


If someone wants to help,

    $ wget https://ngyro.com/pog-reports/2021-10-22/pog.db
    $ guix environment --ad-hoc sqlite -- sqlite3
    sqlite> .open pog.db
    sqlite>

then copy/paste that:

> For the 376:
>
>     SELECT fod_id,
>         swhid,
>         reference
>     FROM fods
>         LEFT JOIN fod_references USING (fod_id)
>     WHERE NOT is_in_swh
>         AND reference LIKE '(git-reference%';

Therefore, I start with these ones.  After this query, a quick Emacs
macro to keep the URLs and then sort them to see if a pattern emerges.
Nothing flashy.  For the record, I get 214 GitHub URLs and 32 GitLab
(.com) ones.  I also note, among various stuff, that:

 "https://notabug.org/cwebber/guile-squee.git";
 "https://notabug.org/mothacehe/guile-squee.git";

because one is defined at (gnu packages guile-xyz) by guile-squee and
the other at (gnu packages ci) by guile-squee-dev.  Then, other remark:
Julia packages are listed:

 "https://github.com/JuliaArrays/OffsetArrays.jl";
 "https://github.com/JuliaArrays/StaticArrays.jl";
 "https://github.com/JuliaCI/BenchmarkTools.jl";
 "https://github.com/JuliaCollections/OrderedCollections.jl";
 "https://github.com/JuliaData/Parsers.jl";
 "https://github.com/JuliaDiff/ChainRules.jl";
 "https://github.com/JuliaDiff/ChainRulesCore.jl";
 "https://github.com/JuliaDiff/ChainRulesTestUtils.jl";
 "https://github.com/JuliaDiff/FiniteDifferences.jl";
 "https://github.com/JuliaGPU/Adapt.jl";
 "https://github.com/JuliaGraphics/ColorTypes.jl";
 "https://github.com/JuliaGraphics/Colors.jl";
 "https://github.com/JuliaLang/Compat.jl";
 "https://github.com/JuliaObjects/ConstructionBase.jl";
 "https://github.com/JuliaPackaging/JLLWrappers.jl";
 "https://github.com/JuliaWeb/URIs.jl";

when I am sure to have scheduled them couple of days (weeks?) ago.
Therefore, I have not investigated yet if the archiving failed or if POG
is behind.

Another general remark, some URLs are duplicated, for instance:

 "https://codeberg.org/dnkl/fcft";
 "https://git.cbaines.net/git/guix/build-coordinator";
 "https://git.code.sf.net/p/wsjt/wsjtx.git";
 "https://git.code.sf.net/u/bsomervi/hamlib.git";
 "https://git.elephly.net/software/mumi.git";
 "https://git.mfiano.net/mfiano/golden-utils";
 "https://git.sr.ht/~bzg/org-contrib";
 "https://git.systemreboot.net/guile-email";
 "https://git.systemreboot.net/guile-xapian";
 "https://git.umaneti.net/flycheck-grammalecte/";
 "https://github.com/Eloston/ungoogled-chromium";
 etc.
 …
 
I have not checked if several packages refer to the same URL.


Now, the core point.  Running ’save-origin’ form (guix swh) on the URLs,
I get for instance:

        https://code.divoplade.fr/mkdir-p.git   accepted        failed
        git://pumpa.branchable.com      accepted        failed

for some I have checked.  Investigation why they fails is required.


Last, I failed to use TOKEN from “guix repl”.  I just do:

--8<---------------cut here---------------start------------->8---
(use-modules (guix swh)
             (srfi srfi-1))

(setenv "TOKEN"
        "eyJhb…"
         )

(define missings
  (list
   "git://pumpa.branchable.com/"

[...]

   "https://salsa.debian.org/installer-team/debootstrap.git";
   ))

(for-each
 (lambda (url)
   (save-origin url))
 missings)
--8<---------------cut here---------------end--------------->8---

but this fails.  What do I miss?  Does %swh-token need to be exported
and tweaked in the script?


Cheers,
simon