Re: Loading tramp for dump goes into infinite regress

[Lynn Winebarger]

On Sun, Jul 24, 2022 at 8:23 AM Eli Zaretskii <eliz@gnu.org> wrote:
>
> > From: Lynn Winebarger <owinebar@gmail.com>
> > Date: Sun, 24 Jul 2022 08:05:30 -0400
> > Cc: emacs-devel <emacs-devel@gnu.org>
> >
> >  I don't even understand what you're trying. Could you pls give the
> >  commands you're calling, that I have a chance to reproduce?
> >
> > Good point.  I'm trying to dump a "fully-loaded" emacs 28.1 that includes 
> > several hundred packages from the
> > various elpas.  I've modified those packages so they reside in site-lisp, 
> > use cl-lib instead of cl, and use an
> > explicit data directory instead of loading files relative to the location 
> > of an installed .el file.
> > I verified these all "work" by having about 1000 require statements in my 
> > .emacs file to explicitly require
> > them.  I then took the load history and separated the files into ones from 
> > the lisp directory and ones from
> > site-lisp.  I created a site-load.el and site-lisp-load.el (loaded at the 
> > end of site-load.el) to explicitly load the
> > files in something resembling dependency order, then running make in the 
> > emacs build directory to create
> > the build.
>
> Note that Micheal asked you to show specific commands you used, so he
> could try reproducing the problems you see, but you haven't provided
> any such commands, only a rather general description of what you are
> trying to do.
>
> Can you please show the shell commands that you use to do the loading
> step?

That would be "make -j$(nproc)", which seems unhelpful.
A more detailed setup (from memory, since I did this on my employer's
system) would be:
------------------------
tar -xzf emacs-28.1-<whatever>.tar.gz
cd emacs-28.1
./autogen.sh
mkdir BUILD
cd BUILD
../configure --prefix=/does/not/exist --with-native-compilation
make -j$(nproc)
find ../lisp -name '*.el' | while read src; do ./src/emacs --batch
--eval "(batch-byte+native-compile)" $(src); done
< follow the steps I described to create the lisp/site-load.el file >
< create a file site-load.mk based on the shell commands in
src/Makefile.in for lisp.mk >
rm etc/DOC
( cd src; make ../etc/DOC )
./lib-src/make-docfile -d lisp -a etc/DOC $(<site-load.mk)
make -j$(nproc)
--------------------------
When the last step stops, I try to fix the issue in the elisp file,
delete the corresponding .elc, then rerun the batch compile command
above before rerunning the last make command.

>
> > I've also compiled every ELISP source file using batch-byte+native-compile. 
> >  That was really painful since,
> > as far as I know, the files can't be native compiled in parallel in 
> > arbitrary order because of potential race
> > conditions, and I haven't made a Makefile for the .ELN files with the 
> > correct dependencies to native compile
> > them in dependency order using make to build them in parallel.
>
> I'm not aware of any such problems.  IME, native compilation can run
> in parallel in any order, and no race conditions of any kind are
> supposed to happen.

Ok, great.  I thought I read, in either the gccemacs blog or the
emacs-devel archive, some concern about race conditions in building
eln files, probably in relation to the async scheduling.  Maybe I am
mistaken or that concern was resolved in the interim.
I'd still like to create that Makefile to do the compilaton in order.
I mean, I have created a file recording the dependencies to the extent
lib-require.el can determine them, but I haven't produced a working
Makefile as of yet.

Lynn