octave-maintainers
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: 64-bit indexing version of Octave release


From: Dyer, Norman Jay
Subject: Re: 64-bit indexing version of Octave release
Date: Mon, 18 Oct 2021 07:21:56 +0000

Dear Kai,


A belated but warm thank you for your work to create an Octave-w64-64 in a Container.

For those Linux machines with Singularity installed, your Octave installation only required 2 easy commands:

singularity pull docker://gnuoctave/octave:6.3.0

singularity run octave_6.3.0.sif

Everything complete!


A HUGE improvement over the earlier alternative script exercises ! !


I encourage you to post on the webpage: gnu.org/software/octave/download


**

§ GNU/Linux

Packaged versions of Octave for GNU/Linux systems are provided by the individual distributions described in the Octave wiki. These packages are created by volunteers. The delay between an Octave source release and the availability of a package for a particular GNU/Linux distribution varies.

Alternatively, there is a growing use of Containers which bypass the many flavors of Linux and deal directly with the Linux core. This requires prior installation of Singularity.

  • Octave 6.3.0-w64-64 (large data indexing) :

singularity pull docker://gnuoctave/octave:6.3.0-w64-64

singularity run octave_6.3.0-w64-64.sif


See https://sylabs.io/guides/3.7/user-guide/quick_start.html for info on Singularity.

**


Given Torvalds’ complaints about 'too damn many individual distributions’, is not this the wave of the future? (to containerize all Linux apps, and only that)


In which case, we would see a switch to:


**

§GNU/Linux

Install Singularity so as to allow download of one of these Containers to the Linux core.

  • octave-6.3.0-w32 (old machines)

  • octave-6.3.0-w64 (most machines)

  • octave-6.3.0-w64-64 (big data machines)

**

... and there would be no delay waiting for the various distribution volunteers.


kind regards,

Norm


P.S. I was distracted from responding to you on Sep12 when octave was installed because I immediately hit more memory limitation problems. Even with 128 gb RAM. There were JAVA memory allocations on top of Fedora memory allocations – still not satisfactorily set up for my purposes. Sorry for my delay in contacting you. My bad.



From: Kai Torben Ohlhus <k.ohlhus@gmail.com>
Sent: Friday, September 10, 2021 8:09 AM
To: Dyer, Norman Jay <ndyer1@uic.edu>
Cc: octave-maintainers <octave-maintainers@gnu.org>
Subject: Re: 64-bit indexing version of Octave release
 
Dear Norm,

You can see all build steps for the images in the respective Dockerfiles
"build-octave-6.docker" -> "octave-6.docker".

64-bit modifications for

OpenBLAS:
https://nam04.safelinks.protection.outlook.com/?url="">

SiteSparse:
https://nam04.safelinks.protection.outlook.com/?url="">

ArpackNG:
https://nam04.safelinks.protection.outlook.com/?url="">

QRupdate:
https://nam04.safelinks.protection.outlook.com/?url="">

Octave:
https://nam04.safelinks.protection.outlook.com/?url="">

Of course you can just apply those compilation steps from the Docker
images to a custom self-compiled version of the libraries and Octave.
This was my initial approach about 4 years ago:

  
https://nam04.safelinks.protection.outlook.com/?url="">
   (abandoned project)

 From this project the Docker project evolved in the past two years.  It
is too difficult to compile Octave from scratch with all dependencies on
every machine you like to use Octave.  Needless to say explaining these
compilation steps to a normal mortal Linux user :)

Docker (Podman/Singularity) they all work with those created images,
hosted on DockerHub, have some limitations, but for me this is currently
the only known working version for Linux to get the 64-bit libraries
conveniently right.

Flatpack, Snap, etc. they all do not address this 64-bit library issue.
And forked versions cannot be distributed as easily as Docker images.

Kai


On 9/10/21 7:31 AM, Dyer, Norman Jay wrote:
> Hello Kai,
> great news to hear of your work with octave in containers.  Thanks in
> advance.
> I have Singularity on Fedora 34 (linux kernel 5.12) on an HP Z820  with 
> 32 cpu, 128 gb ram and 8T of SAS for purposes of handling large sparse
> arrays, which is beyond what the standard issue 32-bit indexing of
> Octave can handle -  BUT the modified-at-load-time 64-bit indexing
> option WILL handle.
> Referring to
>
https://nam04.safelinks.protection.outlook.com/?url="">
> <
https://nam04.safelinks.protection.outlook.com/?url="">> 
> for clarification.
> Note the load modifiers on 4 dependencies.
> So, in your packaging / containers I'm looking for how those
> dependencies get set to 64-bit indexing  (what Octave identifies as
> -64-64  or  --enable-64).
> If you will confirm these tweeks, then I am ready and enthusiastic to
> get this container up and working.
> (I originally joined this group as a volunteer requirements writer, but
> most of that seems merely to be 'clone matlab functionality', so ...) .
> Thanks for all,   Norm
> GNU Octave: Compiling Octave with 64-bit Indexing
> <
https://nam04.safelinks.protection.outlook.com/?url="">>
> G.3 Compiling Octave with 64-bit Indexing. Note: the following only
> applies to systems that have 64-bit pointers. Configuring Octave with
> --enable-64 cannot magically make a 32-bit system have a 64-bit address
> space.. On 64-bit systems, Octave is limited to (approximately) the
> following array sizes when using the default 32-bit indexing mode:
> octave.org
>
>
> ------------------------------------------------------------------------
> *From:* Kai Torben Ohlhus <k.ohlhus@gmail.com>
> *Sent:* Saturday, September 4, 2021 7:39 AM
> *To:* Dyer, Norman Jay <ndyer1@uic.edu>
> *Cc:* octave-maintainers@gnu.org <octave-maintainers@gnu.org>
> *Subject:* Re: 64-bit indexing version of Octave release
> Dear Norm,
>
> An unexpected and welcome request 🙂  What links you to this mailing-list?
>
> The most reliable approach to get Octave and the 64-bit indexing
> (including all library dependencies) on Linux running is the
> Docker-image I am using and maintaining.  Details are described here [1]
> and here [2].
>
> If you have either Singularity, Docker, or Podman installed, using the
> installer script (please change the end of the command accordingly):
>
>      /bin/bash -c "$(curl -fsSL
>
https://nam04.safelinks.protection.outlook.com/?url="">
> <
https://nam04.safelinks.protection.outlook.com/?url="">>)"
>
> install -t singularity
>
> Octave feels like installed via your systems package manager and works
> for me like a charm 🙂
>
> If you have any trouble, please open an issue on GitHub [3] or write me
> again.
>
> Best wishes,
> Kai
>
>
> On 9/4/21 9:04 PM, Dyer, Norman Jay wrote:
>> Dear Kai,
>> How about once in a while releasing a ready-made  64-bit indexing version?
>> I, for one ,have been waiting since 2008 for this.  Thank you much.
>> I've seen a windows release last year, but cannot find any linux
>> releases.  I'm on red hat fedora, but could probably get an Ubuntu
>> version to work.
>> I've tried to follow the recipe for pre-load alterations, but some 2
>> dozen attempts always errored out.
>> Thanks for your consideration,
>> Norm
>>
>
> [1]
>
https://nam04.safelinks.protection.outlook.com/?url="">
> <
https://nam04.safelinks.protection.outlook.com/?url="">>
> [2]
>
https://nam04.safelinks.protection.outlook.com/?url="">
> <
https://nam04.safelinks.protection.outlook.com/?url="">>
> [3]
>
https://nam04.safelinks.protection.outlook.com/?url="">
> <
https://nam04.safelinks.protection.outlook.com/?url="">>

reply via email to

[Prev in Thread] Current Thread [Next in Thread]