[Octave-bug-tracker] [bug #56196] Octave crashes if isdefinite is called with a special sparse matrix

[anonymous]

URL:
  <https://savannah.gnu.org/bugs/?56196>

                 Summary: Octave crashes if isdefinite is called with a
special sparse matrix
                 Project: GNU Octave
            Submitted by: None
            Submitted on: Tue 23 Apr 2019 11:19:20 AM UTC
                Category: Octave Function
                Severity: 3 - Normal
                Priority: 5 - Normal
              Item Group: Segfault, Bus Error, etc.
                  Status: None
             Assigned to: None
         Originator Name: Octave user
        Originator Email: address@hidden
             Open/Closed: Open
         Discussion Lock: Any
                 Release: 5.1.0
        Operating System: Microsoft Windows

    _______________________________________________________

Details:

If you run the script in the attached file, octave crashes because of an
invalid NULL pointer access. In octave-4.4.1 the problem does not occur.

See the stack trace below:

(gdb) run -f octave_isdefinite.m
Starting program: c:\Octave\octave-5.1.0-w64\mingw64\bin\octave-cli.exe -f
octave_isdefinite.m
[New Thread 7792.0x23f0]
[New Thread 7792.0x20bc]
[New Thread 7792.0x153c]
[New Thread 7792.0x6b0]
[New Thread 7792.0x222c]
[New Thread 7792.0x2160]
[New Thread 7792.0xc6c]
[New Thread 7792.0x1ca8]
[New Thread 7792.0x630]
warning: ERROR !!! HeapSetInformation failed to set g_Heap to LFH
warning: ERROR !!! HeapSetInformation failed to set g_SpyHeap to LFH
[New Thread 7792.0x1d90]
[New Thread 7792.0x1cbc]
[New Thread 7792.0xfcc]

Thread 1 received signal SIGSEGV, Segmentation fault.
0x000007fefde11049 in msvcrt!memset () from C:\Windows\system32\msvcrt.dll
(gdb) bt full
#0  0x000007fefde11049 in msvcrt!memset () from
C:\Windows\system32\msvcrt.dll
No symbol table info available.
#1  0x000000006ef7d75d in ?? () from
c:\Octave\octave-5.1.0-w64\mingw64\bin\libcholmod.dll
No symbol table info available.
#2  0x000000006ef9b186 in ?? () from
c:\Octave\octave-5.1.0-w64\mingw64\bin\libcholmod.dll
No symbol table info available.
#3  0x000000006ef9c32a in ?? () from
c:\Octave\octave-5.1.0-w64\mingw64\bin\libcholmod.dll
No symbol table info available.
#4  0x00000000699cb2ad in
liboctave-7!_ZN6octave4math11sparse_cholI12SparseMatrixE15sparse_chol_rep4initERKS2_bb
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctave-7.dll
No symbol table info available.
#5  0x00000000699ccf88 in
liboctave-7!_ZN6octave4math11sparse_cholI12SparseMatrixEC1ERKS2_Rxbb () from
c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctave-7.dll
No symbol table info available.
#6  0x00000000686c7ccc in chol!_Z5FcholRK17octave_value_listi () from
c:\Octave\octave-5.1.0-w64\mingw64\lib\octave\5.1.0\oct\x86_64-w64-mingw32\chol.oct
No symbol table info available.
#7  0x00000000714d856f in
liboctinterp-7!_ZN14octave_builtin4callERN6octave14tree_evaluatorEiRK17octave_value_list
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#8  0x00000000715e7eea in
liboctinterp-7!_ZN6octave14tree_evaluator22visit_index_expressionERNS_21tree_index_expressionE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#9  0x0000000071b31d55 in
liboctinterp-7!_ZN6octave14tree_evaluator10evaluate_nEPNS_15tree_expressionEi
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#10 0x00000000715e9c91 in
liboctinterp-7!_ZN6octave14tree_evaluator22visit_multi_assignmentERNS_21tree_multi_assignmentE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#11 0x0000000071b31fe6 in
liboctinterp-7!_ZN6octave14tree_evaluator8evaluateEPNS_15tree_expressionEi ()
from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#12 0x00000000715e4b40 in
liboctinterp-7!_ZN6octave14tree_evaluator15visit_statementERNS_14tree_statementE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#13 0x00000000715da22b in
liboctinterp-7!_ZN6octave14tree_evaluator20visit_statement_listERNS_19tree_statement_listE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#14 0x00000000715e683a in
liboctinterp-7!_ZN6octave14tree_evaluator21execute_user_functionER20octave_user_functioniRK17octave_value_list
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#15 0x0000000071578df3 in
liboctinterp-7!_ZN20octave_user_function4callERN6octave14tree_evaluatorEiRK17octave_value_list
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#16 0x00000000715e7eea in
liboctinterp-7!_ZN6octave14tree_evaluator22visit_index_expressionERNS_21tree_index_expressionE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#17 0x0000000071b31fe6 in
liboctinterp-7!_ZN6octave14tree_evaluator8evaluateEPNS_15tree_expressionEi ()
from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#18 0x00000000715e2609 in
liboctinterp-7!_ZN6octave14tree_evaluator23convert_to_const_vectorEPNS_18tree_argument_listEPK12octave_value
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#19 0x00000000715e818e in
liboctinterp-7!_ZN6octave14tree_evaluator22visit_index_expressionERNS_21tree_index_expressionE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#20 0x0000000071b31fe6 in
liboctinterp-7!_ZN6octave14tree_evaluator8evaluateEPNS_15tree_expressionEi ()
from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#21 0x00000000715e4b40 in
liboctinterp-7!_ZN6octave14tree_evaluator15visit_statementERNS_14tree_statementE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#22 0x00000000715da22b in
liboctinterp-7!_ZN6octave14tree_evaluator20visit_statement_listERNS_19tree_statement_listE
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#23 0x00000000715de7cd in
liboctinterp-7!_ZN6octave14tree_evaluator19execute_user_scriptER18octave_user_scriptiRK17octave_value_list
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#24 0x0000000071578d83 in
liboctinterp-7!_ZN18octave_user_script4callERN6octave14tree_evaluatorEiRK17octave_value_list
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#25 0x00000000715cd22c in
liboctinterp-7!_ZN6octave11source_fileERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES7_bbS7_
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#26 0x0000000071853cd0 in
liboctinterp-7!_ZN6octave11interpreter22recover_from_exceptionEv () from
c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#27 0x0000000071858c75 in
liboctinterp-7!_ZN6octave11interpreter25execute_command_line_fileEv () from
c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#28 0x000000007185bd55 in liboctinterp-7!_ZN6octave11interpreter7executeEv ()
from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#29 0x0000000071141527 in liboctinterp-7!_ZN6octave15cli_application7executeEv
() from c:\Octave\octave-5.1.0-w64\mingw64\bin\liboctinterp-7.dll
No symbol table info available.
#30 0x0000000000402e80 in octave-cli!main ()
No symbol table info available.
(gdb) 


The illegal instruction is


0x000007fefde11049 <msvcrt!memset+73>:  mov    %rdx,(%rcx)


And the registers are

rax    0x0
rbx    0x0
rcx    0x0
rdx    0x0
rsi    0x22d4d0
rdi    0xfffffffe
rbp    0x1
rsp    0x22cf28
r8     0x20
r9     0x2
r10    0x1
r11    0x50
r12    0x8b7fc10
r13    0x9064e48
r14    0x8fdbdc0
r15    0x14
rip    0x7fefde11049
eflags 0x10283
cs     0x33
ss     0x2b
ds     0x2b
es     0x2b
fs     0x53
gs     0x2b






    _______________________________________________________

File Attachments:


-------------------------------------------------------
Date: Tue 23 Apr 2019 11:19:20 AM UTC  Name: A.mat  Size: 5KiB   By: None

<http://savannah.gnu.org/bugs/download.php?file_id=46814>
-------------------------------------------------------
Date: Tue 23 Apr 2019 11:19:20 AM UTC  Name: octave_isdefinite.m  Size: 85B  
By: None

<http://savannah.gnu.org/bugs/download.php?file_id=46815>

    _______________________________________________________

Reply to this item at:

  <https://savannah.gnu.org/bugs/?56196>

_______________________________________________
  Message sent via Savannah
  https://savannah.gnu.org/