grep

[InoBill [boss]]

Greetings bug-gnu-utils,

Hello guys, I got serious poblems with grep perfomance in all new Linux 
distributions =(

Version:

/bin/grep --version
grep (GNU grep) 2.5.1

Copyright 1988, 1992-1999, 2000, 2001 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Processed command:
cat filename.in|grep -i -E "string$" > filemane.out &

Systems confuguration:

config: 2.8 Hz Dual Xeon, 2 Gb Ram, 2x146 Gb Scsi

Old Linux information (good perfomance):

uname -a: Linux localhost 2.4.28-grsec #1 SMP Sun Nov 28 11:53:59 EST 2004 i686 
i686 i386 GNU/Linux

cat /etc/redhat-release: Red Hat Linux release 9 (Shrike)

top (while grep process):
 22:40:10  up 166 days, 14:54,  2 users,  load average: 0.90, 0.94, 1.20
68 processes: 65 sleeping, 3 running, 0 zombie, 0 stopped
CPU0 states:   4.0% user  11.0% system    0.0% nice   0.0% iowait  85.0% idle
CPU1 states:   0.0% user   4.0% system    0.0% nice   0.0% iowait  96.0% idle
CPU2 states:   5.0% user  16.0% system    0.0% nice   0.0% iowait  79.0% idle
CPU3 states:   3.0% user   1.0% system    0.0% nice   0.0% iowait  96.0% idle

  PID USER     PRI  NI  SIZE  RSS SHARE STAT %CPU %MEM   TIME CPU COMMAND
12465 root      19   0   408  408   356 R    21.7  0.0   0:16   0 cat
11557 root      18   0   628  628   516 R    16.5  0.0   0:14   0 grep

New Linux information (bad perfomance):

uname -a: Linux localhost 2.6.11.12-grsec #1 SMP Tue Sep 6 12:00:44 PDT 2005 
i686 i686 i386 GNU/Linux

cat /etc/redhat-release: CentOS release 4.1 (Final)

top (while grep process):
 09:27:24 up 14:00,  1 user,  load average: 0.69, 0.21, 0.07
Tasks:  74 total,   2 running,  72 sleeping,   0 stopped,   0 zombie
Cpu0  : 100.0% us,  0.0% sy,  0.0% ni,  0.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu1  :  1.0% us,  2.0% sy,  0.0% ni, 97.0% id,  0.0% wa,  0.0% hi,  0.0% si
Cpu2  :  0.0% us,  0.0% sy,  0.0% ni, 99.0% id,  1.0% wa,  0.0% hi,  0.0% si
Cpu3  :  0.0% us,  0.0% sy,  0.0% ni, 100.0% id,  0.0% wa,  0.0% hi,  0.0% si
Mem:   2075360k total,  1359400k used,   715960k free,    47248k buffers
Swap:  1052248k total,      184k used,  1052064k free,  1193264k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND            
                                                    
18214 root      25   0  3868  868  588 R 99.9  0.0   1:13.88 grep               
                                                    
18213 root      15   0  3572  404  344 S  3.0  0.0   0:00.51 cat

Test results:

for 5 minutes of test from the same file:

New Linux processed: 97855 lines
Old linux processed: 4544622 lines

4544622/97855=46 times - reduction of the perfomance =(

Working with data about 100GB ... need you quick help of suggestions
concerning new Linux Kernel dear guys! =) Thanks for your time =)

Best regards,
InoBill                          mailto:address@hidden